-- Logs begin at Thu 2021-12-16 13:51:19 UTC, end at Thu 2021-12-16 15:46:38 UTC. -- Dec 16 14:46:17.255736 dv-cinder-821894-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Dec 16 14:46:17.264387 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Dec 16 14:46:17.264867 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: open("./http_plugin.so"): No such file or directory [core/utils.c line 3732] Dec 16 14:46:17.264867 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: !!! UNABLE to load uWSGI plugin: ./http_plugin.so: cannot open shared object file: No such file or directory !!! Dec 16 14:46:17.264867 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: open("./python3_plugin.so"): No such file or directory [core/utils.c line 3732] Dec 16 14:46:17.264867 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: !!! UNABLE to load uWSGI plugin: ./python3_plugin.so: cannot open shared object file: No such file or directory !!! Dec 16 14:46:17.264867 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: *** Starting uWSGI 2.0.20 (64bit) on [Thu Dec 16 14:46:17 2021] *** Dec 16 14:46:17.264867 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: compiled with version: 7.5.0 on 16 December 2021 14:23:23 Dec 16 14:46:17.264867 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: os: Linux-4.15.0-55-generic #60-Ubuntu SMP Tue Jul 2 18:22:20 UTC 2019 Dec 16 14:46:17.264867 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: nodename: dv-cinder-821894-3-iscsi Dec 16 14:46:17.264867 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: machine: x86_64 Dec 16 14:46:17.264867 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: clock source: unix Dec 16 14:46:17.264867 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: pcre jit disabled Dec 16 14:46:17.264867 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: detected number of CPU cores: 4 Dec 16 14:46:17.264867 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: current working directory: / Dec 16 14:46:17.264867 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: detected binary path: /usr/local/bin/uwsgi Dec 16 14:46:17.264867 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: your processes number limit is 47843 Dec 16 14:46:17.264867 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: your memory page size is 4096 bytes Dec 16 14:46:17.264867 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: detected max file descriptor number: 2048 Dec 16 14:46:17.264867 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: lock engine: pthread robust mutexes Dec 16 14:46:17.264867 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: thunder lock: enabled Dec 16 14:46:17.266508 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Dec 16 14:46:17.266508 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: Python version: 3.6.9 (default, Dec 8 2021, 21:08:43) [GCC 8.4.0] Dec 16 14:46:17.311640 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: Python main interpreter initialized at 0x559ff877c5d0 Dec 16 14:46:17.311640 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: python threads support enabled Dec 16 14:46:17.311640 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: your server socket listen backlog is limited to 100 connections Dec 16 14:46:17.311640 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: your mercy for graceful operations on workers is 90 seconds Dec 16 14:46:17.312253 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: mapped 403077 bytes (393 KB) for 2 cores Dec 16 14:46:17.312253 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: *** Operational MODE: preforking *** Dec 16 14:46:17.312505 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: *** uWSGI is running in multiple interpreter mode *** Dec 16 14:46:17.312505 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: spawned uWSGI master process (pid: 87617) Dec 16 14:46:17.312497 dv-cinder-821894-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Dec 16 14:46:17.312993 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: spawned uWSGI worker 1 (pid: 87618, cores: 1) Dec 16 14:46:17.318124 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: spawned uWSGI worker 2 (pid: 87619, cores: 1) Dec 16 14:46:17.318124 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Dec 16 14:46:22.028657 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2567}} Dec 16 14:46:22.029212 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2568}} Dec 16 14:46:22.031086 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2569}} Dec 16 14:46:22.031521 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2571}} Dec 16 14:46:22.031808 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2572}} Dec 16 14:46:22.032303 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.032672 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.033037 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] bandwidth_poll_interval = 600 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.033407 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] bindir = /usr/local/bin {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.033761 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.034131 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.034609 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.034950 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.035297 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.035656 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.036025 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.036316 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.036669 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.037029 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-821894-3-iscsi {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.037387 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.037731 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.038099 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.038462 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.038797 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.039391 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.039729 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.040337 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.040679 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.041014 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.041379 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.041749 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.042113 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.042314 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2567}} Dec 16 14:46:22.042518 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.042640 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2568}} Dec 16 14:46:22.042929 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.043268 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.043636 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.043978 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.044341 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-821894-3-iscsi {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.044693 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.044806 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2569}} Dec 16 14:46:22.045035 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.045134 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2571}} Dec 16 14:46:22.045377 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.045485 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2572}} Dec 16 14:46:22.045861 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.045975 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.046233 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.046334 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.046577 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.046681 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] bandwidth_poll_interval = 600 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.046932 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.047037 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] bindir = /usr/local/bin {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.047324 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.047440 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.047608 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.047707 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.047977 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.048085 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.048324 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.048431 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.048678 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.048777 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.049025 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.049124 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.049357 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.049454 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.049658 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.049763 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.050640 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.050772 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.050772 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-821894-3-iscsi {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.051022 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.051022 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.051266 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.051406 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.051528 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.051662 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.051767 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.051943 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.052059 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.052204 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.052307 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.052444 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.052556 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.052702 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.052802 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.052953 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.053101 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.053213 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.053452 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.053609 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.053804 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.054013 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.054191 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.054339 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.054571 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.055245 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.055473 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.055649 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.055816 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.055977 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.056151 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.056293 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.056451 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.056576 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.056700 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.056821 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.057036 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.057215 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.057380 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-821894-3-iscsi {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.057546 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.057703 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.057874 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.058034 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.058242 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.058404 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.058558 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.058826 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.45 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.059007 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.059205 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.45 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.059361 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.059525 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.059672 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.059840 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.060006 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.060162 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.060306 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.060408 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.060562 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.060731 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.060841 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.061095 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.061198 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.061434 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.061541 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.061776 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.061894 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.062149 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.062334 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.062487 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.062712 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.062859 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.063002 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.063131 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.063270 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.063397 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.063545 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.063674 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.063830 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.063980 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.064109 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.064312 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.064418 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.064642 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.064772 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.064979 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.065082 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.065315 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.065426 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.065618 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.065719 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.065904 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.066007 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.066292 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.066395 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.066631 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.066732 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.066968 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.067076 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.067304 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.067405 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.067632 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.067740 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.067965 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.068066 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.068291 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.068391 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.068625 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.068724 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.068970 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.069076 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.069317 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.069416 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.069655 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.069754 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.069992 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.070199 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.070369 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.070967 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.071256 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.071370 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.071676 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.071790 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.45 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.071971 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.45 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.072082 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.072314 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.072438 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.072677 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.072787 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.073013 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.073113 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.073347 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.073446 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.073702 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.073935 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.074112 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.074375 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.074610 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.074710 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.075033 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.075212 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.075370 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.075733 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.075838 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.076072 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.076274 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.076409 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.076742 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.076841 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.077073 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.077356 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.077465 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.077708 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.077883 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.078071 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.078381 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.078482 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.078706 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.078916 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.079067 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.079430 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.079535 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.079767 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.079966 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.080103 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.080434 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.080532 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.080786 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.081105 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.081206 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.081521 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.081696 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.081932 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.082280 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.082397 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.082656 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.082877 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.083022 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.083369 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.083469 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.083712 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.083965 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.084072 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.084390 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.084490 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.084732 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.084958 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.085058 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.085384 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.085483 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.085740 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.085934 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.086155 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.086453 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.086562 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.086840 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.086939 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.087186 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.087429 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.087529 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.087848 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.087947 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.088196 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.088401 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.088557 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.088885 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.088984 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.089225 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.089378 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.089601 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.089865 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.090006 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.090372 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.090477 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.090741 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.090911 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.091071 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.091357 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.091540 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.091746 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.091929 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.092346 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.092608 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.092783 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.093003 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.093174 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.093343 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.093620 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.093793 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.094024 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.094263 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.094433 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.094592 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.094760 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.095008 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.095184 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.095329 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.095502 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.095658 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.095940 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.096108 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.096259 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.096460 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.096630 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.096954 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.097127 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.097300 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.097503 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.097677 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.097890 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.098158 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.098331 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.098502 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.098761 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.098925 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.099088 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.099247 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.099418 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.099580 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.099735 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.099901 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.100063 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.100225 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.100384 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.100544 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.100720 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.100890 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.101050 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.101217 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.101375 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.102105 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.102105 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.102420 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.102630 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:46:22.102795 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.102795 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.103121 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.103292 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.103452 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.103621 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.103795 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.103968 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.104127 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.104290 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.104451 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.104625 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.104784 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.104940 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.105096 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.105259 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.105483 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.105659 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.105817 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.105984 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.106230 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.106406 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.106574 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.106755 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.106928 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.107095 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.107255 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.107413 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.107573 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.107744 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.107905 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.108065 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.108223 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.108390 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.108552 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.108727 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.108727 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.109037 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.109206 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.109367 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.109546 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.109709 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.109846 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.110014 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.110295 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.110455 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.110627 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.110799 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.110971 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.111132 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.111302 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.111461 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.111629 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.111791 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.111959 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.112119 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.112282 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.112438 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.112610 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.112738 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.112898 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.113069 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.113227 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.113404 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.113563 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.113563 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.113861 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.114021 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.114220 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.114392 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.114392 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.114678 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.114836 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.114980 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.115123 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.115395 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.115557 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.115750 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.115902 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.116093 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.116432 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.116610 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.116762 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.116964 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.117152 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.117952 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.118154 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.118342 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.118567 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.118746 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.118956 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.119130 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.119302 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.119574 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.119753 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.119983 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.120149 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.120307 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.120582 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.120753 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.120917 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.121091 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.121254 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.121541 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.121729 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.121890 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.122144 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.122317 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.122590 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.122801 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.122988 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.123239 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.123427 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.123592 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.123755 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.123917 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.124268 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.124442 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.124607 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.124782 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.124947 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] glance.allowed_direct_url_schemes = [] {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.125237 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.125405 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.125571 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.125735 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.125898 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.126244 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.126447 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.126612 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.126786 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.126947 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.127201 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.127369 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.127518 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.127650 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.127852 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.128148 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.128309 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.128509 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.128681 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.128846 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.129119 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.129296 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.129548 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.129732 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.129890 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.130120 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.130293 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.130509 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.130689 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.130876 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.131152 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.131331 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.131487 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.131702 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.131880 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.132226 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.132398 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.132802 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.133063 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.133348 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.133526 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.133694 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.133936 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.134205 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.134385 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.134546 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.134708 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.135022 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.135193 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.135363 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.135534 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.135697 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.136006 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.136170 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.136317 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.136536 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.136690 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.136973 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.137141 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.137288 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.137620 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.137782 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.137936 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.138246 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.138435 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.138594 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.138779 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.138935 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.139259 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.139445 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.139624 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.139859 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.140026 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.140195 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.140356 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.140882 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.141045 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.141301 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.141431 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.141654 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.141844 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.142004 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.142382 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.142486 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.142735 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.142933 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.143081 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.143419 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.143521 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.143767 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.143973 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.144073 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.144423 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.144534 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.144760 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.145025 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.145126 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.145414 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.145520 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.145827 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.146112 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.146219 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.146504 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.146604 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.146846 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.147066 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.147172 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.147472 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.147579 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.147806 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.148028 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.148129 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.148498 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.148604 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.148835 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.149045 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.149152 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.149490 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.149598 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.149850 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.150054 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.150185 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.150527 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.150630 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.150862 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.151044 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.151208 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.151541 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.151653 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.151897 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.152050 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.152287 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.152533 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.152644 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.153031 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.153175 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.153367 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.153519 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.153710 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.154019 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.154193 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.154413 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.154619 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.154719 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.155068 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.155178 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.155406 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.155609 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.155714 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.156070 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.156169 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.156417 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.156589 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.156755 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.157075 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.157175 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.157415 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.157522 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.157747 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.158018 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.158199 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.158438 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.158546 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.158778 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.159015 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.159120 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.159427 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.159526 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.159764 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.159956 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.160098 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.160444 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.160549 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.160824 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.160978 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.161188 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.161516 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.161616 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.161850 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.162009 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.162218 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.162546 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.162662 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.162922 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.163442 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] glance.allowed_direct_url_schemes = [] {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.163563 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.163662 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.163756 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.163895 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.164525 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.164937 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.165030 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.165505 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.165614 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.166008 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.166143 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.166531 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.166677 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.167032 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.167135 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.167465 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.167546 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.167808 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.167992 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.168151 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.168475 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.168555 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.168837 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.169019 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.169176 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.169510 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.169591 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.169840 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.169991 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.170252 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.170506 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.170609 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.170982 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.171082 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.171324 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.171496 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.171672 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.171912 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.172012 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.172345 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.172447 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.172682 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.172892 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.173059 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.173378 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.173479 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.173723 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.173831 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.174073 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.174367 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.174468 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.174746 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.174918 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.175110 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.175420 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.175519 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.175783 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.175882 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.176126 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.176391 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.176491 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.176784 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.176884 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.177131 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.177372 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.177473 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.177785 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.177884 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.178196 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.178362 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.178533 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.178858 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.178959 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.179192 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.179373 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.179536 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.180439 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.180555 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.180779 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.180934 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.181115 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.181433 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.181535 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.181788 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.181895 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.182154 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.182437 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.182550 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.182796 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.182896 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.183142 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.183416 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.183515 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.183909 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.184011 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.184275 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.184374 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.184615 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.184878 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.184989 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.185265 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.185365 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.185607 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.185840 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.185939 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.186295 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.186398 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.186631 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.187097 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.187403 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.187513 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.187748 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.187943 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.188082 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.188423 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.188522 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.188787 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.188934 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.189122 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.189444 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.189544 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.189771 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.189952 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.190153 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.190492 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.190640 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.190846 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.191034 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.191313 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.191539 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.191645 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.191962 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.192061 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.192427 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.192528 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.192768 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.192940 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.193133 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.193423 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.193560 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.193787 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.193896 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.194168 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_usb_tablet = True {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.194424 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.194538 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.194845 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.194952 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.195204 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.195410 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.195573 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.195904 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.196012 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.196235 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.196360 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.196602 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.196843 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.196955 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.197311 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.197421 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.197673 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.197783 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.198175 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.198295 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.198535 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.198741 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.198879 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.199235 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.xen_hvmloader_path = /usr/lib/xen/boot/hvmloader {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.199335 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.199591 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.199736 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.199961 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.200268 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.200375 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.200607 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.200746 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.200950 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.201230 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.201334 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.201598 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.201699 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.201963 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.202244 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.202352 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.202642 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.202809 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.202990 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.203304 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.203410 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.203640 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.203896 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.204012 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.204301 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.204476 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.204634 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.204992 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.205098 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.205336 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.205571 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.205672 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.206095 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.206211 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.206397 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.206678 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.206793 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.207069 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.207169 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.207404 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.207683 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.207790 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.208048 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.208224 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.208427 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.208731 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.208831 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.209089 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.209266 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.209457 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.209829 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.209935 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.210195 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.210445 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.210555 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.210920 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.211032 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.211274 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.211551 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.211678 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.211978 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.212098 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.212334 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.212586 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.212687 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.212966 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.213073 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.213304 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.213549 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.213649 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.213948 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.214065 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.214313 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.214574 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.214680 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.214954 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.215062 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.215288 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.215534 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.215641 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.215969 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.216107 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.216320 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.216537 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.216713 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.216973 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.217336 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.217574 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.218020 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.218272 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.218376 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.218470 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.218601 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.218743 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.218970 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.219211 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.219312 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.219658 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.219776 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.220024 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.220238 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.220339 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.220697 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.220798 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.221046 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.221222 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.221393 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.221712 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.221812 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.222073 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.222243 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.222427 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.222737 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.222843 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.223097 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.223238 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.223436 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.223735 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.223857 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.224205 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.224328 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.224632 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.224745 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.225260 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.225360 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.225632 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.225807 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.226310 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: WARNING oslo_config.cfg [-] Deprecated: Option "driver" from group "scheduler" is deprecated for removal ( Dec 16 14:46:22.226310 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: nova no longer provides any in-tree filters except for the 'filter_scheduler' Dec 16 14:46:22.226310 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: scheduler. This filter is considered flexible and pluggable enough for all use Dec 16 14:46:22.226310 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: cases and can be extended through the use of custom, out-of-tree filters and Dec 16 14:46:22.226310 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: weighers along with powerful, in-tree filters like the Dec 16 14:46:22.226310 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: 'AggregateInstanceExtraSpecsFilter' and 'ComputeCapabilitiesFilter' filters. Dec 16 14:46:22.226310 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: ). Its value may be silently ignored in the future. Dec 16 14:46:22.227299 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.227370 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.driver = filter_scheduler {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.227508 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.227589 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.227892 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.227999 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.228239 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.228522 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.228622 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.228913 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.229017 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.229259 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.periodic_task_interval = 60 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.229604 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.229762 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.229947 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.230212 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.230314 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.230680 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.230900 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.231048 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.233413 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.233579 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.233719 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.233844 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.233977 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.234116 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.234216 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.234216 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.234383 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.234481 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.234652 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.234652 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.234912 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.235037 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.235136 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.235136 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.235396 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.235568 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.235728 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.235871 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.236030 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.236203 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.236370 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.236533 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.236691 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.236845 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.237001 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.237239 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.237375 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.237581 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.237747 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.237910 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.238230 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.238386 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.238589 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.238731 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.239174 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.239312 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.239481 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.239657 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.239826 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.240146 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.240311 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.240463 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.240639 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.240810 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.241114 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.241416 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.241622 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.241790 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.242191 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.242887 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.243107 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.243272 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.243479 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.243645 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.243813 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.244125 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.244303 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.244456 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.244614 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.244812 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.245085 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.245254 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.245406 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.245615 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.245785 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.246091 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.246269 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.246439 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.246596 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.246768 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.247027 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.247197 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.247382 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.247503 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.247693 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.247980 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.248316 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.248489 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.248721 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.249078 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.249271 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.249433 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] spice.keymap = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.249670 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.249962 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.250183 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.250349 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.250510 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.250662 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.250822 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.251104 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.251284 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.251441 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.251602 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.251757 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.252086 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.252261 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.252435 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.252599 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.252755 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.253045 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.253208 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.253403 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.253708 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.253878 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.254030 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.254239 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.254380 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.254700 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.254866 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.255194 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.255413 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.255697 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.255798 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.256229 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.256720 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.257227 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.257757 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.258851 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.259382 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.259943 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.260689 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.261202 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.261708 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.262073 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.262454 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.262556 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.262818 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.263006 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.263171 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.264523 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.264663 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.264748 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.264851 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.264923 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.264923 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.265054 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.265136 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.265205 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_usb_tablet = True {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.265272 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.265601 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.265714 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.265886 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.266566 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.266688 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.266688 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.266955 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.267056 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.267220 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.267326 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.267633 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.267734 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.267975 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.268169 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.269734 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.269861 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.269961 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.269961 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.270164 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.271991 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.272117 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.272225 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.272225 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.272403 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.272497 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.272590 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.272691 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vnc.keymap = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.272787 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.272881 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.272981 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.273053 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.273053 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.273193 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.xen_hvmloader_path = /usr/lib/xen/boot/hvmloader {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.273294 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.273401 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.274024 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.274124 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.274208 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.274208 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.274363 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.274559 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.275283 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.275408 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.275408 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.275556 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.275624 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.275749 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.275881 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.276226 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.276340 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.276569 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.276748 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.276915 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.277236 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.277409 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.277576 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.277733 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.277917 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.278259 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.278365 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.278728 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.278836 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.279049 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.279212 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.279401 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.279700 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.279809 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.280166 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.280279 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.280512 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.280683 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.280858 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.281203 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.281305 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.281542 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.281708 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.281894 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.282274 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.282397 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.282681 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.agent_path = usr/sbin/xe-update-networking {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.282783 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.283027 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.agent_resetnetwork_timeout = 60 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.283257 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.283365 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.agent_timeout = 30 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.283694 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.agent_version_timeout = 300 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.283800 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.284040 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.block_device_creation_timeout = 10 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.284237 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.284402 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.cache_images = all {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.284724 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.284826 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.check_host = True {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.285070 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.connection_concurrent = 5 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.285170 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.285405 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.connection_password = **** {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.285658 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.285798 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.connection_url = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.286117 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.connection_username = root {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.286222 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.286485 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.console_public_hostname = dv-cinder-821894-3-iscsi {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.286695 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.286843 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.default_os_type = linux {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.287183 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.disable_agent = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.287283 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.287519 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.image_compression_level = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.287706 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.287884 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.image_handler = direct_vhd {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.288242 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.288343 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.image_upload_handler = {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.288577 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.independent_compute = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.288735 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.288920 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.introduce_vdi_retry_wait = 20 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.289285 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.ipxe_boot_menu_url = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.289393 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.289644 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.ipxe_mkisofs_cmd = mkisofs {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.289809 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.289986 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.ipxe_network_name = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.290360 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.290464 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.login_timeout = 10 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.290699 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.max_kernel_ramdisk_size = 16777216 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.290875 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.291043 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.num_vbd_unplug_retries = 10 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.291377 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.ovs_integration_bridge = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.291477 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.291719 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.running_timeout = 60 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.291870 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.292060 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.sparse_copy = True {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.292353 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.292452 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.sr_base_path = /var/run/sr-mount {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.292751 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.sr_matching_filter = default-sr:true {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.292858 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.293088 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.target_host = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.293305 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.293406 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.target_port = 3260 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.293744 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.use_agent_default = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.293844 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.294166 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.use_join_force = True {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.294281 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.294513 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.vhd_coalesce_max_attempts = 20 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.294730 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.294830 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.vhd_coalesce_poll_interval = 5.0 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.295181 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.295293 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.295520 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.295666 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.296009 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.296109 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.296354 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.296636 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.296737 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] remote_debug.host = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.297008 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] remote_debug.port = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.297115 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.297375 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.297599 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.297760 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.298126 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.298230 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.298494 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.298594 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.298845 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.299077 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.299187 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.299515 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.299621 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.299878 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.300080 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.300236 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.300567 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.300667 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.300900 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.301102 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.301267 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.301612 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.301718 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.301973 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.302210 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.302393 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.302702 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.302809 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.303050 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.303204 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.303390 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.303725 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.303826 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.304107 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.304208 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.304447 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.304732 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.304847 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.305162 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.305262 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.305515 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.305710 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.305862 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.306382 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.306517 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.306616 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.306717 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.306923 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.307215 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.307317 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.307592 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.307693 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.307935 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.308169 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.308325 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.308653 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.308765 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.308971 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.309141 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.309332 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.309693 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.310058 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.310162 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.310493 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.310604 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.310842 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.311228 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.311458 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: WARNING oslo_config.cfg [-] Deprecated: Option "driver" from group "scheduler" is deprecated for removal ( Dec 16 14:46:22.311458 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: nova no longer provides any in-tree filters except for the 'filter_scheduler' Dec 16 14:46:22.311458 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: scheduler. This filter is considered flexible and pluggable enough for all use Dec 16 14:46:22.311458 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: cases and can be extended through the use of custom, out-of-tree filters and Dec 16 14:46:22.311458 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: weighers along with powerful, in-tree filters like the Dec 16 14:46:22.311458 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: 'AggregateInstanceExtraSpecsFilter' and 'ComputeCapabilitiesFilter' filters. Dec 16 14:46:22.311458 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: ). Its value may be silently ignored in the future. Dec 16 14:46:22.312023 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.312023 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=87618) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2591}} Dec 16 14:46:22.312201 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.driver = filter_scheduler {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.312520 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.313025 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.313527 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.314100 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.314571 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.315070 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.periodic_task_interval = 60 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.315569 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.316069 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.316529 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.317063 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.317588 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.318144 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.318692 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.319198 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.319704 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.320201 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.321244 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.321845 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.322386 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.322878 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.323388 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.323905 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.324419 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.324931 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.325442 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.325943 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.326497 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.327000 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.327494 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.327990 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.328492 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.329030 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.329575 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.330119 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.330625 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.331124 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.331631 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.332506 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.333029 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.333575 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.334153 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.334690 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.335203 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.335714 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.336804 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.337311 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.337835 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.338403 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.338928 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.339445 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.339987 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.340517 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.341052 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.341583 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.342366 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.343371 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.344024 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.344590 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.345129 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] spice.keymap = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.345719 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.346354 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.346923 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.347442 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.347993 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.348490 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.348986 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.349506 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.350013 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.350526 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.351010 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.351529 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.352028 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.352510 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.353137 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.353484 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.354020 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.354529 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.355015 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.355474 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.356203 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.356700 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.357194 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.357683 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.358198 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.358699 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.359183 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.359469 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG oslo_db.sqlalchemy.engines [None req-c6458b30-6091-4fa6-a139-8ab3553defb0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=87618) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 16 14:46:22.359672 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.360165 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.360664 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.361151 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.361647 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.362165 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.362698 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.363184 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.363668 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.364169 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.364658 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.365174 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.365665 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.366184 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.366750 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.367296 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.367795 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vnc.keymap = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.368729 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.369273 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.369782 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.370392 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.370941 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.371437 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.371924 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.372411 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.372936 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.373438 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.374152 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.374440 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.374942 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.375435 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.375927 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.376419 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.376908 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.377401 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.377894 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.378524 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.379043 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.379551 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.380058 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.380568 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.381063 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.381560 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.382076 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.382567 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.383616 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.384160 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.384709 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.agent_path = usr/sbin/xe-update-networking {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.385218 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.agent_resetnetwork_timeout = 60 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.385723 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.agent_timeout = 30 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.386280 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.agent_version_timeout = 300 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.386784 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.block_device_creation_timeout = 10 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.387312 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.cache_images = all {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.387815 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.check_host = True {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.388314 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.connection_concurrent = 5 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.388800 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.connection_password = **** {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.389312 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.connection_url = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.389802 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.connection_username = root {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.390376 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.console_public_hostname = dv-cinder-821894-3-iscsi {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.390898 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.default_os_type = linux {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.391395 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.disable_agent = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.391884 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.image_compression_level = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.392408 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.image_handler = direct_vhd {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.392924 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.image_upload_handler = {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.393419 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.independent_compute = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.393915 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.introduce_vdi_retry_wait = 20 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.394431 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.ipxe_boot_menu_url = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.394951 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.ipxe_mkisofs_cmd = mkisofs {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.395438 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.ipxe_network_name = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.395941 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.login_timeout = 10 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.396442 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.max_kernel_ramdisk_size = 16777216 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.396939 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.num_vbd_unplug_retries = 10 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.397426 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.ovs_integration_bridge = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.397930 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.running_timeout = 60 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.399024 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.sparse_copy = True {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.399565 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.sr_base_path = /var/run/sr-mount {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.400102 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.sr_matching_filter = default-sr:true {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.400593 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.target_host = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.401091 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.target_port = 3260 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.401585 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.use_agent_default = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.402108 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.use_join_force = True {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.402612 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.vhd_coalesce_max_attempts = 20 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.403118 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.vhd_coalesce_poll_interval = 5.0 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.403620 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.404109 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.404825 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.405328 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.405836 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] remote_debug.host = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.406349 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] remote_debug.port = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.406879 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.407459 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.407981 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.408518 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.409038 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.409569 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.410105 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.410648 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.411185 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.411732 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.412261 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.412836 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.413367 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.413913 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.414539 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.415060 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.415571 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.416107 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.416720 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.417314 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.417869 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.418493 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.419084 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.419706 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.420246 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.420760 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.421317 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.421817 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.422358 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.422863 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.423368 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.423884 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.424400 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.424938 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.425462 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.425981 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.426538 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.427152 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.427627 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.428186 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.428725 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:46:22.429123 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=87619) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2591}} Dec 16 14:46:22.481640 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG oslo_db.sqlalchemy.engines [None req-6fec760b-e854-4e3f-902c-f6d56c8bcd41 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=87619) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 16 14:46:22.725709 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.context [None req-c6458b30-6091-4fa6-a139-8ab3553defb0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),93843735-3183-4729-8723-375da9e05360(cell1) {{(pid=87618) load_cells /opt/stack/nova/nova/context.py:467}} Dec 16 14:46:22.732063 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG oslo_concurrency.lockutils [None req-c6458b30-6091-4fa6-a139-8ab3553defb0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87618) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:46:22.733825 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG oslo_concurrency.lockutils [None req-c6458b30-6091-4fa6-a139-8ab3553defb0 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87618) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:46:22.734727 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG oslo_concurrency.lockutils [None req-c6458b30-6091-4fa6-a139-8ab3553defb0 None None] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87618) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:46:22.736735 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG oslo_concurrency.lockutils [None req-c6458b30-6091-4fa6-a139-8ab3553defb0 None None] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87618) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:46:22.768061 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG oslo_db.sqlalchemy.engines [None req-c6458b30-6091-4fa6-a139-8ab3553defb0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=87618) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 16 14:46:22.801630 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG oslo_db.sqlalchemy.engines [None req-c6458b30-6091-4fa6-a139-8ab3553defb0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=87618) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 16 14:46:22.840149 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.context [None req-6fec760b-e854-4e3f-902c-f6d56c8bcd41 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),93843735-3183-4729-8723-375da9e05360(cell1) {{(pid=87619) load_cells /opt/stack/nova/nova/context.py:467}} Dec 16 14:46:22.846150 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG oslo_concurrency.lockutils [None req-6fec760b-e854-4e3f-902c-f6d56c8bcd41 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87619) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:46:22.847947 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG oslo_concurrency.lockutils [None req-6fec760b-e854-4e3f-902c-f6d56c8bcd41 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87619) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:46:22.883672 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG oslo_concurrency.lockutils [None req-6fec760b-e854-4e3f-902c-f6d56c8bcd41 None None] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87619) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:46:22.883672 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG oslo_concurrency.lockutils [None req-6fec760b-e854-4e3f-902c-f6d56c8bcd41 None None] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87619) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:46:22.883672 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG oslo_db.sqlalchemy.engines [None req-6fec760b-e854-4e3f-902c-f6d56c8bcd41 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=87619) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 16 14:46:22.886789 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG oslo_db.sqlalchemy.engines [None req-6fec760b-e854-4e3f-902c-f6d56c8bcd41 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=87619) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 16 14:46:22.911051 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG oslo_db.sqlalchemy.engines [None req-6fec760b-e854-4e3f-902c-f6d56c8bcd41 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=87619) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 16 14:46:23.350135 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: WARNING keystonemiddleware.auth_token [None req-c6458b30-6091-4fa6-a139-8ab3553defb0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 16 14:46:23.358312 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: WARNING keystonemiddleware.auth_token [None req-c6458b30-6091-4fa6-a139-8ab3553defb0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 16 14:46:23.518672 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: WARNING keystonemiddleware.auth_token [None req-6fec760b-e854-4e3f-902c-f6d56c8bcd41 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 16 14:46:23.531515 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: WARNING keystonemiddleware.auth_token [None req-6fec760b-e854-4e3f-902c-f6d56c8bcd41 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 16 14:46:23.679670 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: WARNING keystonemiddleware.auth_token [None req-c6458b30-6091-4fa6-a139-8ab3553defb0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 16 14:46:23.685065 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: WARNING keystonemiddleware.auth_token [None req-c6458b30-6091-4fa6-a139-8ab3553defb0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 16 14:46:23.690642 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559ff877c5d0 pid: 87618 (default app) Dec 16 14:46:23.693017 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi [None req-c6458b30-6091-4fa6-a139-8ab3553defb0 None None] Calling method '>' {{(pid=87618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:46:23.694260 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: INFO nova.api.openstack.requestlog [None req-c6458b30-6091-4fa6-a139-8ab3553defb0 None None] 10.222.0.45 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001926 Dec 16 14:46:23.694694 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: [pid: 87618|app: 0|req: 1/1] 10.222.0.45 () {50 vars in 779 bytes} [Thu Dec 16 14:46:23 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:46:23.999061 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: WARNING keystonemiddleware.auth_token [None req-6fec760b-e854-4e3f-902c-f6d56c8bcd41 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 16 14:46:24.007211 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: WARNING keystonemiddleware.auth_token [None req-6fec760b-e854-4e3f-902c-f6d56c8bcd41 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 16 14:46:24.016766 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x559ff877c5d0 pid: 87619 (default app) Dec 16 14:47:41.135085 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi [None req-955ae9b6-6c25-4862-a854-0b859f1a874d admin admin] Calling method '>' {{(pid=87618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:47:41.162214 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: INFO nova.api.openstack.requestlog [None req-955ae9b6-6c25-4862-a854-0b859f1a874d admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail" status: 200 len: 15 microversion: 2.1 time: 0.513716 Dec 16 14:47:41.163349 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: [pid: 87618|app: 0|req: 2/2] 10.222.0.45 () {58 vars in 1150 bytes} [Thu Dec 16 14:47:40 2021] GET /compute/v2.1/flavors/detail => generated 15 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 14:47:43.778899 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi [None req-9e6d3eb0-ea8c-421a-af17-4e7f391fbba5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "ram": 256, "vcpus": 1, "disk": 1, "id": "c1", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=87619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:47:43.806500 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:47:43.806500 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: warnings.warn(msg) Dec 16 14:47:43.851794 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: INFO nova.api.openstack.requestlog [None req-9e6d3eb0-ea8c-421a-af17-4e7f391fbba5 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 367 microversion: 2.1 time: 0.417431 Dec 16 14:47:43.852415 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: [pid: 87619|app: 0|req: 1/3] 10.222.0.45 () {62 vars in 1183 bytes} [Thu Dec 16 14:47:43 2021] POST /compute/v2.1/flavors => generated 367 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:47:43.866677 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi [None req-488116df-97ba-45b9-8a9a-f27b3990e2a7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=87618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:47:43.871701 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:47:43.871701 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: warnings.warn(msg) Dec 16 14:47:43.943958 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: INFO nova.api.openstack.requestlog [None req-488116df-97ba-45b9-8a9a-f27b3990e2a7 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.084515 Dec 16 14:47:43.944574 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: [pid: 87618|app: 0|req: 3/4] 10.222.0.45 () {62 vars in 1236 bytes} [Thu Dec 16 14:47:43 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 14:47:43.957840 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi [None req-d6d6f324-0c57-4fba-b9df-fbf8f9498b52 admin admin] Calling method '>' {{(pid=87619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:47:43.979042 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: INFO nova.api.openstack.requestlog [None req-d6d6f324-0c57-4fba-b9df-fbf8f9498b52 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.028336 Dec 16 14:47:43.979601 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: [pid: 87619|app: 0|req: 2/5] 10.222.0.45 () {58 vars in 1183 bytes} [Thu Dec 16 14:47:43 2021] GET /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 14:47:46.329653 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi [None req-7f2b92c0-283b-47b6-9245-f37511b225c5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "ram": 512, "vcpus": 1, "disk": 5, "id": "d1", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=87618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:47:46.355959 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:47:46.355959 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: warnings.warn(msg) Dec 16 14:47:46.433060 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: INFO nova.api.openstack.requestlog [None req-7f2b92c0-283b-47b6-9245-f37511b225c5 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 364 microversion: 2.1 time: 0.189825 Dec 16 14:47:46.433687 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: [pid: 87618|app: 0|req: 4/6] 10.222.0.45 () {62 vars in 1183 bytes} [Thu Dec 16 14:47:46 2021] POST /compute/v2.1/flavors => generated 364 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:47:46.447920 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi [None req-45057c63-9630-43bc-821c-2aa0157d2dd8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=87619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:47:46.452361 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:47:46.452361 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: warnings.warn(msg) Dec 16 14:47:46.562673 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: INFO nova.api.openstack.requestlog [None req-45057c63-9630-43bc-821c-2aa0157d2dd8 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.122002 Dec 16 14:47:46.563233 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: [pid: 87619|app: 0|req: 3/7] 10.222.0.45 () {62 vars in 1236 bytes} [Thu Dec 16 14:47:46 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 14:47:46.578647 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi [None req-06086e24-f82a-4f40-823a-6371a70c3b35 admin admin] Calling method '>' {{(pid=87618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:47:46.597356 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: INFO nova.api.openstack.requestlog [None req-06086e24-f82a-4f40-823a-6371a70c3b35 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.027317 Dec 16 14:47:46.597924 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: [pid: 87618|app: 0|req: 5/8] 10.222.0.45 () {58 vars in 1183 bytes} [Thu Dec 16 14:47:46 2021] GET /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 14:47:48.955849 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi [None req-30a1f7db-8016-47f9-add6-807883476e3a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "ram": 1024, "vcpus": 1, "disk": 10, "id": "d2", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=87619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:47:49.005795 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: INFO nova.api.openstack.requestlog [None req-30a1f7db-8016-47f9-add6-807883476e3a admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 364 microversion: 2.1 time: 0.131929 Dec 16 14:47:49.006866 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: [pid: 87619|app: 0|req: 4/9] 10.222.0.45 () {62 vars in 1183 bytes} [Thu Dec 16 14:47:48 2021] POST /compute/v2.1/flavors => generated 364 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:47:49.021142 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi [None req-593e5650-6a17-4c94-ab48-7f4256aff2a0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=87618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:47:49.084924 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: INFO nova.api.openstack.requestlog [None req-593e5650-6a17-4c94-ab48-7f4256aff2a0 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.071354 Dec 16 14:47:49.085560 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: [pid: 87618|app: 0|req: 6/10] 10.222.0.45 () {62 vars in 1236 bytes} [Thu Dec 16 14:47:49 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 16 14:47:49.098731 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi [None req-fa63a714-4168-4df1-b9ad-cd6765a0e98e admin admin] Calling method '>' {{(pid=87619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:47:49.116811 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: INFO nova.api.openstack.requestlog [None req-fa63a714-4168-4df1-b9ad-cd6765a0e98e admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.024915 Dec 16 14:47:49.117368 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: [pid: 87619|app: 0|req: 5/11] 10.222.0.45 () {58 vars in 1183 bytes} [Thu Dec 16 14:47:49 2021] GET /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 14:47:51.429446 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi [None req-e706af33-4108-4701-9b98-1ce2a787421d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "ram": 2048, "vcpus": 2, "disk": 10, "id": "d3", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=87618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:47:51.488824 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: INFO nova.api.openstack.requestlog [None req-e706af33-4108-4701-9b98-1ce2a787421d admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 364 microversion: 2.1 time: 0.142461 Dec 16 14:47:51.490092 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: [pid: 87618|app: 0|req: 7/12] 10.222.0.45 () {62 vars in 1183 bytes} [Thu Dec 16 14:47:51 2021] POST /compute/v2.1/flavors => generated 364 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:47:51.503875 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi [None req-7e718f1c-39f3-4f66-b795-41f86aae2500 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=87619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:47:51.571438 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: INFO nova.api.openstack.requestlog [None req-7e718f1c-39f3-4f66-b795-41f86aae2500 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.074525 Dec 16 14:47:51.572058 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: [pid: 87619|app: 0|req: 6/13] 10.222.0.45 () {62 vars in 1236 bytes} [Thu Dec 16 14:47:51 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 14:47:51.585248 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi [None req-1007c33d-7714-4bf5-affa-c6d2c498f123 admin admin] Calling method '>' {{(pid=87618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:47:51.604309 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: INFO nova.api.openstack.requestlog [None req-1007c33d-7714-4bf5-affa-c6d2c498f123 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.026032 Dec 16 14:47:51.604881 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: [pid: 87618|app: 0|req: 8/14] 10.222.0.45 () {58 vars in 1183 bytes} [Thu Dec 16 14:47:51 2021] GET /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 14:47:53.936389 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi [None req-42b929a0-67a8-443b-85a5-57f8b3438bc5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "ram": 4096, "vcpus": 4, "disk": 20, "id": "d4", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=87619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:47:53.983947 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: INFO nova.api.openstack.requestlog [None req-42b929a0-67a8-443b-85a5-57f8b3438bc5 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 364 microversion: 2.1 time: 0.133105 Dec 16 14:47:53.984569 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: [pid: 87619|app: 0|req: 7/15] 10.222.0.45 () {62 vars in 1183 bytes} [Thu Dec 16 14:47:53 2021] POST /compute/v2.1/flavors => generated 364 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:47:53.998951 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi [None req-538544c0-9687-48c6-9273-d5bfccaf0155 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=87618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:47:54.062993 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: INFO nova.api.openstack.requestlog [None req-538544c0-9687-48c6-9273-d5bfccaf0155 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.071024 Dec 16 14:47:54.063616 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: [pid: 87618|app: 0|req: 9/16] 10.222.0.45 () {62 vars in 1236 bytes} [Thu Dec 16 14:47:53 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 14:47:54.077214 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi [None req-db38e6e7-8c07-49e7-bbe1-4800922ccf01 admin admin] Calling method '>' {{(pid=87619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:47:54.095688 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: INFO nova.api.openstack.requestlog [None req-db38e6e7-8c07-49e7-bbe1-4800922ccf01 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.025492 Dec 16 14:47:54.096255 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: [pid: 87619|app: 0|req: 8/17] 10.222.0.45 () {58 vars in 1183 bytes} [Thu Dec 16 14:47:54 2021] GET /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 14:47:56.428930 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi [None req-c2ab4d69-9c24-405c-b1b7-1116abc23c45 admin admin] Calling method '>' {{(pid=87618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:47:56.449216 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: INFO nova.api.openstack.requestlog [None req-c2ab4d69-9c24-405c-b1b7-1116abc23c45 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail" status: 200 len: 1786 microversion: 2.1 time: 0.104098 Dec 16 14:47:56.449930 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: [pid: 87618|app: 0|req: 10/18] 10.222.0.45 () {58 vars in 1150 bytes} [Thu Dec 16 14:47:56 2021] GET /compute/v2.1/flavors/detail => generated 1786 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:47:58.786847 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi [None req-2c26857e-394e-41e2-aa83-ce2aae1ca788 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "ram": 512, "vcpus": 1, "disk": 1, "id": "1", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=87619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:47:58.845560 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: INFO nova.api.openstack.requestlog [None req-2c26857e-394e-41e2-aa83-ce2aae1ca788 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 362 microversion: 2.1 time: 0.140712 Dec 16 14:47:58.846205 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: [pid: 87619|app: 0|req: 9/19] 10.222.0.45 () {62 vars in 1183 bytes} [Thu Dec 16 14:47:58 2021] POST /compute/v2.1/flavors => generated 362 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:47:58.860052 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi [None req-3050fa7f-1d07-445a-8f62-8322f18d4784 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=87618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:47:58.925254 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: INFO nova.api.openstack.requestlog [None req-3050fa7f-1d07-445a-8f62-8322f18d4784 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.071986 Dec 16 14:47:58.925816 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: [pid: 87618|app: 0|req: 11/20] 10.222.0.45 () {62 vars in 1233 bytes} [Thu Dec 16 14:47:58 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 14:47:58.944503 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi [None req-d21ef67b-c6ef-4ff7-bcb6-472fe9d443d9 admin admin] Calling method '>' {{(pid=87619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:47:58.969346 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: INFO nova.api.openstack.requestlog [None req-d21ef67b-c6ef-4ff7-bcb6-472fe9d443d9 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.032383 Dec 16 14:47:58.969955 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: [pid: 87619|app: 0|req: 10/21] 10.222.0.45 () {58 vars in 1180 bytes} [Thu Dec 16 14:47:58 2021] GET /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 14:48:01.303851 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi [None req-743a4dab-ecdf-45ea-855f-6fdca05c0acc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "ram": 2048, "vcpus": 1, "disk": 20, "id": "2", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=87618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:48:01.349973 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: INFO nova.api.openstack.requestlog [None req-743a4dab-ecdf-45ea-855f-6fdca05c0acc admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 365 microversion: 2.1 time: 0.131513 Dec 16 14:48:01.350627 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: [pid: 87618|app: 0|req: 12/22] 10.222.0.45 () {62 vars in 1183 bytes} [Thu Dec 16 14:48:01 2021] POST /compute/v2.1/flavors => generated 365 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:48:01.364770 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi [None req-f39cf1c8-dde4-4944-9429-7a3c51fc41c0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=87619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:48:01.429496 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: INFO nova.api.openstack.requestlog [None req-f39cf1c8-dde4-4944-9429-7a3c51fc41c0 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.071990 Dec 16 14:48:01.430167 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: [pid: 87619|app: 0|req: 11/23] 10.222.0.45 () {62 vars in 1233 bytes} [Thu Dec 16 14:48:01 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 14:48:01.443760 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi [None req-ba4075a9-d9c8-48f3-9e55-df65a882e1a2 admin admin] Calling method '>' {{(pid=87618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:48:01.461923 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: INFO nova.api.openstack.requestlog [None req-ba4075a9-d9c8-48f3-9e55-df65a882e1a2 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.025641 Dec 16 14:48:01.462516 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: [pid: 87618|app: 0|req: 13/24] 10.222.0.45 () {58 vars in 1180 bytes} [Thu Dec 16 14:48:01 2021] GET /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 14:48:03.864788 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi [None req-ae53f99a-7c20-401b-9bca-2ae9d9e97f98 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "ram": 4096, "vcpus": 2, "disk": 40, "id": "3", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=87619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:48:03.920132 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: INFO nova.api.openstack.requestlog [None req-ae53f99a-7c20-401b-9bca-2ae9d9e97f98 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 366 microversion: 2.1 time: 0.138366 Dec 16 14:48:03.920747 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: [pid: 87619|app: 0|req: 12/25] 10.222.0.45 () {62 vars in 1183 bytes} [Thu Dec 16 14:48:03 2021] POST /compute/v2.1/flavors => generated 366 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:48:03.934836 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi [None req-21efdae2-bd80-4994-82b7-6cf0c77b07d0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=87618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:48:04.016109 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: INFO nova.api.openstack.requestlog [None req-21efdae2-bd80-4994-82b7-6cf0c77b07d0 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.088576 Dec 16 14:48:04.016715 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: [pid: 87618|app: 0|req: 14/26] 10.222.0.45 () {62 vars in 1233 bytes} [Thu Dec 16 14:48:03 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 14:48:04.030267 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi [None req-48ea2df4-5171-4e09-b289-277f631a7303 admin admin] Calling method '>' {{(pid=87619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:48:04.049128 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: INFO nova.api.openstack.requestlog [None req-48ea2df4-5171-4e09-b289-277f631a7303 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.025844 Dec 16 14:48:04.049697 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: [pid: 87619|app: 0|req: 13/27] 10.222.0.45 () {58 vars in 1180 bytes} [Thu Dec 16 14:48:04 2021] GET /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 14:48:06.358538 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi [None req-dcba4b97-ffa0-4922-aae3-03fa3b9e9ecb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "ram": 8192, "vcpus": 4, "disk": 80, "id": "4", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=87618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:48:06.411981 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: INFO nova.api.openstack.requestlog [None req-dcba4b97-ffa0-4922-aae3-03fa3b9e9ecb admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 365 microversion: 2.1 time: 0.135433 Dec 16 14:48:06.412618 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: [pid: 87618|app: 0|req: 15/28] 10.222.0.45 () {62 vars in 1183 bytes} [Thu Dec 16 14:48:06 2021] POST /compute/v2.1/flavors => generated 365 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:48:06.427091 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi [None req-13b9d3bb-3f0c-454c-ae0c-cdc6c7de015d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=87619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:48:06.490106 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: INFO nova.api.openstack.requestlog [None req-13b9d3bb-3f0c-454c-ae0c-cdc6c7de015d admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.070716 Dec 16 14:48:06.490703 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: [pid: 87619|app: 0|req: 14/29] 10.222.0.45 () {62 vars in 1233 bytes} [Thu Dec 16 14:48:06 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 14:48:06.503618 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi [None req-9116462f-6654-400a-8059-31c6d470a791 admin admin] Calling method '>' {{(pid=87618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:48:06.521912 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: INFO nova.api.openstack.requestlog [None req-9116462f-6654-400a-8059-31c6d470a791 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.025136 Dec 16 14:48:06.522518 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: [pid: 87618|app: 0|req: 16/30] 10.222.0.45 () {58 vars in 1180 bytes} [Thu Dec 16 14:48:06 2021] GET /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 14:48:08.813568 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi [None req-e66a6b63-928f-48ab-beef-a406eefcb584 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "ram": 16384, "vcpus": 8, "disk": 160, "id": "5", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=87619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:48:08.875104 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: INFO nova.api.openstack.requestlog [None req-e66a6b63-928f-48ab-beef-a406eefcb584 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 368 microversion: 2.1 time: 0.144395 Dec 16 14:48:08.875716 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: [pid: 87619|app: 0|req: 15/31] 10.222.0.45 () {62 vars in 1183 bytes} [Thu Dec 16 14:48:08 2021] POST /compute/v2.1/flavors => generated 368 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:48:08.889950 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi [None req-1fa095ac-a745-4089-932e-636857c11452 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=87618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:48:08.954819 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: INFO nova.api.openstack.requestlog [None req-1fa095ac-a745-4089-932e-636857c11452 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.071582 Dec 16 14:48:08.955372 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: [pid: 87618|app: 0|req: 17/32] 10.222.0.45 () {62 vars in 1233 bytes} [Thu Dec 16 14:48:08 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 14:48:08.968781 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi [None req-4241d27d-7271-4247-afb3-ebf0bdb41286 admin admin] Calling method '>' {{(pid=87619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:48:08.987487 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: INFO nova.api.openstack.requestlog [None req-4241d27d-7271-4247-afb3-ebf0bdb41286 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.025980 Dec 16 14:48:08.989973 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: [pid: 87619|app: 0|req: 16/33] 10.222.0.45 () {58 vars in 1180 bytes} [Thu Dec 16 14:48:08 2021] GET /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 14:48:47.027579 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi [None req-f57bce0b-607d-4f38-9e92-769037c752a3 admin admin] Calling method '>' {{(pid=87618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:48:47.050959 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: INFO nova.api.openstack.requestlog [None req-f57bce0b-607d-4f38-9e92-769037c752a3 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail" status: 200 len: 3562 microversion: 2.1 time: 0.113736 Dec 16 14:48:47.051558 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: [pid: 87618|app: 0|req: 18/34] 10.222.0.45 () {58 vars in 1150 bytes} [Thu Dec 16 14:48:46 2021] GET /compute/v2.1/flavors/detail => generated 3562 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:48:48.648385 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi [None req-4241d27d-7271-4247-afb3-ebf0bdb41286 admin admin] Calling method '>' {{(pid=87619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:48:48.650474 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: INFO nova.api.openstack.requestlog [None req-4241d27d-7271-4247-afb3-ebf0bdb41286 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001567 Dec 16 14:48:48.650474 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: [pid: 87619|app: 0|req: 17/35] 10.222.0.45 () {56 vars in 1065 bytes} [Thu Dec 16 14:48:48 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:48:48.874571 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi [None req-28e40ae8-f3d7-4012-8846-ce2df7c1f5c1 admin admin] Calling method '>' {{(pid=87618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:48:48.894100 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: INFO nova.api.openstack.wsgi [None req-28e40ae8-f3d7-4012-8846-ce2df7c1f5c1 admin admin] HTTP exception thrown: Flavor 42 could not be found. Dec 16 14:48:48.894781 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi [None req-28e40ae8-f3d7-4012-8846-ce2df7c1f5c1 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=87618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:941}} Dec 16 14:48:48.895644 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: INFO nova.api.openstack.requestlog [None req-28e40ae8-f3d7-4012-8846-ce2df7c1f5c1 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.87 time: 0.108452 Dec 16 14:48:48.896259 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: [pid: 87618|app: 0|req: 19/36] 10.222.0.45 () {60 vars in 1181 bytes} [Thu Dec 16 14:48:48 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 16 14:48:48.909200 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi [None req-c5e5d9b7-20b8-4957-83b5-655e96073238 admin admin] Calling method '>' {{(pid=87619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:48:48.932062 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: INFO nova.api.openstack.requestlog [None req-c5e5d9b7-20b8-4957-83b5-655e96073238 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.87 time: 0.029718 Dec 16 14:48:48.932622 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: [pid: 87619|app: 0|req: 18/37] 10.222.0.45 () {60 vars in 1201 bytes} [Thu Dec 16 14:48:48 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:48:48.946228 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi [None req-104b4750-d3dd-4a3f-a359-9cc77012ff17 admin admin] Calling method '>' {{(pid=87618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:48:48.968153 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: INFO nova.api.openstack.requestlog [None req-104b4750-d3dd-4a3f-a359-9cc77012ff17 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.87 time: 0.029331 Dec 16 14:48:48.968729 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: [pid: 87618|app: 0|req: 20/38] 10.222.0.45 () {60 vars in 1201 bytes} [Thu Dec 16 14:48:48 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:48:48.981621 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi [None req-9908545b-93a4-4b15-98a1-3a196eedbda4 admin admin] Calling method '>' {{(pid=87619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:48:48.998167 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: INFO nova.api.openstack.wsgi [None req-9908545b-93a4-4b15-98a1-3a196eedbda4 admin admin] HTTP exception thrown: Flavor 42 could not be found. Dec 16 14:48:48.998801 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi [None req-9908545b-93a4-4b15-98a1-3a196eedbda4 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=87619) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:941}} Dec 16 14:48:48.999639 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: INFO nova.api.openstack.requestlog [None req-9908545b-93a4-4b15-98a1-3a196eedbda4 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.87 time: 0.024792 Dec 16 14:48:49.000174 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: [pid: 87619|app: 0|req: 19/39] 10.222.0.45 () {60 vars in 1181 bytes} [Thu Dec 16 14:48:48 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 16 14:48:50.584614 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi [None req-104b4750-d3dd-4a3f-a359-9cc77012ff17 admin admin] Calling method '>' {{(pid=87618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:48:50.585694 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: INFO nova.api.openstack.requestlog [None req-104b4750-d3dd-4a3f-a359-9cc77012ff17 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001543 Dec 16 14:48:50.586201 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: [pid: 87618|app: 0|req: 21/40] 10.222.0.45 () {56 vars in 1065 bytes} [Thu Dec 16 14:48:50 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:48:50.796900 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi [None req-f95f4554-6dbe-45c8-a6b6-6e49670931af admin admin] Calling method '>' {{(pid=87619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:48:50.809853 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: INFO nova.api.openstack.wsgi [None req-f95f4554-6dbe-45c8-a6b6-6e49670931af admin admin] HTTP exception thrown: Flavor 84 could not be found. Dec 16 14:48:50.810485 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi [None req-f95f4554-6dbe-45c8-a6b6-6e49670931af admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=87619) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:941}} Dec 16 14:48:50.811320 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: INFO nova.api.openstack.requestlog [None req-f95f4554-6dbe-45c8-a6b6-6e49670931af admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.87 time: 0.098083 Dec 16 14:48:50.811858 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: [pid: 87619|app: 0|req: 20/41] 10.222.0.45 () {60 vars in 1181 bytes} [Thu Dec 16 14:48:50 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 16 14:48:50.826501 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi [None req-a2075a3b-b4e2-46b7-9788-4aa5ecd221b4 admin admin] Calling method '>' {{(pid=87618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:48:50.849021 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: INFO nova.api.openstack.requestlog [None req-a2075a3b-b4e2-46b7-9788-4aa5ecd221b4 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.87 time: 0.029500 Dec 16 14:48:50.849590 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: [pid: 87618|app: 0|req: 22/42] 10.222.0.45 () {60 vars in 1201 bytes} [Thu Dec 16 14:48:50 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:48:50.862515 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi [None req-ca7ed72e-dddf-4f1b-bff6-8b4ffc624cd2 admin admin] Calling method '>' {{(pid=87619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:48:50.884354 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: INFO nova.api.openstack.requestlog [None req-ca7ed72e-dddf-4f1b-bff6-8b4ffc624cd2 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.87 time: 0.028595 Dec 16 14:48:50.884912 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: [pid: 87619|app: 0|req: 21/43] 10.222.0.45 () {60 vars in 1201 bytes} [Thu Dec 16 14:48:50 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:48:50.898238 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi [None req-ff999dfd-01d9-4444-b07d-af01750bc2a4 admin admin] Calling method '>' {{(pid=87618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:48:50.911210 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: INFO nova.api.openstack.wsgi [None req-ff999dfd-01d9-4444-b07d-af01750bc2a4 admin admin] HTTP exception thrown: Flavor 84 could not be found. Dec 16 14:48:50.911824 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi [None req-ff999dfd-01d9-4444-b07d-af01750bc2a4 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=87618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:941}} Dec 16 14:48:50.912673 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: INFO nova.api.openstack.requestlog [None req-ff999dfd-01d9-4444-b07d-af01750bc2a4 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.87 time: 0.021934 Dec 16 14:48:50.913210 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: [pid: 87618|app: 0|req: 23/44] 10.222.0.45 () {60 vars in 1181 bytes} [Thu Dec 16 14:48:50 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 16 14:48:52.484698 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi [None req-ca7ed72e-dddf-4f1b-bff6-8b4ffc624cd2 admin admin] Calling method '>' {{(pid=87619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:48:52.485778 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: INFO nova.api.openstack.requestlog [None req-ca7ed72e-dddf-4f1b-bff6-8b4ffc624cd2 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001578 Dec 16 14:48:52.486239 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: [pid: 87619|app: 0|req: 22/45] 10.222.0.45 () {56 vars in 1065 bytes} [Thu Dec 16 14:48:52 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:48:52.695926 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi [None req-8614ebae-ef79-4bfe-b30a-96ef1f3adfcf admin admin] Calling method '>' {{(pid=87618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:48:52.708742 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: INFO nova.api.openstack.wsgi [None req-8614ebae-ef79-4bfe-b30a-96ef1f3adfcf admin admin] HTTP exception thrown: Flavor 451 could not be found. Dec 16 14:48:52.709361 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi [None req-8614ebae-ef79-4bfe-b30a-96ef1f3adfcf admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=87618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:941}} Dec 16 14:48:52.710248 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: INFO nova.api.openstack.requestlog [None req-8614ebae-ef79-4bfe-b30a-96ef1f3adfcf admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.87 time: 0.098202 Dec 16 14:48:52.710953 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: [pid: 87618|app: 0|req: 24/46] 10.222.0.45 () {60 vars in 1184 bytes} [Thu Dec 16 14:48:52 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 16 14:48:52.723959 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi [None req-81545a46-203a-4721-91fd-0593a97013cd admin admin] Calling method '>' {{(pid=87619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:48:52.745856 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: INFO nova.api.openstack.requestlog [None req-81545a46-203a-4721-91fd-0593a97013cd admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.87 time: 0.028722 Dec 16 14:48:52.746471 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: [pid: 87619|app: 0|req: 23/47] 10.222.0.45 () {60 vars in 1201 bytes} [Thu Dec 16 14:48:52 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:48:52.760307 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi [None req-e121347c-ecf7-4d95-bb5d-6dd9b799a5ce admin admin] Calling method '>' {{(pid=87618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:48:52.781778 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: INFO nova.api.openstack.requestlog [None req-e121347c-ecf7-4d95-bb5d-6dd9b799a5ce admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.87 time: 0.028952 Dec 16 14:48:52.782380 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: [pid: 87618|app: 0|req: 25/48] 10.222.0.45 () {60 vars in 1201 bytes} [Thu Dec 16 14:48:52 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:48:52.795957 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi [None req-53d62d2f-c995-4a87-b26e-438f5221b04f admin admin] Calling method '>' {{(pid=87619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:48:52.809537 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: INFO nova.api.openstack.wsgi [None req-53d62d2f-c995-4a87-b26e-438f5221b04f admin admin] HTTP exception thrown: Flavor 451 could not be found. Dec 16 14:48:52.810181 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi [None req-53d62d2f-c995-4a87-b26e-438f5221b04f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=87619) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:941}} Dec 16 14:48:52.811020 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: INFO nova.api.openstack.requestlog [None req-53d62d2f-c995-4a87-b26e-438f5221b04f admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.87 time: 0.022713 Dec 16 14:48:52.811568 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: [pid: 87619|app: 0|req: 24/49] 10.222.0.45 () {60 vars in 1184 bytes} [Thu Dec 16 14:48:52 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 16 14:48:54.381369 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi [None req-e121347c-ecf7-4d95-bb5d-6dd9b799a5ce admin admin] Calling method '>' {{(pid=87618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:48:54.382538 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: INFO nova.api.openstack.requestlog [None req-e121347c-ecf7-4d95-bb5d-6dd9b799a5ce admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001589 Dec 16 14:48:54.382986 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: [pid: 87618|app: 0|req: 26/50] 10.222.0.45 () {56 vars in 1065 bytes} [Thu Dec 16 14:48:54 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:48:54.594192 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi [None req-731d02a6-0cd8-47e1-bb4f-2902ef3b6b59 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=87619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:48:54.643367 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: INFO nova.api.openstack.requestlog [None req-731d02a6-0cd8-47e1-bb4f-2902ef3b6b59 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.87 time: 0.132398 Dec 16 14:48:54.643950 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: [pid: 87619|app: 0|req: 25/51] 10.222.0.45 () {64 vars in 1226 bytes} [Thu Dec 16 14:48:54 2021] POST /compute/v2.1/flavors => generated 404 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:48:56.237199 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi [None req-e121347c-ecf7-4d95-bb5d-6dd9b799a5ce admin admin] Calling method '>' {{(pid=87618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:48:56.238320 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: INFO nova.api.openstack.requestlog [None req-e121347c-ecf7-4d95-bb5d-6dd9b799a5ce admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002101 Dec 16 14:48:56.238761 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: [pid: 87618|app: 0|req: 27/52] 10.222.0.45 () {56 vars in 1065 bytes} [Thu Dec 16 14:48:56 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:48:56.454546 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi [None req-e7561de1-f4d8-4a07-8d93-c719aed3f2c8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=87619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:48:56.512425 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: INFO nova.api.openstack.requestlog [None req-e7561de1-f4d8-4a07-8d93-c719aed3f2c8 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.87 time: 0.144741 Dec 16 14:48:56.513031 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: [pid: 87619|app: 0|req: 26/53] 10.222.0.45 () {64 vars in 1226 bytes} [Thu Dec 16 14:48:56 2021] POST /compute/v2.1/flavors => generated 405 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:48:58.092084 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi [None req-e121347c-ecf7-4d95-bb5d-6dd9b799a5ce admin admin] Calling method '>' {{(pid=87618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:48:58.093155 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: INFO nova.api.openstack.requestlog [None req-e121347c-ecf7-4d95-bb5d-6dd9b799a5ce admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001563 Dec 16 14:48:58.093642 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: [pid: 87618|app: 0|req: 28/54] 10.222.0.45 () {56 vars in 1065 bytes} [Thu Dec 16 14:48:58 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:48:58.303672 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi [None req-33138287-79b7-4411-9df9-a0d6f26f72a3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=87619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:48:58.402299 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: INFO nova.api.openstack.requestlog [None req-33138287-79b7-4411-9df9-a0d6f26f72a3 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.87 time: 0.182559 Dec 16 14:48:58.402903 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: [pid: 87619|app: 0|req: 27/55] 10.222.0.45 () {64 vars in 1226 bytes} [Thu Dec 16 14:48:58 2021] POST /compute/v2.1/flavors => generated 407 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:48:59.980355 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi [None req-e121347c-ecf7-4d95-bb5d-6dd9b799a5ce admin admin] Calling method '>' {{(pid=87618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:48:59.981442 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: INFO nova.api.openstack.requestlog [None req-e121347c-ecf7-4d95-bb5d-6dd9b799a5ce admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001593 Dec 16 14:48:59.981929 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: [pid: 87618|app: 0|req: 29/56] 10.222.0.45 () {56 vars in 1065 bytes} [Thu Dec 16 14:48:59 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:49:00.192744 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi [None req-3dbc54ad-6427-46ae-adae-0a654ed80441 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=87619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:49:00.301185 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: INFO nova.api.openstack.requestlog [None req-3dbc54ad-6427-46ae-adae-0a654ed80441 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.87 time: 0.191595 Dec 16 14:49:00.301771 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: [pid: 87619|app: 0|req: 28/57] 10.222.0.45 () {64 vars in 1226 bytes} [Thu Dec 16 14:49:00 2021] POST /compute/v2.1/flavors => generated 409 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:49:01.899050 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi [None req-e121347c-ecf7-4d95-bb5d-6dd9b799a5ce admin admin] Calling method '>' {{(pid=87618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:49:01.900177 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: INFO nova.api.openstack.requestlog [None req-e121347c-ecf7-4d95-bb5d-6dd9b799a5ce admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001584 Dec 16 14:49:01.900625 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: [pid: 87618|app: 0|req: 30/58] 10.222.0.45 () {56 vars in 1065 bytes} [Thu Dec 16 14:49:01 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:49:02.109675 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi [None req-a3578aa7-36cb-41e4-90e9-0fbbae81267e admin admin] Calling method '>' {{(pid=87619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:49:02.144477 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: INFO nova.api.openstack.requestlog [None req-a3578aa7-36cb-41e4-90e9-0fbbae81267e admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.87 time: 0.118655 Dec 16 14:49:02.145065 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: [pid: 87619|app: 0|req: 29/59] 10.222.0.45 () {60 vars in 1193 bytes} [Thu Dec 16 14:49:02 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:49:43.432895 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi [None req-e121347c-ecf7-4d95-bb5d-6dd9b799a5ce admin admin] Calling method '>' {{(pid=87618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:49:43.433977 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: INFO nova.api.openstack.requestlog [None req-e121347c-ecf7-4d95-bb5d-6dd9b799a5ce admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001574 Dec 16 14:49:43.434452 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: [pid: 87618|app: 0|req: 31/60] 10.222.0.45 () {56 vars in 1065 bytes} [Thu Dec 16 14:49:43 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:49:43.645874 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi [None req-968fae42-a9ca-4ac3-883e-008dd658ee57 admin admin] Calling method '>' {{(pid=87619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:49:43.677725 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: INFO nova.api.openstack.requestlog [None req-968fae42-a9ca-4ac3-883e-008dd658ee57 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.87 time: 0.116272 Dec 16 14:49:43.678339 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: [pid: 87619|app: 0|req: 30/61] 10.222.0.45 () {60 vars in 1193 bytes} [Thu Dec 16 14:49:43 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:51:12.049432 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi [None req-7f5bcea9-87c7-45de-ad5e-ba16c19e7a20 tempest-verify_tempest_config-414034236 tempest-verify_tempest_config-414034236-project] Calling method '>' {{(pid=87618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:51:12.054697 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: INFO nova.api.openstack.requestlog [None req-7f5bcea9-87c7-45de-ad5e-ba16c19e7a20 tempest-verify_tempest_config-414034236 tempest-verify_tempest_config-414034236-project] 10.222.0.45 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.156460 Dec 16 14:51:12.055275 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: [pid: 87618|app: 0|req: 32/62] 10.222.0.45 () {58 vars in 1124 bytes} [Thu Dec 16 14:51:11 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:52:47.811124 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi [None req-968fae42-a9ca-4ac3-883e-008dd658ee57 admin admin] Calling method '>' {{(pid=87619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:52:47.812214 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: INFO nova.api.openstack.requestlog [None req-968fae42-a9ca-4ac3-883e-008dd658ee57 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001562 Dec 16 14:52:47.812658 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: [pid: 87619|app: 0|req: 31/63] 10.222.0.45 () {56 vars in 1065 bytes} [Thu Dec 16 14:52:47 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:52:48.099473 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi [None req-fc506c32-3820-4bf9-ac77-03f0b7be6b4c admin admin] Calling method '>' {{(pid=87618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:52:48.103643 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:52:48.103643 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: warnings.warn(msg) Dec 16 14:52:48.105299 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG oslo_concurrency.lockutils [None req-fc506c32-3820-4bf9-ac77-03f0b7be6b4c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87618) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:52:48.105798 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG oslo_concurrency.lockutils [None req-fc506c32-3820-4bf9-ac77-03f0b7be6b4c admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87618) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:52:48.106715 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG oslo_concurrency.lockutils [None req-fc506c32-3820-4bf9-ac77-03f0b7be6b4c admin admin] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87618) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:52:48.107201 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG oslo_concurrency.lockutils [None req-fc506c32-3820-4bf9-ac77-03f0b7be6b4c admin admin] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87618) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:52:48.147977 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: INFO nova.api.openstack.requestlog [None req-fc506c32-3820-4bf9-ac77-03f0b7be6b4c admin admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.87 time: 0.206928 Dec 16 14:52:48.148597 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: [pid: 87618|app: 0|req: 33/64] 10.222.0.45 () {60 vars in 1184 bytes} [Thu Dec 16 14:52:47 2021] GET /compute/v2.1/os-services => generated 791 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:52:49.732931 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi [None req-968fae42-a9ca-4ac3-883e-008dd658ee57 admin admin] Calling method '>' {{(pid=87619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:52:49.734654 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: INFO nova.api.openstack.requestlog [None req-968fae42-a9ca-4ac3-883e-008dd658ee57 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002173 Dec 16 14:52:49.735128 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: [pid: 87619|app: 0|req: 32/65] 10.222.0.45 () {56 vars in 1065 bytes} [Thu Dec 16 14:52:49 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:52:49.944630 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi [None req-0bb318aa-639b-4c2a-8fce-38f270ef60eb admin admin] Calling method '>' {{(pid=87618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:52:49.948738 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:52:49.948738 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: warnings.warn(msg) Dec 16 14:52:49.950356 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG oslo_concurrency.lockutils [None req-0bb318aa-639b-4c2a-8fce-38f270ef60eb admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87618) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:52:49.950861 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG oslo_concurrency.lockutils [None req-0bb318aa-639b-4c2a-8fce-38f270ef60eb admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87618) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:52:49.951723 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG oslo_concurrency.lockutils [None req-0bb318aa-639b-4c2a-8fce-38f270ef60eb admin admin] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87618) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:52:49.952212 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG oslo_concurrency.lockutils [None req-0bb318aa-639b-4c2a-8fce-38f270ef60eb admin admin] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87618) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:52:49.977800 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: INFO nova.api.openstack.requestlog [None req-0bb318aa-639b-4c2a-8fce-38f270ef60eb admin admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.87 time: 0.116652 Dec 16 14:52:49.978460 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: [pid: 87618|app: 0|req: 34/66] 10.222.0.45 () {60 vars in 1184 bytes} [Thu Dec 16 14:52:49 2021] GET /compute/v2.1/os-services => generated 791 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:53:01.997792 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi [None req-968fae42-a9ca-4ac3-883e-008dd658ee57 admin admin] Calling method '>' {{(pid=87619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:53:01.999516 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: INFO nova.api.openstack.requestlog [None req-968fae42-a9ca-4ac3-883e-008dd658ee57 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001597 Dec 16 14:53:01.999953 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: [pid: 87619|app: 0|req: 33/67] 10.222.0.45 () {56 vars in 1065 bytes} [Thu Dec 16 14:53:01 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:53:02.216519 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi [None req-1a8656cd-3f68-4709-9fe6-5dac8be99375 admin admin] Calling method '>' {{(pid=87618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:53:02.220651 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:53:02.220651 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: warnings.warn(msg) Dec 16 14:53:02.222250 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG oslo_concurrency.lockutils [None req-1a8656cd-3f68-4709-9fe6-5dac8be99375 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87618) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:53:02.222737 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG oslo_concurrency.lockutils [None req-1a8656cd-3f68-4709-9fe6-5dac8be99375 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87618) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:53:02.223577 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG oslo_concurrency.lockutils [None req-1a8656cd-3f68-4709-9fe6-5dac8be99375 admin admin] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87618) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:53:02.224049 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG oslo_concurrency.lockutils [None req-1a8656cd-3f68-4709-9fe6-5dac8be99375 admin admin] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87618) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:53:02.255228 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: INFO nova.api.openstack.requestlog [None req-1a8656cd-3f68-4709-9fe6-5dac8be99375 admin admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.87 time: 0.128443 Dec 16 14:53:02.255768 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: [pid: 87618|app: 0|req: 35/68] 10.222.0.45 () {60 vars in 1184 bytes} [Thu Dec 16 14:53:02 2021] GET /compute/v2.1/os-services => generated 1011 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:53:03.848420 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi [None req-968fae42-a9ca-4ac3-883e-008dd658ee57 admin admin] Calling method '>' {{(pid=87619) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:53:03.849556 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: INFO nova.api.openstack.requestlog [None req-968fae42-a9ca-4ac3-883e-008dd658ee57 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001591 Dec 16 14:53:03.849995 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: [pid: 87619|app: 0|req: 34/69] 10.222.0.45 () {56 vars in 1065 bytes} [Thu Dec 16 14:53:03 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:53:04.063491 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG nova.api.openstack.wsgi [None req-071b71fa-cfcf-44e5-9e7e-8c41ab8d7267 admin admin] Calling method '>' {{(pid=87618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:53:04.067633 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:53:04.067633 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: warnings.warn(msg) Dec 16 14:53:04.069218 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG oslo_concurrency.lockutils [None req-071b71fa-cfcf-44e5-9e7e-8c41ab8d7267 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87618) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:53:04.069718 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG oslo_concurrency.lockutils [None req-071b71fa-cfcf-44e5-9e7e-8c41ab8d7267 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87618) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:53:04.070603 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG oslo_concurrency.lockutils [None req-071b71fa-cfcf-44e5-9e7e-8c41ab8d7267 admin admin] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87618) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:53:04.071095 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: DEBUG oslo_concurrency.lockutils [None req-071b71fa-cfcf-44e5-9e7e-8c41ab8d7267 admin admin] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87618) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:53:04.099261 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: INFO nova.api.openstack.requestlog [None req-071b71fa-cfcf-44e5-9e7e-8c41ab8d7267 admin admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.87 time: 0.120196 Dec 16 14:53:04.099891 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: [pid: 87618|app: 0|req: 36/70] 10.222.0.45 () {60 vars in 1184 bytes} [Thu Dec 16 14:53:03 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:54:03.894317 dv-cinder-821894-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Dec 16 14:54:03.895113 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: Thu Dec 16 14:54:03 2021 - graceful shutdown triggered... Dec 16 14:54:03.895566 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: Gracefully killing worker 1 (pid: 87618)... Dec 16 14:54:03.895652 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: Gracefully killing worker 2 (pid: 87619)... Dec 16 14:54:04.896241 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: worker 1 buried after 1 seconds Dec 16 14:54:04.896241 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: worker 2 buried after 1 seconds Dec 16 14:54:04.896241 dv-cinder-821894-3-iscsi devstack@n-api.service[87617]: goodbye to uWSGI. Dec 16 14:54:04.897935 dv-cinder-821894-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Dec 16 14:54:04.899637 dv-cinder-821894-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Dec 16 14:54:04.908914 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Dec 16 14:54:04.909369 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: open("./http_plugin.so"): No such file or directory [core/utils.c line 3732] Dec 16 14:54:04.909369 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: !!! UNABLE to load uWSGI plugin: ./http_plugin.so: cannot open shared object file: No such file or directory !!! Dec 16 14:54:04.909369 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: open("./python3_plugin.so"): No such file or directory [core/utils.c line 3732] Dec 16 14:54:04.909369 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: !!! UNABLE to load uWSGI plugin: ./python3_plugin.so: cannot open shared object file: No such file or directory !!! Dec 16 14:54:04.909369 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: *** Starting uWSGI 2.0.20 (64bit) on [Thu Dec 16 14:54:04 2021] *** Dec 16 14:54:04.909369 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: compiled with version: 7.5.0 on 16 December 2021 14:23:23 Dec 16 14:54:04.909369 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: os: Linux-4.15.0-55-generic #60-Ubuntu SMP Tue Jul 2 18:22:20 UTC 2019 Dec 16 14:54:04.909369 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: nodename: dv-cinder-821894-3-iscsi Dec 16 14:54:04.909369 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: machine: x86_64 Dec 16 14:54:04.909369 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: clock source: unix Dec 16 14:54:04.909369 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: pcre jit disabled Dec 16 14:54:04.909369 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: detected number of CPU cores: 4 Dec 16 14:54:04.909369 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: current working directory: / Dec 16 14:54:04.909369 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: detected binary path: /usr/local/bin/uwsgi Dec 16 14:54:04.909369 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: your processes number limit is 47843 Dec 16 14:54:04.909369 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: your memory page size is 4096 bytes Dec 16 14:54:04.909369 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: detected max file descriptor number: 2048 Dec 16 14:54:04.909369 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: lock engine: pthread robust mutexes Dec 16 14:54:04.909369 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: thunder lock: enabled Dec 16 14:54:04.911068 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Dec 16 14:54:04.911068 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: Python version: 3.6.9 (default, Dec 8 2021, 21:08:43) [GCC 8.4.0] Dec 16 14:54:04.956259 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: Python main interpreter initialized at 0x55ff33a315d0 Dec 16 14:54:04.956259 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: python threads support enabled Dec 16 14:54:04.956259 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: your server socket listen backlog is limited to 100 connections Dec 16 14:54:04.956259 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: your mercy for graceful operations on workers is 90 seconds Dec 16 14:54:04.958491 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: mapped 403077 bytes (393 KB) for 2 cores Dec 16 14:54:04.958491 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: *** Operational MODE: preforking *** Dec 16 14:54:04.958491 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: *** uWSGI is running in multiple interpreter mode *** Dec 16 14:54:04.958491 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: spawned uWSGI master process (pid: 101353) Dec 16 14:54:04.958491 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: spawned uWSGI worker 1 (pid: 101355, cores: 1) Dec 16 14:54:04.958491 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: spawned uWSGI worker 2 (pid: 101356, cores: 1) Dec 16 14:54:04.958491 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Dec 16 14:54:04.957070 dv-cinder-821894-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Dec 16 14:54:09.346029 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2567}} Dec 16 14:54:09.346733 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2568}} Dec 16 14:54:09.348480 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2569}} Dec 16 14:54:09.348919 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2571}} Dec 16 14:54:09.349215 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2572}} Dec 16 14:54:09.349713 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.350203 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.350464 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] bandwidth_poll_interval = 600 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.350842 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] bindir = /usr/local/bin {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.351215 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.351575 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.351955 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.352305 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.352666 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.353027 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.353404 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.353701 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.354121 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.354463 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-821894-3-iscsi {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.354826 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.355173 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.355521 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.355890 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.356235 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.356604 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.356946 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.357604 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.357954 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.358348 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.358695 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.359156 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.359528 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.359942 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.360615 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.361199 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.361374 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.362137 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.362404 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-821894-3-iscsi {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.362777 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.363137 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.363575 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.364082 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.364666 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.365625 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.365947 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.366375 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.366734 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.367120 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.367497 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.367845 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.368229 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.368637 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.368992 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.369410 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.370117 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.370500 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.370767 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.371180 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.371402 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.371781 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.372297 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.372518 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.372809 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.373155 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.373527 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.373897 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.374309 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.374661 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.375011 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.375354 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.375700 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.376046 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.376401 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.376818 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.377189 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.377561 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.377910 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.378305 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.378768 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.45 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.379060 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.45 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.379406 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.379919 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.380380 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.380735 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.381105 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.381481 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.381832 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.382258 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.382637 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.383012 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.383384 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.383729 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.385593 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.385593 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.385593 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.385593 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.385593 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.385593 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.387067 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.387067 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.387067 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.387067 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.387676 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.387676 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.387963 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.388183 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.388531 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.389407 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.389870 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.390279 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.390463 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.390810 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.391153 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.391498 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.391844 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.392222 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.392619 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.393033 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.393225 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.393571 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.393871 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.394268 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.394614 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.394959 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.395321 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.395662 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.396004 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.396361 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.396938 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.396938 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.396938 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.396938 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.396938 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.396938 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.396938 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.400762 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2567}} Dec 16 14:54:09.400873 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.400983 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2568}} Dec 16 14:54:09.401307 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.401307 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.401307 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.401791 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2569}} Dec 16 14:54:09.401967 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.402188 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2571}} Dec 16 14:54:09.402347 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.402518 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2572}} Dec 16 14:54:09.402695 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.402695 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.403024 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.403189 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.403350 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.403350 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] bandwidth_poll_interval = 600 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.403669 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.403842 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] bindir = /usr/local/bin {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.404014 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.404169 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.404957 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.405139 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.405319 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.405475 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.405631 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.405797 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.405951 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.406164 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.406334 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.406493 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.406640 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.406836 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.406997 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.407153 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.407313 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.407482 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.407642 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.407813 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-821894-3-iscsi {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.407981 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.408194 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.408309 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.408556 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.408720 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.408880 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.409034 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.409256 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.409551 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.409733 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.409889 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.410069 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.410221 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.410342 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.410489 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.410593 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.410899 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.411021 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.411254 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.411395 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.411607 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.411727 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.411967 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.412080 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.412372 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.412479 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.412723 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.412829 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.413083 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.413189 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.413431 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.413547 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.413779 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.413893 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.414158 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.414278 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.414508 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.414614 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.414858 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.414963 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-821894-3-iscsi {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.415212 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.415326 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.415558 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.415670 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.415913 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.416025 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.416268 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.416386 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.416627 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.416732 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.416977 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.417090 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.417327 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.417445 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.417675 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.417787 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.418030 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.418239 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.418429 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.418549 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.418777 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.418936 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.419143 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.419250 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.419488 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.419608 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.419859 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.419977 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.420220 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.420336 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.420571 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.420684 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.420951 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.421057 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.421301 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.421425 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.421650 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.421781 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.421929 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.422033 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.422290 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.422624 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.422731 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.423010 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.423115 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.423365 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.423477 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.423685 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.423839 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.423954 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.424054 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.424253 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.424366 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.424623 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.424734 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.424986 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.425090 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.425329 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.425443 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.425670 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.425776 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.426017 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.426199 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.426404 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.426524 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.426754 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.426863 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.427102 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.427212 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.427471 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.427589 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.427835 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.427948 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.428191 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.428379 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.428565 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.428734 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.429651 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.429651 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.430012 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.430165 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.430301 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.45 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.430434 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.430550 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.45 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.430655 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.430655 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.433417 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.433544 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.433656 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.433793 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.433939 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.434088 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.434208 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.434320 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.434421 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.434519 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.434616 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.434724 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.434832 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.434932 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.435039 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.435138 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.435243 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.435243 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.435442 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.435442 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.435649 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.435649 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.435649 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.435649 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.435649 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.436119 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.436216 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.436508 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.436859 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.437212 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.437565 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.437922 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.438308 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.438579 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.438689 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.438970 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.439094 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.442106 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.442248 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.442374 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.442491 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.442491 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.442697 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.442797 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.442896 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.442994 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.443101 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.443208 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.443308 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.443406 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.443510 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.443609 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.443714 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.443814 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.443814 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.443814 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.443814 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.443814 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.443814 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.444212 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.444315 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.444489 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.444651 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.444891 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.445276 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.445549 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.445652 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.445911 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.446011 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.446288 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.446396 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.446643 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.446749 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.447031 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.447152 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.447457 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.447560 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.447731 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.447875 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.448120 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.448484 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.448759 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.448981 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.449270 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.449419 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] glance.allowed_direct_url_schemes = [] {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.449634 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.450030 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.450323 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.450444 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.450848 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.450973 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.451578 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.451685 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.451909 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.452268 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.452574 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.452689 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.452944 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.453058 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.453295 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.453395 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.453651 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.453757 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.454004 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.454140 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.454437 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.454539 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.454724 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.454825 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.455060 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.455169 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.455407 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.455508 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.455758 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.455864 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.456105 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.456218 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.456444 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.456550 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.456790 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.456889 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.457141 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.457236 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.457476 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.457595 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.457810 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.457928 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.458257 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.458735 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.458898 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.459102 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.459259 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.459484 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.459737 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.459927 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.460153 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.460341 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.460572 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.460727 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.461120 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.461286 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.461438 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.461587 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 16 14:54:09.461737 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.461737 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.462214 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.462487 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.462645 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.462812 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.462963 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.463126 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.463417 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.463586 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.463745 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.463898 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.463898 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.464201 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.464359 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.464531 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.464778 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.464936 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.465110 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.465268 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.465424 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.465581 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.465737 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.465893 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.466081 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.466240 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.466400 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.466550 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.466750 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.467411 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.467411 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.467718 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.467875 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.468111 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.468276 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.468432 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.468595 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.468751 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.468908 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.469058 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.469207 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.469369 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.469519 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.469679 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.469919 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.470106 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.470342 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.470727 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.470888 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.471264 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.471423 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.471573 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.471721 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.471884 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.472042 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.472208 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.472628 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.472793 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.472945 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.473107 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.473259 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.473415 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.473566 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.473721 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.473878 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.474028 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.474219 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.474377 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.474529 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.474687 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.474687 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.475099 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.475251 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.475400 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.475555 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.475725 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.475891 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.476041 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.476190 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.476338 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.476494 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.476661 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.476822 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.476978 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.477128 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.477288 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.477438 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.477637 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.477802 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.477952 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.478215 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.478371 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.478521 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.478683 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.478844 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.478999 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.479150 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.479306 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.479457 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.479614 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.479771 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.479939 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.480162 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.480341 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.480561 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.480744 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.480966 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.481146 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.481527 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.481681 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.481840 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.481997 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.482183 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.482370 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.482764 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.482930 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.483089 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.483239 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.483395 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.483551 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.483713 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.483869 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.484033 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.484185 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.484340 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.484489 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.484644 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.484803 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.484982 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.485226 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.485388 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.485388 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.485702 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.485865 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.486021 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.486245 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.486395 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.486560 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.486710 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.486866 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.487021 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.487184 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.487184 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.487184 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.487184 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.487766 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.487766 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.488060 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.488230 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.488675 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.489023 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.489375 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.489731 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.490097 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.490455 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.490808 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.491155 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.491544 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.491728 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.491887 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.492038 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.492187 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.492412 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.492601 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.492997 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.493156 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.493313 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.493465 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.493661 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.493835 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.493988 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.494193 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.494346 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.494496 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.494661 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.494812 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.494968 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.495118 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.495375 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.495541 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.495698 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.495854 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.495854 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.496147 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.496312 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.496477 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.496638 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.496788 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.496936 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.497126 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.497291 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.497449 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.497607 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.497757 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.497913 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.498147 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.498312 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.498492 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.498728 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.498883 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.499039 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.499188 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.499350 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.499500 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.499648 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.499798 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.499946 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.500150 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.500333 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.500567 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.500811 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.501062 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.501304 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.501475 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.501847 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.502006 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.502200 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.502351 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.502500 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.502655 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.502812 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.503235 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.503404 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.503555 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.503704 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.503852 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.504016 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.504167 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.504321 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.504471 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.504620 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.504777 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.504777 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.505062 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.505218 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.505403 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.505646 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.505816 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.505976 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.505976 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.506326 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.506484 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.506635 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.506796 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.506946 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.507097 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.507246 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.507246 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.507548 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.507548 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.507856 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.508006 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.508161 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.508311 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.508471 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.508629 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.508879 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.509036 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.509187 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.509336 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.509598 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.509845 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.510003 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.510430 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.510603 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.510938 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.511113 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.511290 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.511542 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.511990 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.512159 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.512159 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.512459 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.512635 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.512792 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.512949 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.513471 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.513471 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.514344 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.514495 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.514643 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.514797 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.515061 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.515405 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.515565 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.515860 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.516107 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] glance.allowed_direct_url_schemes = [] {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.516267 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.516524 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.516744 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.516903 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.517216 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.517380 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.517548 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.517901 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_usb_tablet = True {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.518105 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.518272 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.518805 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.519121 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.519273 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.519273 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.519573 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.519771 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.519931 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.520146 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.520304 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.520525 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.520684 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.521056 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.521222 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.521372 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.521547 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.521809 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.522300 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.522471 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.522630 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.522788 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.522938 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.523101 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.523378 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.523795 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.523953 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.524104 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.524266 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.524433 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.524765 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.524926 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.xen_hvmloader_path = /usr/lib/xen/boot/hvmloader {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.525124 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.525470 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.525641 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.525993 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.526236 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.526835 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.527205 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.527573 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.527740 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.527995 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.528163 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.528355 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.528513 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.528740 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.528905 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.529199 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.529882 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.530059 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.530218 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.530435 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.530847 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.531035 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.531507 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.531673 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.531942 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.532126 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.532583 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.532583 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.532893 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.533043 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.533198 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.533375 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.533623 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.534067 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.534232 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.534411 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.534411 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.534411 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.534903 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.535052 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.535200 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.535356 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.535660 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.536168 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.536411 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.536777 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.537157 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.537602 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.537959 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.538393 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.538830 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.539220 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.539559 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.539935 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.540420 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.540589 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.540740 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.540896 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.541096 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.541264 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.541443 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.541777 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.541947 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.542255 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.542427 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.542836 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.542990 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.543141 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.543296 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.543453 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.543621 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.543621 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.544229 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.544397 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.544549 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.544699 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.544880 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.545042 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.545199 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.545349 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.545497 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.545646 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.545807 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.545959 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.546131 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.546391 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.546566 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.546724 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.546882 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.547031 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.547186 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.547342 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.547498 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.547655 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.547812 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.547963 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.548117 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.548266 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.548413 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.548577 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.548735 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.548891 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.549048 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.549205 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.549502 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.549677 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.549838 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.549989 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.550173 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.550330 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.550487 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.550652 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.550802 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.550957 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.551108 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.551272 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.551428 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.551585 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.551915 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.552071 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.552237 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.552465 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.552634 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.553051 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.553051 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.553357 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.553507 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.553655 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.553803 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.553803 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.554492 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: WARNING oslo_config.cfg [-] Deprecated: Option "driver" from group "scheduler" is deprecated for removal ( Dec 16 14:54:09.554492 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: nova no longer provides any in-tree filters except for the 'filter_scheduler' Dec 16 14:54:09.554492 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: scheduler. This filter is considered flexible and pluggable enough for all use Dec 16 14:54:09.554492 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: cases and can be extended through the use of custom, out-of-tree filters and Dec 16 14:54:09.554492 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: weighers along with powerful, in-tree filters like the Dec 16 14:54:09.554492 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: 'AggregateInstanceExtraSpecsFilter' and 'ComputeCapabilitiesFilter' filters. Dec 16 14:54:09.554492 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: ). Its value may be silently ignored in the future. Dec 16 14:54:09.555483 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.555642 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.driver = filter_scheduler {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.555793 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.555949 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.556108 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.556264 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.556442 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.556694 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.556858 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.557016 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.557016 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.557301 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.557463 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.periodic_task_interval = 60 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.557613 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.557761 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.557915 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.558103 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.558268 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.558426 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.558582 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.558731 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.558731 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.559021 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.559178 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.559327 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.559492 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.559730 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.559892 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.560042 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.560211 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.560370 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.561089 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.561242 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.561390 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.561548 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.561697 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.561871 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.562200 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.562360 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.562612 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.562794 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.563185 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.563345 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.563494 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.563644 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.563792 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.563954 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.564187 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.564342 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.564693 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.564858 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.565023 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.565173 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.565331 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.565486 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.565637 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.565786 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.565947 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.566176 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.566342 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.566492 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.566641 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.566902 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.567072 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.567223 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.567378 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.567539 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.567695 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.567907 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.568058 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.568206 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.568206 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.568496 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.568645 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.568806 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.568962 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.569112 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.569261 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.569415 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.569580 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.569580 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.569962 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.570140 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.570290 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.570438 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.570595 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.570757 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.570907 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.571065 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.571214 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.571362 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.571527 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.571684 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.571840 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.572003 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.572297 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.572297 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.572621 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.572849 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.573010 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.573387 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.573552 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.573705 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.573862 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.574027 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.574216 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.574435 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.574604 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.574927 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.575099 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.575258 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.575415 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.575415 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.575709 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.575879 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.576037 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.576746 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.576932 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.577177 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.577340 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] spice.keymap = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.577496 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.577654 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.577804 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.577961 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.578147 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.578300 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.578300 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.578585 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.578741 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.578891 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.579061 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.579219 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.579378 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.579527 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.579676 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.579836 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.580011 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.580230 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.580386 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.580536 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.580684 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.580841 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.581004 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.581156 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.581305 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.581460 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.581617 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.581775 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.581925 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.582143 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.582451 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.582608 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.582757 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.583002 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.583166 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.583799 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.583966 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.584117 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.584274 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.584440 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.584666 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.584827 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.585169 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.585325 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.585484 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.585634 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.585790 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.585790 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.586124 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.586288 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.586447 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.586603 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.586760 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.586916 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.587072 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.587327 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.587497 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.587649 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.587806 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.587956 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.588104 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.588320 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.588438 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.588515 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.588619 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.588725 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.588825 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.588990 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.588990 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.589194 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.589300 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.589456 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.589605 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.589605 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.589605 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.590067 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.590238 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.590460 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.590616 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.590780 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.590932 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.590932 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vnc.keymap = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.591240 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.591240 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.591545 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.591718 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.591888 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.592046 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.592202 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.592353 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.592677 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.592833 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.593007 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.593232 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.593386 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.593699 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.593959 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.593959 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.594330 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.594498 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.594671 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.594900 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.595068 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.595448 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.595613 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.595771 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.595928 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.596086 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.596237 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.596392 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.596541 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.596695 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.596695 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.597005 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.597156 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.597321 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.597560 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.597716 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.597873 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.598054 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.598213 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.598502 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.598660 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.598810 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_usb_tablet = True {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.599073 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.599232 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.599388 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.599538 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.599687 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.599842 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.599842 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.600135 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.600284 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.600449 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.600667 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.600831 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.601001 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.601166 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.601322 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.601580 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.601744 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.601902 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.602098 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.602258 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.agent_path = usr/sbin/xe-update-networking {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.602408 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.602557 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.agent_resetnetwork_timeout = 60 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.602557 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.agent_timeout = 30 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.603021 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.603172 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.agent_version_timeout = 300 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.603425 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.603583 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.block_device_creation_timeout = 10 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.603859 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.xen_hvmloader_path = /usr/lib/xen/boot/hvmloader {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.604098 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.cache_images = all {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.604264 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.604415 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.check_host = True {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.604566 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.604722 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.connection_concurrent = 5 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.604888 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.605105 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.connection_password = **** {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.605268 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.605418 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.connection_url = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.605761 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.605930 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.connection_username = root {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.606098 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.606253 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.console_public_hostname = dv-cinder-821894-3-iscsi {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.606418 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.606568 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.default_os_type = linux {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.606723 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.606881 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.disable_agent = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.607037 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.607198 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.image_compression_level = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.607373 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.607524 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.image_handler = direct_vhd {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.607781 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.607946 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.image_upload_handler = {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.608112 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.608275 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.independent_compute = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.608433 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.608667 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.introduce_vdi_retry_wait = 20 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.608831 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.608988 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.ipxe_boot_menu_url = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.609145 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.609304 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.ipxe_mkisofs_cmd = mkisofs {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.609454 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.609602 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.ipxe_network_name = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.609750 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.609899 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.login_timeout = 10 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.610112 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.610288 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.max_kernel_ramdisk_size = 16777216 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.610446 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.610603 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.num_vbd_unplug_retries = 10 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.610835 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.611003 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.ovs_integration_bridge = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.611003 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.running_timeout = 60 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.611313 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.611469 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.sparse_copy = True {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.611619 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.611774 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.sr_base_path = /var/run/sr-mount {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.611932 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.612089 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.sr_matching_filter = default-sr:true {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.612248 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.612407 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.target_host = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.612559 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.612713 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.target_port = 3260 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.613027 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.613197 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.use_agent_default = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.613349 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.613583 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.use_join_force = True {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.613746 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.613982 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.vhd_coalesce_max_attempts = 20 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.614241 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.614411 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.vhd_coalesce_poll_interval = 5.0 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.614569 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.614729 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.614885 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.615037 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.615282 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.615445 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.615596 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.615934 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.616094 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.616272 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] remote_debug.host = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.616470 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.616622 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] remote_debug.port = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.616772 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.616938 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.617089 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.617239 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.617399 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.617550 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.617706 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.617962 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.618152 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.618314 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.618465 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.618615 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.618857 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.619019 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.619185 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.619345 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.619495 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.619652 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.619803 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.619952 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.620101 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.620257 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.620410 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.620566 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.620716 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.620960 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.621118 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.621285 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.621443 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.621593 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.621748 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.621905 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.622080 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.622247 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.622406 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.622556 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.622705 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.622861 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.623802 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.623994 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.624242 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.624469 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.624632 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.624790 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.624790 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.625096 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.625096 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.625474 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.625637 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.625800 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.626212 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.626372 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.626532 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.626693 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.626851 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.627009 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.627009 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.627303 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.627460 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.627612 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.627767 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.627929 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.628182 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.628349 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.628521 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.628521 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.628521 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.629065 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.629234 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.629386 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.629543 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.629694 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.629694 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.629988 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.629988 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.630300 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.630300 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.630607 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.630607 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.630607 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101356) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2591}} Dec 16 14:54:09.631132 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.631132 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.631132 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: WARNING oslo_config.cfg [-] Deprecated: Option "driver" from group "scheduler" is deprecated for removal ( Dec 16 14:54:09.631132 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: nova no longer provides any in-tree filters except for the 'filter_scheduler' Dec 16 14:54:09.631132 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: scheduler. This filter is considered flexible and pluggable enough for all use Dec 16 14:54:09.631132 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: cases and can be extended through the use of custom, out-of-tree filters and Dec 16 14:54:09.631132 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: weighers along with powerful, in-tree filters like the Dec 16 14:54:09.631132 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: 'AggregateInstanceExtraSpecsFilter' and 'ComputeCapabilitiesFilter' filters. Dec 16 14:54:09.631132 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: ). Its value may be silently ignored in the future. Dec 16 14:54:09.632382 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.driver = filter_scheduler {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.632382 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.632382 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.632814 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.632979 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.633253 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.633797 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.periodic_task_interval = 60 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.633980 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.634331 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.634695 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.635088 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.635521 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.636526 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.636526 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.636526 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.636997 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.637247 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.637620 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.638073 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.638469 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.639402 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.640071 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.640452 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.640832 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.641191 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.641556 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.641923 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.642355 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.642726 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.643091 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.643455 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.643951 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.644197 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.644649 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.644956 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.645322 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.645690 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.646100 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.646754 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.647125 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.647521 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.647907 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.648289 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.648658 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.649030 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.649401 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.649731 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.650207 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.650461 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.650823 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.651178 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.651538 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.651898 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.652250 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.652888 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.653352 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.653889 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.654372 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.656540 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.656540 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] spice.keymap = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.656540 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.656540 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.656540 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.656540 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.656991 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.657182 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.657534 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.657911 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.658304 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.658661 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.658996 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.659358 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.659727 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.660082 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.660443 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.660797 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.661192 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.661554 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.661909 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.662292 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.662657 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.663009 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.663367 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.663725 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.664081 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.664452 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.664809 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.665167 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.665523 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.665886 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.666270 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.666633 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.666989 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.667370 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.667725 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.668079 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.668452 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.668815 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.669198 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.669560 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.669928 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_db.sqlalchemy.engines [None req-e2f8b5f0-302b-4159-9135-aecbb008c2f6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=101356) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 16 14:54:09.670097 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.670374 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.670749 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.671112 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vnc.keymap = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.671747 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.672141 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.672511 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.672914 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.673312 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.673673 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.674029 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.674461 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.674848 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.675212 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.675575 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.675923 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.676262 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.676811 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.677176 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.677538 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.677900 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.678289 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.678651 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.679070 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.679449 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.679805 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.680373 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.680941 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.681536 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.681908 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.682298 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.682668 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.683038 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.683438 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.683847 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.agent_path = usr/sbin/xe-update-networking {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.684209 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.agent_resetnetwork_timeout = 60 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.684575 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.agent_timeout = 30 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.684935 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.agent_version_timeout = 300 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.685300 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.block_device_creation_timeout = 10 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.686251 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.cache_images = all {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.686622 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.check_host = True {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.686984 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.connection_concurrent = 5 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.687338 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.connection_password = **** {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.687696 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.connection_url = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.688076 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.connection_username = root {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.688470 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.console_public_hostname = dv-cinder-821894-3-iscsi {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.688850 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.default_os_type = linux {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.689212 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.disable_agent = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.689569 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.image_compression_level = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.689967 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.image_handler = direct_vhd {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.690374 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.image_upload_handler = {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.690737 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.independent_compute = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.691099 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.introduce_vdi_retry_wait = 20 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.691454 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.ipxe_boot_menu_url = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.691834 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.ipxe_mkisofs_cmd = mkisofs {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.692193 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.ipxe_network_name = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.692553 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.login_timeout = 10 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.692913 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.max_kernel_ramdisk_size = 16777216 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.693275 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.num_vbd_unplug_retries = 10 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.693755 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.ovs_integration_bridge = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.694172 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.running_timeout = 60 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.694606 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.sparse_copy = True {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.694919 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.sr_base_path = /var/run/sr-mount {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.695299 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.sr_matching_filter = default-sr:true {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.695655 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.target_host = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.696015 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.target_port = 3260 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.696375 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.use_agent_default = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.696992 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.use_join_force = True {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.697360 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.vhd_coalesce_max_attempts = 20 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.697731 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] xenserver.vhd_coalesce_poll_interval = 5.0 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.698167 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.698531 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.699045 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.699412 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.699780 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] remote_debug.host = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.700142 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] remote_debug.port = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.700527 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.700936 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.701954 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.702368 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.702743 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.703124 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.703489 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.703874 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.704255 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.704636 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.704991 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.705383 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.705746 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.706136 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.706500 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.706864 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.707227 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.707588 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.707981 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.708369 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.708993 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.709377 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.709746 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.710156 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.710528 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.710899 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.711288 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.711652 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.712052 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.712383 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.712755 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.713126 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.713496 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.713879 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.714289 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.714678 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.715061 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.715486 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.715852 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.716263 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.716661 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 16 14:54:09.717011 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101355) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2591}} Dec 16 14:54:09.758431 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_db.sqlalchemy.engines [None req-12931fe4-a198-4f53-a470-8323233a0435 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=101355) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 16 14:54:10.030767 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.context [None req-e2f8b5f0-302b-4159-9135-aecbb008c2f6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),93843735-3183-4729-8723-375da9e05360(cell1) {{(pid=101356) load_cells /opt/stack/nova/nova/context.py:467}} Dec 16 14:54:10.036425 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e2f8b5f0-302b-4159-9135-aecbb008c2f6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:54:10.038243 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e2f8b5f0-302b-4159-9135-aecbb008c2f6 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:54:10.039281 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e2f8b5f0-302b-4159-9135-aecbb008c2f6 None None] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:54:10.041295 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e2f8b5f0-302b-4159-9135-aecbb008c2f6 None None] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:54:10.066926 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_db.sqlalchemy.engines [None req-e2f8b5f0-302b-4159-9135-aecbb008c2f6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=101356) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 16 14:54:10.069489 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_db.sqlalchemy.engines [None req-e2f8b5f0-302b-4159-9135-aecbb008c2f6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=101356) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 16 14:54:10.098354 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_db.sqlalchemy.engines [None req-e2f8b5f0-302b-4159-9135-aecbb008c2f6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=101356) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 16 14:54:10.118891 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.context [None req-12931fe4-a198-4f53-a470-8323233a0435 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),93843735-3183-4729-8723-375da9e05360(cell1) {{(pid=101355) load_cells /opt/stack/nova/nova/context.py:467}} Dec 16 14:54:10.125097 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-12931fe4-a198-4f53-a470-8323233a0435 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:54:10.126921 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-12931fe4-a198-4f53-a470-8323233a0435 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:54:10.127921 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-12931fe4-a198-4f53-a470-8323233a0435 None None] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:54:10.130002 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-12931fe4-a198-4f53-a470-8323233a0435 None None] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:54:10.154771 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_db.sqlalchemy.engines [None req-12931fe4-a198-4f53-a470-8323233a0435 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=101355) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 16 14:54:10.155673 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_db.sqlalchemy.engines [None req-12931fe4-a198-4f53-a470-8323233a0435 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=101355) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 16 14:54:10.187775 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_db.sqlalchemy.engines [None req-12931fe4-a198-4f53-a470-8323233a0435 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=101355) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 16 14:54:10.546027 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: WARNING keystonemiddleware.auth_token [None req-e2f8b5f0-302b-4159-9135-aecbb008c2f6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 16 14:54:10.553698 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: WARNING keystonemiddleware.auth_token [None req-e2f8b5f0-302b-4159-9135-aecbb008c2f6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 16 14:54:10.656445 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: WARNING keystonemiddleware.auth_token [None req-12931fe4-a198-4f53-a470-8323233a0435 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 16 14:54:10.664229 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: WARNING keystonemiddleware.auth_token [None req-12931fe4-a198-4f53-a470-8323233a0435 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 16 14:54:10.880653 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: WARNING keystonemiddleware.auth_token [None req-e2f8b5f0-302b-4159-9135-aecbb008c2f6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 16 14:54:10.886510 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: WARNING keystonemiddleware.auth_token [None req-e2f8b5f0-302b-4159-9135-aecbb008c2f6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 16 14:54:10.892306 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ff33a315d0 pid: 101356 (default app) Dec 16 14:54:10.996828 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: WARNING keystonemiddleware.auth_token [None req-12931fe4-a198-4f53-a470-8323233a0435 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 16 14:54:11.002991 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: WARNING keystonemiddleware.auth_token [None req-12931fe4-a198-4f53-a470-8323233a0435 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 16 14:54:11.008528 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55ff33a315d0 pid: 101355 (default app) Dec 16 14:55:01.808224 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-4d174aef-935c-4823-b04e-598eafe1f642 tempest-VolumesSnapshotsTestJSON-405609184 tempest-VolumesSnapshotsTestJSON-405609184-project] Action: 'create', calling method: .version_select at 0x7f14f76552f0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1834586807"}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:55:01.952530 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-e2fbc835-1b8b-4303-b12b-0d78edf8a4fa tempest-VolumesGetTestJSON-255620915 tempest-VolumesGetTestJSON-255620915-project] Action: 'create', calling method: .version_select at 0x7f14f76512f0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1685071604", "metadata": {"Type": "work"}}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:55:03.599632 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-4d174aef-935c-4823-b04e-598eafe1f642 tempest-VolumesSnapshotsTestJSON-405609184 tempest-VolumesSnapshotsTestJSON-405609184-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.379302 Dec 16 14:55:03.600715 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1/1] 10.222.0.45 () {60 vars in 1145 bytes} [Thu Dec 16 14:55:00 2021] POST /compute/v2.1/os-volumes => generated 345 bytes in 3382 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Dec 16 14:55:03.765799 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-e2fbc835-1b8b-4303-b12b-0d78edf8a4fa tempest-VolumesGetTestJSON-255620915 tempest-VolumesGetTestJSON-255620915-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 2.965244 Dec 16 14:55:03.766534 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1/2] 10.222.0.45 () {60 vars in 1146 bytes} [Thu Dec 16 14:55:00 2021] POST /compute/v2.1/os-volumes => generated 353 bytes in 2969 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Dec 16 14:55:03.916112 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-d6689245-f61d-40aa-821f-f6b888cd90b1 tempest-VolumesNegativeTest-1803166700 tempest-VolumesNegativeTest-1803166700-project] Action: 'create', calling method: .version_select at 0x7f14f8169598>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1651378003", "metadata": {"Type": "work"}}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:55:03.919624 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-d6689245-f61d-40aa-821f-f6b888cd90b1 tempest-VolumesNegativeTest-1803166700 tempest-VolumesNegativeTest-1803166700-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=101356) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:941}} Dec 16 14:55:03.920952 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-d6689245-f61d-40aa-821f-f6b888cd90b1 tempest-VolumesNegativeTest-1803166700 tempest-VolumesNegativeTest-1803166700-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.318691 Dec 16 14:55:03.921670 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 2/3] 10.222.0.45 () {60 vars in 1146 bytes} [Thu Dec 16 14:55:03 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 320 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 16 14:55:03.934199 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-077e1162-cb7a-4039-9278-203da13dcc18 tempest-VolumesSnapshotsTestJSON-405609184 tempest-VolumesSnapshotsTestJSON-405609184-project] Calling method '.version_select at 0x7f14f757b048>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:03.934557 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-2c0cd950-aa1d-42cf-b774-6139b35dd74c tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-799762820", "imageRef": "9b00ff4e-db72-4324-820b-87a6bd73b055", "flavorRef": "452", "networks": [{"uuid": "6400031e-0dc2-4363-a75b-4e9ac2480f83"}]}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:55:04.100645 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-077e1162-cb7a-4039-9278-203da13dcc18 tempest-VolumesSnapshotsTestJSON-405609184 tempest-VolumesSnapshotsTestJSON-405609184-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/8f4d029d-e43a-4ed5-b0b8-c6d473339535" status: 200 len: 345 microversion: 2.1 time: 0.177577 Dec 16 14:55:04.101263 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 3/4] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Dec 16 14:55:03 2021] GET /compute/v2.1/os-volumes/8f4d029d-e43a-4ed5-b0b8-c6d473339535 => generated 345 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:55:04.119513 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-f0d237cb-45fc-4938-9fee-1ef67325a6f9 tempest-VolumesGetTestJSON-255620915 tempest-VolumesGetTestJSON-255620915-project] Calling method '.version_select at 0x7f14f757b488>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:04.143214 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.network.neutron [None req-2c0cd950-aa1d-42cf-b774-6139b35dd74c tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] validate_networks() for [('6400031e-0dc2-4363-a75b-4e9ac2480f83', None, None, None)] {{(pid=101355) validate_networks /opt/stack/nova/nova/network/neutron.py:2383}} Dec 16 14:55:04.263965 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-f0d237cb-45fc-4938-9fee-1ef67325a6f9 tempest-VolumesGetTestJSON-255620915 tempest-VolumesGetTestJSON-255620915-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/1ad8c39b-e922-4cdb-a5f0-38f83d3fd75d" status: 200 len: 353 microversion: 2.1 time: 0.155409 Dec 16 14:55:04.263965 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 4/5] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Dec 16 14:55:04 2021] GET /compute/v2.1/os-volumes/1ad8c39b-e922-4cdb-a5f0-38f83d3fd75d => generated 353 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:55:04.272018 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-63220c11-d233-4173-9082-21ee28db3ab1 tempest-VolumesNegativeTest-1803166700 tempest-VolumesNegativeTest-1803166700-project] Action: 'create', calling method: .version_select at 0x7f14f757b730>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-136296517", "metadata": {"Type": "work"}}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:55:04.275325 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-63220c11-d233-4173-9082-21ee28db3ab1 tempest-VolumesNegativeTest-1803166700 tempest-VolumesNegativeTest-1803166700-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=101356) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:941}} Dec 16 14:55:04.281480 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-63220c11-d233-4173-9082-21ee28db3ab1 tempest-VolumesNegativeTest-1803166700 tempest-VolumesNegativeTest-1803166700-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.015480 Dec 16 14:55:04.282494 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 5/6] 10.222.0.45 () {60 vars in 1146 bytes} [Thu Dec 16 14:55:04 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 16 14:55:04.298833 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-a8d86bd8-179b-4925-84f9-14f05dd00d57 tempest-VolumesNegativeTest-1803166700 tempest-VolumesNegativeTest-1803166700-project] Action: 'create', calling method: .version_select at 0x7f14f757bae8>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-530572272", "metadata": {"Type": "work"}}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:55:04.300427 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-a8d86bd8-179b-4925-84f9-14f05dd00d57 tempest-VolumesNegativeTest-1803166700 tempest-VolumesNegativeTest-1803166700-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=101356) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:941}} Dec 16 14:55:04.301336 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-a8d86bd8-179b-4925-84f9-14f05dd00d57 tempest-VolumesNegativeTest-1803166700 tempest-VolumesNegativeTest-1803166700-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.013229 Dec 16 14:55:04.302831 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 6/7] 10.222.0.45 () {60 vars in 1146 bytes} [Thu Dec 16 14:55:04 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 16 14:55:04.318511 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-21bd8035-fc85-4ac2-bf4a-aa61f7841b93 tempest-VolumesNegativeTest-1803166700 tempest-VolumesNegativeTest-1803166700-project] Calling method '.version_select at 0x7f14f757bd08>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:04.480816 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.wsgi [None req-21bd8035-fc85-4ac2-bf4a-aa61f7841b93 tempest-VolumesNegativeTest-1803166700 tempest-VolumesNegativeTest-1803166700-project] HTTP exception thrown: Volume tempest-invalid-1237650315 could not be found. Dec 16 14:55:04.482311 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-21bd8035-fc85-4ac2-bf4a-aa61f7841b93 tempest-VolumesNegativeTest-1803166700 tempest-VolumesNegativeTest-1803166700-project] Returning 404 to user: Volume tempest-invalid-1237650315 could not be found. {{(pid=101356) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:941}} Dec 16 14:55:04.483368 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-21bd8035-fc85-4ac2-bf4a-aa61f7841b93 tempest-VolumesNegativeTest-1803166700 tempest-VolumesNegativeTest-1803166700-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1237650315" status: 404 len: 99 microversion: 2.1 time: 0.175678 Dec 16 14:55:04.488587 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 7/8] 10.222.0.45 () {58 vars in 1208 bytes} [Thu Dec 16 14:55:04 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-1237650315 => generated 99 bytes in 182 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Dec 16 14:55:04.497970 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-de357153-195e-4449-bdee-d6f6b04738b4 tempest-VolumesNegativeTest-1803166700 tempest-VolumesNegativeTest-1803166700-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007658 Dec 16 14:55:04.498759 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 8/9] 10.222.0.45 () {58 vars in 1130 bytes} [Thu Dec 16 14:55:04 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Dec 16 14:55:04.514779 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-027ced00-307f-417d-87fe-957fa8c4e7a4 tempest-VolumesNegativeTest-1803166700 tempest-VolumesNegativeTest-1803166700-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.008850 Dec 16 14:55:04.515502 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 9/10] 10.222.0.45 () {58 vars in 1127 bytes} [Thu Dec 16 14:55:04 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Dec 16 14:55:04.529194 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-c7c8f9dc-26e7-43c6-9d24-d427bd6e35ff tempest-VolumesNegativeTest-1803166700 tempest-VolumesNegativeTest-1803166700-project] Calling method '.version_select at 0x7f14f757b378>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:04.617594 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.wsgi [None req-c7c8f9dc-26e7-43c6-9d24-d427bd6e35ff tempest-VolumesNegativeTest-1803166700 tempest-VolumesNegativeTest-1803166700-project] HTTP exception thrown: Volume a4cceb77-ade8-45f0-81ab-3ae23330c7c4 could not be found. Dec 16 14:55:04.618979 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-c7c8f9dc-26e7-43c6-9d24-d427bd6e35ff tempest-VolumesNegativeTest-1803166700 tempest-VolumesNegativeTest-1803166700-project] Returning 404 to user: Volume a4cceb77-ade8-45f0-81ab-3ae23330c7c4 could not be found. {{(pid=101356) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:941}} Dec 16 14:55:04.620873 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-c7c8f9dc-26e7-43c6-9d24-d427bd6e35ff tempest-VolumesNegativeTest-1803166700 tempest-VolumesNegativeTest-1803166700-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/a4cceb77-ade8-45f0-81ab-3ae23330c7c4" status: 404 len: 109 microversion: 2.1 time: 0.099674 Dec 16 14:55:04.622365 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 10/11] 10.222.0.45 () {58 vars in 1238 bytes} [Thu Dec 16 14:55:04 2021] DELETE /compute/v2.1/os-volumes/a4cceb77-ade8-45f0-81ab-3ae23330c7c4 => generated 109 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 16 14:55:04.649268 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-159d15f8-6d03-4dcd-904c-f7ea614a970a tempest-VolumesNegativeTest-1803166700 tempest-VolumesNegativeTest-1803166700-project] Calling method '.version_select at 0x7f14f757b620>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:04.728512 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.wsgi [None req-159d15f8-6d03-4dcd-904c-f7ea614a970a tempest-VolumesNegativeTest-1803166700 tempest-VolumesNegativeTest-1803166700-project] HTTP exception thrown: Volume e10a45c9-18ce-44d8-af5b-cdc0f0ad437d could not be found. Dec 16 14:55:04.729711 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-159d15f8-6d03-4dcd-904c-f7ea614a970a tempest-VolumesNegativeTest-1803166700 tempest-VolumesNegativeTest-1803166700-project] Returning 404 to user: Volume e10a45c9-18ce-44d8-af5b-cdc0f0ad437d could not be found. {{(pid=101356) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:941}} Dec 16 14:55:04.731745 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-159d15f8-6d03-4dcd-904c-f7ea614a970a tempest-VolumesNegativeTest-1803166700 tempest-VolumesNegativeTest-1803166700-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/e10a45c9-18ce-44d8-af5b-cdc0f0ad437d" status: 404 len: 109 microversion: 2.1 time: 0.102596 Dec 16 14:55:04.732645 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 11/12] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Dec 16 14:55:04 2021] GET /compute/v2.1/os-volumes/e10a45c9-18ce-44d8-af5b-cdc0f0ad437d => generated 109 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 16 14:55:05.125440 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-b4e30436-0c60-4b54-bc2b-7777fec14c11 tempest-VolumesSnapshotsTestJSON-405609184 tempest-VolumesSnapshotsTestJSON-405609184-project] Calling method '.version_select at 0x7f14f79f5048>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:05.333905 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-b4e30436-0c60-4b54-bc2b-7777fec14c11 tempest-VolumesSnapshotsTestJSON-405609184 tempest-VolumesSnapshotsTestJSON-405609184-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/8f4d029d-e43a-4ed5-b0b8-c6d473339535" status: 200 len: 346 microversion: 2.1 time: 0.216765 Dec 16 14:55:05.334641 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 12/13] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Dec 16 14:55:05 2021] GET /compute/v2.1/os-volumes/8f4d029d-e43a-4ed5-b0b8-c6d473339535 => generated 346 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:55:05.356705 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-4df2a1e9-c078-485c-a88e-20790f84b06c tempest-VolumesGetTestJSON-255620915 tempest-VolumesGetTestJSON-255620915-project] Calling method '.version_select at 0x7f14f757bf28>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:05.548408 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-4df2a1e9-c078-485c-a88e-20790f84b06c tempest-VolumesGetTestJSON-255620915 tempest-VolumesGetTestJSON-255620915-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/1ad8c39b-e922-4cdb-a5f0-38f83d3fd75d" status: 200 len: 354 microversion: 2.1 time: 0.212673 Dec 16 14:55:05.549349 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 13/14] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Dec 16 14:55:05 2021] GET /compute/v2.1/os-volumes/1ad8c39b-e922-4cdb-a5f0-38f83d3fd75d => generated 354 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:55:05.568670 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-e873b6d5-2b4f-459d-bc47-74a00c9227e3 tempest-VolumesSnapshotsTestJSON-405609184 tempest-VolumesSnapshotsTestJSON-405609184-project] Action: 'create', calling method: .version_select at 0x7f14f757bd90>, body: {"snapshot": {"volume_id": "8f4d029d-e43a-4ed5-b0b8-c6d473339535", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1255867442"}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:55:05.695062 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.virt.hardware [None req-2c0cd950-aa1d-42cf-b774-6139b35dd74c tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Flavor limits 0:0:0 {{(pid=101355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:338}} Dec 16 14:55:05.699320 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.virt.hardware [None req-2c0cd950-aa1d-42cf-b774-6139b35dd74c tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Image limits 0:0:0 {{(pid=101355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:342}} Dec 16 14:55:05.699320 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.virt.hardware [None req-2c0cd950-aa1d-42cf-b774-6139b35dd74c tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Flavor pref 0:0:0 {{(pid=101355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:378}} Dec 16 14:55:05.699320 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.virt.hardware [None req-2c0cd950-aa1d-42cf-b774-6139b35dd74c tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Image pref 0:0:0 {{(pid=101355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:382}} Dec 16 14:55:05.699320 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.virt.hardware [None req-2c0cd950-aa1d-42cf-b774-6139b35dd74c tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=101355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:422}} Dec 16 14:55:05.719074 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2c0cd950-aa1d-42cf-b774-6139b35dd74c tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:05.719873 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2c0cd950-aa1d-42cf-b774-6139b35dd74c tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:05.720904 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2c0cd950-aa1d-42cf-b774-6139b35dd74c tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:05.724864 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2c0cd950-aa1d-42cf-b774-6139b35dd74c tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:05.781924 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.quota [None req-2c0cd950-aa1d-42cf-b774-6139b35dd74c tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Getting quotas for project c8372f52bdbf443385cd0058e122fbfc. Resources: {'ram', 'instances', 'cores'} {{(pid=101355) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 16 14:55:05.787941 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.quota [None req-2c0cd950-aa1d-42cf-b774-6139b35dd74c tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Getting quotas for user 7623b303ca8244b58179ef0146dd2bb5 and project c8372f52bdbf443385cd0058e122fbfc. Resources: {'ram', 'instances', 'cores'} {{(pid=101355) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 16 14:55:05.803390 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-2c0cd950-aa1d-42cf-b774-6139b35dd74c tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Going to run 1 instances... {{(pid=101355) _provision_instances /opt/stack/nova/nova/compute/api.py:1224}} Dec 16 14:55:05.807515 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-2c0cd950-aa1d-42cf-b774-6139b35dd74c tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] [instance: 8a5137d8-24f6-4b78-abcb-2cf8d939df3e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9b00ff4e-db72-4324-820b-87a6bd73b055',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1616}} Dec 16 14:55:06.078847 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-2c0cd950-aa1d-42cf-b774-6139b35dd74c tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.310997 Dec 16 14:55:06.086134 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 2/15] 10.222.0.45 () {60 vars in 1137 bytes} [Thu Dec 16 14:55:03 2021] POST /compute/v2.1/servers => generated 380 bytes in 2313 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 16 14:55:06.094123 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-4286000e-bdc1-45a9-a413-8ef24f7b86d5 tempest-VolumesGetTestJSON-255620915 tempest-VolumesGetTestJSON-255620915-project] Calling method '.version_select at 0x7f14f749cea0>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:06.271405 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-4286000e-bdc1-45a9-a413-8ef24f7b86d5 tempest-VolumesGetTestJSON-255620915 tempest-VolumesGetTestJSON-255620915-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/1ad8c39b-e922-4cdb-a5f0-38f83d3fd75d" status: 200 len: 354 microversion: 2.1 time: 0.185092 Dec 16 14:55:06.271405 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 3/16] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Dec 16 14:55:06 2021] GET /compute/v2.1/os-volumes/1ad8c39b-e922-4cdb-a5f0-38f83d3fd75d => generated 354 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:55:06.292010 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-756dc1bc-e430-4db2-b9c6-071b9a163a7c tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:06.293012 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-756dc1bc-e430-4db2-b9c6-071b9a163a7c tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] [instance: 8a5137d8-24f6-4b78-abcb-2cf8d939df3e] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:55:06.391120 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-e873b6d5-2b4f-459d-bc47-74a00c9227e3 tempest-VolumesSnapshotsTestJSON-405609184 tempest-VolumesSnapshotsTestJSON-405609184-project] 10.222.0.45 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.840358 Dec 16 14:55:06.391732 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 14/17] 10.222.0.45 () {60 vars in 1152 bytes} [Thu Dec 16 14:55:05 2021] POST /compute/v2.1/os-snapshots => generated 287 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:55:06.401466 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-3b764a9d-b3f0-4ba7-80fb-3f6a144c25f7 tempest-VolumesGetTestJSON-255620915 tempest-VolumesGetTestJSON-255620915-project] Calling method '.version_select at 0x7f14f761bf28>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:06.595206 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-756dc1bc-e430-4db2-b9c6-071b9a163a7c tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7623b303ca8244b58179ef0146dd2bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8372f52bdbf443385cd0058e122fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:06.622813 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-756dc1bc-e430-4db2-b9c6-071b9a163a7c tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] 10.222.0.45 "GET /compute/v2.1/servers/8a5137d8-24f6-4b78-abcb-2cf8d939df3e" status: 200 len: 1214 microversion: 2.1 time: 0.352704 Dec 16 14:55:06.637412 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 4/18] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:55:06 2021] GET /compute/v2.1/servers/8a5137d8-24f6-4b78-abcb-2cf8d939df3e => generated 1214 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:55:06.644657 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-20200868-79bf-4f9e-abd9-32d2001787fa tempest-VolumesSnapshotsTestJSON-405609184 tempest-VolumesSnapshotsTestJSON-405609184-project] Calling method '.version_select at 0x7f14f74aa8c8>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:06.686014 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-3b764a9d-b3f0-4ba7-80fb-3f6a144c25f7 tempest-VolumesGetTestJSON-255620915 tempest-VolumesGetTestJSON-255620915-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/1ad8c39b-e922-4cdb-a5f0-38f83d3fd75d" status: 202 len: 0 microversion: 2.1 time: 0.292982 Dec 16 14:55:06.686662 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 15/19] 10.222.0.45 () {58 vars in 1238 bytes} [Thu Dec 16 14:55:06 2021] DELETE /compute/v2.1/os-volumes/1ad8c39b-e922-4cdb-a5f0-38f83d3fd75d => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:55:06.701809 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-8955e05a-dd4a-4bd4-975d-e33954455516 tempest-VolumesGetTestJSON-255620915 tempest-VolumesGetTestJSON-255620915-project] Calling method '.version_select at 0x7f14f757bae8>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:06.737505 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-20200868-79bf-4f9e-abd9-32d2001787fa tempest-VolumesSnapshotsTestJSON-405609184 tempest-VolumesSnapshotsTestJSON-405609184-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/1338fd83-9c48-4023-83e6-b5330e2ba722" status: 200 len: 287 microversion: 2.1 time: 0.100773 Dec 16 14:55:06.738454 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 5/20] 10.222.0.45 () {58 vars in 1241 bytes} [Thu Dec 16 14:55:06 2021] GET /compute/v2.1/os-snapshots/1338fd83-9c48-4023-83e6-b5330e2ba722 => generated 287 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:55:06.756557 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-887ad1ac-1db0-474e-aed4-bec889fdd0a0 tempest-VolumesSnapshotsTestJSON-405609184 tempest-VolumesSnapshotsTestJSON-405609184-project] Calling method '.version_select at 0x7f14f744eb70>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:06.859370 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-887ad1ac-1db0-474e-aed4-bec889fdd0a0 tempest-VolumesSnapshotsTestJSON-405609184 tempest-VolumesSnapshotsTestJSON-405609184-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.113905 Dec 16 14:55:06.859987 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 6/21] 10.222.0.45 () {58 vars in 1130 bytes} [Thu Dec 16 14:55:06 2021] GET /compute/v2.1/os-snapshots => generated 290 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:55:06.876377 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-2f2f8c81-c6f2-4751-bec4-fc0012c3e66e tempest-VolumesSnapshotsTestJSON-405609184 tempest-VolumesSnapshotsTestJSON-405609184-project] Calling method '.version_select at 0x7f14f745d268>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:07.300817 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-8955e05a-dd4a-4bd4-975d-e33954455516 tempest-VolumesGetTestJSON-255620915 tempest-VolumesGetTestJSON-255620915-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/1ad8c39b-e922-4cdb-a5f0-38f83d3fd75d" status: 200 len: 353 microversion: 2.1 time: 0.270946 Dec 16 14:55:07.300817 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 16/22] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Dec 16 14:55:06 2021] GET /compute/v2.1/os-volumes/1ad8c39b-e922-4cdb-a5f0-38f83d3fd75d => generated 353 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:55:07.309854 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-2f2f8c81-c6f2-4751-bec4-fc0012c3e66e tempest-VolumesSnapshotsTestJSON-405609184 tempest-VolumesSnapshotsTestJSON-405609184-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/1338fd83-9c48-4023-83e6-b5330e2ba722" status: 200 len: 287 microversion: 2.1 time: 0.123886 Dec 16 14:55:07.309854 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 7/23] 10.222.0.45 () {58 vars in 1241 bytes} [Thu Dec 16 14:55:06 2021] GET /compute/v2.1/os-snapshots/1338fd83-9c48-4023-83e6-b5330e2ba722 => generated 287 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:55:07.647560 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-d7423d38-9286-4ac6-bee3-93878794c79a tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:07.648381 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-d7423d38-9286-4ac6-bee3-93878794c79a tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] [instance: 8a5137d8-24f6-4b78-abcb-2cf8d939df3e] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:55:07.822689 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-d7423d38-9286-4ac6-bee3-93878794c79a tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7623b303ca8244b58179ef0146dd2bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8372f52bdbf443385cd0058e122fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:07.899135 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-d7423d38-9286-4ac6-bee3-93878794c79a tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] 10.222.0.45 "GET /compute/v2.1/servers/8a5137d8-24f6-4b78-abcb-2cf8d939df3e" status: 200 len: 1214 microversion: 2.1 time: 0.258995 Dec 16 14:55:07.902977 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 17/24] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:55:07 2021] GET /compute/v2.1/servers/8a5137d8-24f6-4b78-abcb-2cf8d939df3e => generated 1214 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:55:07.998183 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-78b311ae-d673-40b9-aa66-cede28783170 tempest-VolumesGetTestJSON-255620915 tempest-VolumesGetTestJSON-255620915-project] Calling method '.version_select at 0x7f14f744eea0>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:08.010120 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-33f85e11-d37e-4d6f-8e78-172963a695a5 tempest-VolumesSnapshotsTestJSON-405609184 tempest-VolumesSnapshotsTestJSON-405609184-project] Calling method '.version_select at 0x7f14f761b8c8>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:08.173659 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-33f85e11-d37e-4d6f-8e78-172963a695a5 tempest-VolumesSnapshotsTestJSON-405609184 tempest-VolumesSnapshotsTestJSON-405609184-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/1338fd83-9c48-4023-83e6-b5330e2ba722" status: 200 len: 287 microversion: 2.1 time: 0.171203 Dec 16 14:55:08.178756 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 18/25] 10.222.0.45 () {58 vars in 1241 bytes} [Thu Dec 16 14:55:08 2021] GET /compute/v2.1/os-snapshots/1338fd83-9c48-4023-83e6-b5330e2ba722 => generated 287 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:55:08.225760 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-78b311ae-d673-40b9-aa66-cede28783170 tempest-VolumesGetTestJSON-255620915 tempest-VolumesGetTestJSON-255620915-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/1ad8c39b-e922-4cdb-a5f0-38f83d3fd75d" status: 200 len: 353 microversion: 2.1 time: 0.236575 Dec 16 14:55:08.227154 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 8/26] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Dec 16 14:55:07 2021] GET /compute/v2.1/os-volumes/1ad8c39b-e922-4cdb-a5f0-38f83d3fd75d => generated 353 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:55:08.924372 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-912661c2-adc9-44ce-a0bb-3d8a66ff8358 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:08.925053 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-912661c2-adc9-44ce-a0bb-3d8a66ff8358 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] [instance: 8a5137d8-24f6-4b78-abcb-2cf8d939df3e] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:55:08.943392 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-912661c2-adc9-44ce-a0bb-3d8a66ff8358 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:08.943884 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-912661c2-adc9-44ce-a0bb-3d8a66ff8358 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:08.944743 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-912661c2-adc9-44ce-a0bb-3d8a66ff8358 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:08.945214 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-912661c2-adc9-44ce-a0bb-3d8a66ff8358 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:09.190584 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-2a197992-0b7f-4fc7-984f-4d6227c7129c tempest-VolumesSnapshotsTestJSON-405609184 tempest-VolumesSnapshotsTestJSON-405609184-project] Calling method '.version_select at 0x7f14f744eb70>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:09.212627 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-912661c2-adc9-44ce-a0bb-3d8a66ff8358 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7623b303ca8244b58179ef0146dd2bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8372f52bdbf443385cd0058e122fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:09.240692 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-912661c2-adc9-44ce-a0bb-3d8a66ff8358 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] 10.222.0.45 "GET /compute/v2.1/servers/8a5137d8-24f6-4b78-abcb-2cf8d939df3e" status: 200 len: 1218 microversion: 2.1 time: 0.324282 Dec 16 14:55:09.243131 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 19/27] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:55:08 2021] GET /compute/v2.1/servers/8a5137d8-24f6-4b78-abcb-2cf8d939df3e => generated 1218 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:55:09.260059 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-56804184-25c2-4b9f-a5b4-a0f6d72e8626 tempest-VolumesGetTestJSON-255620915 tempest-VolumesGetTestJSON-255620915-project] Calling method '.version_select at 0x7f14f744a510>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:09.329825 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-2a197992-0b7f-4fc7-984f-4d6227c7129c tempest-VolumesSnapshotsTestJSON-405609184 tempest-VolumesSnapshotsTestJSON-405609184-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/1338fd83-9c48-4023-83e6-b5330e2ba722" status: 200 len: 287 microversion: 2.1 time: 0.146989 Dec 16 14:55:09.330498 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 9/28] 10.222.0.45 () {58 vars in 1241 bytes} [Thu Dec 16 14:55:09 2021] GET /compute/v2.1/os-snapshots/1338fd83-9c48-4023-83e6-b5330e2ba722 => generated 287 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:55:09.616266 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-56804184-25c2-4b9f-a5b4-a0f6d72e8626 tempest-VolumesGetTestJSON-255620915 tempest-VolumesGetTestJSON-255620915-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/1ad8c39b-e922-4cdb-a5f0-38f83d3fd75d" status: 200 len: 353 microversion: 2.1 time: 0.371264 Dec 16 14:55:09.617128 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 20/29] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Dec 16 14:55:09 2021] GET /compute/v2.1/os-volumes/1ad8c39b-e922-4cdb-a5f0-38f83d3fd75d => generated 353 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:55:10.262919 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-964991ed-bab7-408c-b9b9-9e39cd207c03 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:10.269236 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-964991ed-bab7-408c-b9b9-9e39cd207c03 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] [instance: 8a5137d8-24f6-4b78-abcb-2cf8d939df3e] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:55:10.296375 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-964991ed-bab7-408c-b9b9-9e39cd207c03 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:10.299616 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-964991ed-bab7-408c-b9b9-9e39cd207c03 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:10.300739 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-964991ed-bab7-408c-b9b9-9e39cd207c03 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:10.301442 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-964991ed-bab7-408c-b9b9-9e39cd207c03 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:10.356114 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-969c2f39-2390-4182-a541-a020524be1c9 tempest-VolumesSnapshotsTestJSON-405609184 tempest-VolumesSnapshotsTestJSON-405609184-project] Calling method '.version_select at 0x7f14f744ab70>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:10.496733 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-969c2f39-2390-4182-a541-a020524be1c9 tempest-VolumesSnapshotsTestJSON-405609184 tempest-VolumesSnapshotsTestJSON-405609184-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/1338fd83-9c48-4023-83e6-b5330e2ba722" status: 200 len: 287 microversion: 2.1 time: 0.153310 Dec 16 14:55:10.501818 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 21/30] 10.222.0.45 () {58 vars in 1241 bytes} [Thu Dec 16 14:55:10 2021] GET /compute/v2.1/os-snapshots/1338fd83-9c48-4023-83e6-b5330e2ba722 => generated 287 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:55:10.635145 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-2b2e93f5-92b8-41f1-bbb3-56e4acba786a tempest-VolumesGetTestJSON-255620915 tempest-VolumesGetTestJSON-255620915-project] Calling method '.version_select at 0x7f14f8138b70>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:10.719022 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-964991ed-bab7-408c-b9b9-9e39cd207c03 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7623b303ca8244b58179ef0146dd2bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8372f52bdbf443385cd0058e122fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:10.748638 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-964991ed-bab7-408c-b9b9-9e39cd207c03 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] 10.222.0.45 "GET /compute/v2.1/servers/8a5137d8-24f6-4b78-abcb-2cf8d939df3e" status: 200 len: 1210 microversion: 2.1 time: 0.487150 Dec 16 14:55:10.753240 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 10/31] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:55:10 2021] GET /compute/v2.1/servers/8a5137d8-24f6-4b78-abcb-2cf8d939df3e => generated 1210 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:55:10.866833 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-2b2e93f5-92b8-41f1-bbb3-56e4acba786a tempest-VolumesGetTestJSON-255620915 tempest-VolumesGetTestJSON-255620915-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/1ad8c39b-e922-4cdb-a5f0-38f83d3fd75d" status: 200 len: 353 microversion: 2.1 time: 0.241174 Dec 16 14:55:10.867449 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 22/32] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Dec 16 14:55:10 2021] GET /compute/v2.1/os-volumes/1ad8c39b-e922-4cdb-a5f0-38f83d3fd75d => generated 353 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:55:11.525646 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-1d881eb2-ff2f-498e-a9ab-9a36b4db91b0 tempest-VolumesSnapshotsTestJSON-405609184 tempest-VolumesSnapshotsTestJSON-405609184-project] Calling method '.version_select at 0x7f14f73d6f28>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:11.656244 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-1d881eb2-ff2f-498e-a9ab-9a36b4db91b0 tempest-VolumesSnapshotsTestJSON-405609184 tempest-VolumesSnapshotsTestJSON-405609184-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/1338fd83-9c48-4023-83e6-b5330e2ba722" status: 200 len: 287 microversion: 2.1 time: 0.151118 Dec 16 14:55:11.657413 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 11/33] 10.222.0.45 () {58 vars in 1241 bytes} [Thu Dec 16 14:55:11 2021] GET /compute/v2.1/os-snapshots/1338fd83-9c48-4023-83e6-b5330e2ba722 => generated 287 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:55:11.773749 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-b648e9a0-8b32-4b70-9e21-76902a4d9d24 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:11.777065 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-b648e9a0-8b32-4b70-9e21-76902a4d9d24 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] [instance: 8a5137d8-24f6-4b78-abcb-2cf8d939df3e] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:55:11.799189 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b648e9a0-8b32-4b70-9e21-76902a4d9d24 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:11.799746 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b648e9a0-8b32-4b70-9e21-76902a4d9d24 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:11.800624 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b648e9a0-8b32-4b70-9e21-76902a4d9d24 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:11.801116 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b648e9a0-8b32-4b70-9e21-76902a4d9d24 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:11.892687 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-6f38c2a6-27d7-443b-8ea7-e91b582c1def tempest-VolumesGetTestJSON-255620915 tempest-VolumesGetTestJSON-255620915-project] Calling method '.version_select at 0x7f14f736bd90>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:12.177008 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-6f38c2a6-27d7-443b-8ea7-e91b582c1def tempest-VolumesGetTestJSON-255620915 tempest-VolumesGetTestJSON-255620915-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/1ad8c39b-e922-4cdb-a5f0-38f83d3fd75d" status: 200 len: 353 microversion: 2.1 time: 0.295945 Dec 16 14:55:12.177490 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 12/34] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Dec 16 14:55:11 2021] GET /compute/v2.1/os-volumes/1ad8c39b-e922-4cdb-a5f0-38f83d3fd75d => generated 353 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:55:12.588162 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-b648e9a0-8b32-4b70-9e21-76902a4d9d24 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7623b303ca8244b58179ef0146dd2bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8372f52bdbf443385cd0058e122fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:12.629448 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-b648e9a0-8b32-4b70-9e21-76902a4d9d24 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] 10.222.0.45 "GET /compute/v2.1/servers/8a5137d8-24f6-4b78-abcb-2cf8d939df3e" status: 200 len: 1266 microversion: 2.1 time: 0.865109 Dec 16 14:55:12.630269 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 23/35] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:55:11 2021] GET /compute/v2.1/servers/8a5137d8-24f6-4b78-abcb-2cf8d939df3e => generated 1266 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:55:12.673454 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-2b5aeff0-75b5-4f26-ba85-52738dfa0d48 tempest-VolumesSnapshotsTestJSON-405609184 tempest-VolumesSnapshotsTestJSON-405609184-project] Calling method '.version_select at 0x7f14f73d6e18>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:12.845910 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-2b5aeff0-75b5-4f26-ba85-52738dfa0d48 tempest-VolumesSnapshotsTestJSON-405609184 tempest-VolumesSnapshotsTestJSON-405609184-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/1338fd83-9c48-4023-83e6-b5330e2ba722" status: 200 len: 288 microversion: 2.1 time: 0.180247 Dec 16 14:55:12.846723 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 13/36] 10.222.0.45 () {58 vars in 1241 bytes} [Thu Dec 16 14:55:12 2021] GET /compute/v2.1/os-snapshots/1338fd83-9c48-4023-83e6-b5330e2ba722 => generated 288 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:55:12.870708 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-c85e3bc4-0ec4-4a9e-b4c8-f64c8ef2b834 tempest-VolumesSnapshotsTestJSON-405609184 tempest-VolumesSnapshotsTestJSON-405609184-project] Calling method '.version_select at 0x7f14f7463bf8>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:13.195284 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-e0ad5a4a-237c-4335-8698-4012494f3163 tempest-VolumesGetTestJSON-255620915 tempest-VolumesGetTestJSON-255620915-project] Calling method '.version_select at 0x7f14f7c21d08>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:13.230126 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-c85e3bc4-0ec4-4a9e-b4c8-f64c8ef2b834 tempest-VolumesSnapshotsTestJSON-405609184 tempest-VolumesSnapshotsTestJSON-405609184-project] 10.222.0.45 "DELETE /compute/v2.1/os-snapshots/1338fd83-9c48-4023-83e6-b5330e2ba722" status: 202 len: 0 microversion: 2.1 time: 0.375243 Dec 16 14:55:13.235558 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 24/37] 10.222.0.45 () {58 vars in 1244 bytes} [Thu Dec 16 14:55:12 2021] DELETE /compute/v2.1/os-snapshots/1338fd83-9c48-4023-83e6-b5330e2ba722 => generated 0 bytes in 381 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:55:13.247316 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-8eaa826c-c701-4777-84d5-9b3fb1df4080 tempest-VolumesSnapshotsTestJSON-405609184 tempest-VolumesSnapshotsTestJSON-405609184-project] Calling method '.version_select at 0x7f14f73f09d8>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:13.394028 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.wsgi [None req-e0ad5a4a-237c-4335-8698-4012494f3163 tempest-VolumesGetTestJSON-255620915 tempest-VolumesGetTestJSON-255620915-project] HTTP exception thrown: Volume 1ad8c39b-e922-4cdb-a5f0-38f83d3fd75d could not be found. Dec 16 14:55:13.394802 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-e0ad5a4a-237c-4335-8698-4012494f3163 tempest-VolumesGetTestJSON-255620915 tempest-VolumesGetTestJSON-255620915-project] Returning 404 to user: Volume 1ad8c39b-e922-4cdb-a5f0-38f83d3fd75d could not be found. {{(pid=101355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:941}} Dec 16 14:55:13.395620 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-e0ad5a4a-237c-4335-8698-4012494f3163 tempest-VolumesGetTestJSON-255620915 tempest-VolumesGetTestJSON-255620915-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/1ad8c39b-e922-4cdb-a5f0-38f83d3fd75d" status: 404 len: 109 microversion: 2.1 time: 0.209356 Dec 16 14:55:13.397618 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 14/38] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Dec 16 14:55:13 2021] GET /compute/v2.1/os-volumes/1ad8c39b-e922-4cdb-a5f0-38f83d3fd75d => generated 109 bytes in 211 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 14:55:13.549177 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-8eaa826c-c701-4777-84d5-9b3fb1df4080 tempest-VolumesSnapshotsTestJSON-405609184 tempest-VolumesSnapshotsTestJSON-405609184-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/1338fd83-9c48-4023-83e6-b5330e2ba722" status: 200 len: 287 microversion: 2.1 time: 0.312219 Dec 16 14:55:13.554926 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 25/39] 10.222.0.45 () {58 vars in 1241 bytes} [Thu Dec 16 14:55:13 2021] GET /compute/v2.1/os-snapshots/1338fd83-9c48-4023-83e6-b5330e2ba722 => generated 287 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:55:13.654627 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-e01a8989-6adf-4ec0-ae03-89d004af7714 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:13.655283 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-e01a8989-6adf-4ec0-ae03-89d004af7714 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] [instance: 8a5137d8-24f6-4b78-abcb-2cf8d939df3e] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:55:13.714247 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e01a8989-6adf-4ec0-ae03-89d004af7714 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:13.722757 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e01a8989-6adf-4ec0-ae03-89d004af7714 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:13.723929 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e01a8989-6adf-4ec0-ae03-89d004af7714 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:13.724354 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e01a8989-6adf-4ec0-ae03-89d004af7714 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:14.041731 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-e01a8989-6adf-4ec0-ae03-89d004af7714 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7623b303ca8244b58179ef0146dd2bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8372f52bdbf443385cd0058e122fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:14.070447 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-e01a8989-6adf-4ec0-ae03-89d004af7714 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] 10.222.0.45 "GET /compute/v2.1/servers/8a5137d8-24f6-4b78-abcb-2cf8d939df3e" status: 200 len: 1272 microversion: 2.1 time: 0.426888 Dec 16 14:55:14.075938 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 15/40] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:55:13 2021] GET /compute/v2.1/servers/8a5137d8-24f6-4b78-abcb-2cf8d939df3e => generated 1272 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:55:14.566723 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-97ed25b2-d869-41de-882a-7686dc3303ac tempest-VolumesSnapshotsTestJSON-405609184 tempest-VolumesSnapshotsTestJSON-405609184-project] Calling method '.version_select at 0x7f14f74636a8>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:14.637040 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.wsgi [None req-97ed25b2-d869-41de-882a-7686dc3303ac tempest-VolumesSnapshotsTestJSON-405609184 tempest-VolumesSnapshotsTestJSON-405609184-project] HTTP exception thrown: Snapshot 1338fd83-9c48-4023-83e6-b5330e2ba722 could not be found. Dec 16 14:55:14.638062 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-97ed25b2-d869-41de-882a-7686dc3303ac tempest-VolumesSnapshotsTestJSON-405609184 tempest-VolumesSnapshotsTestJSON-405609184-project] Returning 404 to user: Snapshot 1338fd83-9c48-4023-83e6-b5330e2ba722 could not be found. {{(pid=101356) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:941}} Dec 16 14:55:14.639516 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-97ed25b2-d869-41de-882a-7686dc3303ac tempest-VolumesSnapshotsTestJSON-405609184 tempest-VolumesSnapshotsTestJSON-405609184-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/1338fd83-9c48-4023-83e6-b5330e2ba722" status: 404 len: 111 microversion: 2.1 time: 0.080488 Dec 16 14:55:14.640309 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 26/41] 10.222.0.45 () {58 vars in 1241 bytes} [Thu Dec 16 14:55:14 2021] GET /compute/v2.1/os-snapshots/1338fd83-9c48-4023-83e6-b5330e2ba722 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 14:55:14.654743 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-b90f78e9-e301-46f4-a4bc-748a1534d2a4 tempest-VolumesSnapshotsTestJSON-405609184 tempest-VolumesSnapshotsTestJSON-405609184-project] Calling method '.version_select at 0x7f14f736b950>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:14.946991 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-b90f78e9-e301-46f4-a4bc-748a1534d2a4 tempest-VolumesSnapshotsTestJSON-405609184 tempest-VolumesSnapshotsTestJSON-405609184-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/8f4d029d-e43a-4ed5-b0b8-c6d473339535" status: 202 len: 0 microversion: 2.1 time: 0.301045 Dec 16 14:55:14.956959 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 16/42] 10.222.0.45 () {58 vars in 1238 bytes} [Thu Dec 16 14:55:14 2021] DELETE /compute/v2.1/os-volumes/8f4d029d-e43a-4ed5-b0b8-c6d473339535 => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:55:14.967125 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-a5bca66f-617e-4279-ac79-c3a27c0a227e tempest-VolumesSnapshotsTestJSON-405609184 tempest-VolumesSnapshotsTestJSON-405609184-project] Calling method '.version_select at 0x7f14f73f07b8>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:15.110702 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-274cca0b-f202-4607-a99d-1bdae97e1734 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:15.111525 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-274cca0b-f202-4607-a99d-1bdae97e1734 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] [instance: 8a5137d8-24f6-4b78-abcb-2cf8d939df3e] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:55:15.162991 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-274cca0b-f202-4607-a99d-1bdae97e1734 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:15.166093 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-274cca0b-f202-4607-a99d-1bdae97e1734 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:15.166093 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-274cca0b-f202-4607-a99d-1bdae97e1734 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:15.166093 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-274cca0b-f202-4607-a99d-1bdae97e1734 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:15.496715 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.wsgi [None req-a5bca66f-617e-4279-ac79-c3a27c0a227e tempest-VolumesSnapshotsTestJSON-405609184 tempest-VolumesSnapshotsTestJSON-405609184-project] HTTP exception thrown: Volume 8f4d029d-e43a-4ed5-b0b8-c6d473339535 could not be found. Dec 16 14:55:15.497455 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-a5bca66f-617e-4279-ac79-c3a27c0a227e tempest-VolumesSnapshotsTestJSON-405609184 tempest-VolumesSnapshotsTestJSON-405609184-project] Returning 404 to user: Volume 8f4d029d-e43a-4ed5-b0b8-c6d473339535 could not be found. {{(pid=101356) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:941}} Dec 16 14:55:15.498530 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-a5bca66f-617e-4279-ac79-c3a27c0a227e tempest-VolumesSnapshotsTestJSON-405609184 tempest-VolumesSnapshotsTestJSON-405609184-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/8f4d029d-e43a-4ed5-b0b8-c6d473339535" status: 404 len: 109 microversion: 2.1 time: 0.544924 Dec 16 14:55:15.499231 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 27/43] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Dec 16 14:55:14 2021] GET /compute/v2.1/os-volumes/8f4d029d-e43a-4ed5-b0b8-c6d473339535 => generated 109 bytes in 547 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 14:55:15.522668 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-55ad4017-07f6-4023-b0ca-4310e60f89a6 tempest-VolumesSnapshotsTestJSON-405609184 tempest-VolumesSnapshotsTestJSON-405609184-project] Calling method '.version_select at 0x7f14f7c23d08>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:15.756849 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-274cca0b-f202-4607-a99d-1bdae97e1734 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7623b303ca8244b58179ef0146dd2bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8372f52bdbf443385cd0058e122fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:15.774006 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.wsgi [None req-55ad4017-07f6-4023-b0ca-4310e60f89a6 tempest-VolumesSnapshotsTestJSON-405609184 tempest-VolumesSnapshotsTestJSON-405609184-project] HTTP exception thrown: Volume 8f4d029d-e43a-4ed5-b0b8-c6d473339535 could not be found. Dec 16 14:55:15.774754 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-55ad4017-07f6-4023-b0ca-4310e60f89a6 tempest-VolumesSnapshotsTestJSON-405609184 tempest-VolumesSnapshotsTestJSON-405609184-project] Returning 404 to user: Volume 8f4d029d-e43a-4ed5-b0b8-c6d473339535 could not be found. {{(pid=101356) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:941}} Dec 16 14:55:15.775673 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-55ad4017-07f6-4023-b0ca-4310e60f89a6 tempest-VolumesSnapshotsTestJSON-405609184 tempest-VolumesSnapshotsTestJSON-405609184-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/8f4d029d-e43a-4ed5-b0b8-c6d473339535" status: 404 len: 109 microversion: 2.1 time: 0.263515 Dec 16 14:55:15.776624 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 28/44] 10.222.0.45 () {58 vars in 1238 bytes} [Thu Dec 16 14:55:15 2021] DELETE /compute/v2.1/os-volumes/8f4d029d-e43a-4ed5-b0b8-c6d473339535 => generated 109 bytes in 265 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 16 14:55:15.786411 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-274cca0b-f202-4607-a99d-1bdae97e1734 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] 10.222.0.45 "GET /compute/v2.1/servers/8a5137d8-24f6-4b78-abcb-2cf8d939df3e" status: 200 len: 1272 microversion: 2.1 time: 0.698784 Dec 16 14:55:15.787177 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 17/45] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:55:15 2021] GET /compute/v2.1/servers/8a5137d8-24f6-4b78-abcb-2cf8d939df3e => generated 1272 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:55:15.824774 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-64de5739-43a7-48a2-8734-bdf88240d6fe tempest-VolumesSnapshotsTestJSON-405609184 tempest-VolumesSnapshotsTestJSON-405609184-project] Calling method '.version_select at 0x7f14f736b048>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:15.959982 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.wsgi [None req-64de5739-43a7-48a2-8734-bdf88240d6fe tempest-VolumesSnapshotsTestJSON-405609184 tempest-VolumesSnapshotsTestJSON-405609184-project] HTTP exception thrown: Volume 8f4d029d-e43a-4ed5-b0b8-c6d473339535 could not be found. Dec 16 14:55:15.960640 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-64de5739-43a7-48a2-8734-bdf88240d6fe tempest-VolumesSnapshotsTestJSON-405609184 tempest-VolumesSnapshotsTestJSON-405609184-project] Returning 404 to user: Volume 8f4d029d-e43a-4ed5-b0b8-c6d473339535 could not be found. {{(pid=101355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:941}} Dec 16 14:55:15.961532 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-64de5739-43a7-48a2-8734-bdf88240d6fe tempest-VolumesSnapshotsTestJSON-405609184 tempest-VolumesSnapshotsTestJSON-405609184-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/8f4d029d-e43a-4ed5-b0b8-c6d473339535" status: 404 len: 109 microversion: 2.1 time: 0.153412 Dec 16 14:55:15.962124 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 18/46] 10.222.0.45 () {58 vars in 1235 bytes} [Thu Dec 16 14:55:15 2021] GET /compute/v2.1/os-volumes/8f4d029d-e43a-4ed5-b0b8-c6d473339535 => generated 109 bytes in 175 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 14:55:16.490426 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-17d81564-39b9-4dfe-93b0-cc875371f231 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-702874321", "imageRef": "9b00ff4e-db72-4324-820b-87a6bd73b055", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cfa2cabe-611e-4d60-ae11-c50e41390453"}]}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:55:16.819382 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-27dd274b-d2ec-424c-85aa-9b8d2e446bf6 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:16.820026 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-27dd274b-d2ec-424c-85aa-9b8d2e446bf6 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] [instance: 8a5137d8-24f6-4b78-abcb-2cf8d939df3e] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:55:16.846899 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-27dd274b-d2ec-424c-85aa-9b8d2e446bf6 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:16.847640 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-27dd274b-d2ec-424c-85aa-9b8d2e446bf6 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:16.848717 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-27dd274b-d2ec-424c-85aa-9b8d2e446bf6 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:16.850988 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-27dd274b-d2ec-424c-85aa-9b8d2e446bf6 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:16.915613 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.network.neutron [None req-17d81564-39b9-4dfe-93b0-cc875371f231 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] validate_networks() for [('cfa2cabe-611e-4d60-ae11-c50e41390453', None, None, None)] {{(pid=101356) validate_networks /opt/stack/nova/nova/network/neutron.py:2383}} Dec 16 14:55:17.262744 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-27dd274b-d2ec-424c-85aa-9b8d2e446bf6 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7623b303ca8244b58179ef0146dd2bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8372f52bdbf443385cd0058e122fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:17.293078 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-27dd274b-d2ec-424c-85aa-9b8d2e446bf6 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] 10.222.0.45 "GET /compute/v2.1/servers/8a5137d8-24f6-4b78-abcb-2cf8d939df3e" status: 200 len: 1272 microversion: 2.1 time: 0.482063 Dec 16 14:55:17.293681 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 19/47] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:55:16 2021] GET /compute/v2.1/servers/8a5137d8-24f6-4b78-abcb-2cf8d939df3e => generated 1272 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:55:18.314808 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-dc44fa69-e90d-4023-b180-24b71a581810 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:18.326674 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-dc44fa69-e90d-4023-b180-24b71a581810 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] [instance: 8a5137d8-24f6-4b78-abcb-2cf8d939df3e] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:55:18.336922 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-dc44fa69-e90d-4023-b180-24b71a581810 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:18.337884 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-dc44fa69-e90d-4023-b180-24b71a581810 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:18.355911 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-dc44fa69-e90d-4023-b180-24b71a581810 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:18.356562 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-dc44fa69-e90d-4023-b180-24b71a581810 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:19.325812 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-dc44fa69-e90d-4023-b180-24b71a581810 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7623b303ca8244b58179ef0146dd2bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8372f52bdbf443385cd0058e122fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:19.375467 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-dc44fa69-e90d-4023-b180-24b71a581810 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] 10.222.0.45 "GET /compute/v2.1/servers/8a5137d8-24f6-4b78-abcb-2cf8d939df3e" status: 200 len: 1314 microversion: 2.1 time: 1.069312 Dec 16 14:55:19.376057 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 20/48] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:55:18 2021] GET /compute/v2.1/servers/8a5137d8-24f6-4b78-abcb-2cf8d939df3e => generated 1314 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:55:20.398133 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-f9628ade-a5e6-4211-94b3-b1d90e7e42ad tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:20.400298 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-f9628ade-a5e6-4211-94b3-b1d90e7e42ad tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] [instance: 8a5137d8-24f6-4b78-abcb-2cf8d939df3e] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:55:20.414265 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f9628ade-a5e6-4211-94b3-b1d90e7e42ad tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:20.415446 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f9628ade-a5e6-4211-94b3-b1d90e7e42ad tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:20.430940 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f9628ade-a5e6-4211-94b3-b1d90e7e42ad tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:20.444066 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f9628ade-a5e6-4211-94b3-b1d90e7e42ad tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:20.940178 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-f9628ade-a5e6-4211-94b3-b1d90e7e42ad tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7623b303ca8244b58179ef0146dd2bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8372f52bdbf443385cd0058e122fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:20.951611 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-f9628ade-a5e6-4211-94b3-b1d90e7e42ad tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] 10.222.0.45 "GET /compute/v2.1/servers/8a5137d8-24f6-4b78-abcb-2cf8d939df3e" status: 200 len: 1314 microversion: 2.1 time: 0.562456 Dec 16 14:55:20.962510 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 21/49] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:55:20 2021] GET /compute/v2.1/servers/8a5137d8-24f6-4b78-abcb-2cf8d939df3e => generated 1314 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:55:22.562337 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-93507a45-5693-4767-8a68-fd75e87c20b5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'create', calling method: .version_select at 0x7f14f736b158>, body: {"keypair": {"name": "tempest-keypair-491906442"}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:55:22.586165 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.virt.hardware [None req-17d81564-39b9-4dfe-93b0-cc875371f231 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Flavor limits 0:0:0 {{(pid=101356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:338}} Dec 16 14:55:22.586645 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.virt.hardware [None req-17d81564-39b9-4dfe-93b0-cc875371f231 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Image limits 0:0:0 {{(pid=101356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:342}} Dec 16 14:55:22.587185 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.virt.hardware [None req-17d81564-39b9-4dfe-93b0-cc875371f231 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Flavor pref 0:0:0 {{(pid=101356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:378}} Dec 16 14:55:22.587640 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.virt.hardware [None req-17d81564-39b9-4dfe-93b0-cc875371f231 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Image pref 0:0:0 {{(pid=101356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:382}} Dec 16 14:55:22.588148 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.virt.hardware [None req-17d81564-39b9-4dfe-93b0-cc875371f231 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=101356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:422}} Dec 16 14:55:22.610218 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-17d81564-39b9-4dfe-93b0-cc875371f231 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:22.612118 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-17d81564-39b9-4dfe-93b0-cc875371f231 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:22.613774 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-17d81564-39b9-4dfe-93b0-cc875371f231 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:22.616089 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-17d81564-39b9-4dfe-93b0-cc875371f231 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:22.683766 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.quota [None req-17d81564-39b9-4dfe-93b0-cc875371f231 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Getting quotas for project 3a7679aab0dd4c2589d94c145df1f4b9. Resources: {'ram', 'instances', 'cores'} {{(pid=101356) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 16 14:55:22.712728 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.quota [None req-17d81564-39b9-4dfe-93b0-cc875371f231 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Getting quotas for user 2c77eab7702e4838812d02bac0d5db0a and project 3a7679aab0dd4c2589d94c145df1f4b9. Resources: {'ram', 'instances', 'cores'} {{(pid=101356) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 16 14:55:22.715835 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.quota [None req-93507a45-5693-4767-8a68-fd75e87c20b5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Getting quotas for project ff7a06ecc2404836b66f3a06d4f34d63. Resources: {'key_pairs'} {{(pid=101355) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 16 14:55:22.724836 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.quota [None req-93507a45-5693-4767-8a68-fd75e87c20b5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Getting quotas for user 7f435da8bee949fda856a880c75dfa46 and project ff7a06ecc2404836b66f3a06d4f34d63. Resources: {'key_pairs'} {{(pid=101355) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 16 14:55:22.744945 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-17d81564-39b9-4dfe-93b0-cc875371f231 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Going to run 1 instances... {{(pid=101356) _provision_instances /opt/stack/nova/nova/compute/api.py:1224}} Dec 16 14:55:22.750081 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-17d81564-39b9-4dfe-93b0-cc875371f231 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: 407dd6f1-6f0a-41ba-80e2-9ebe4630fa75] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9b00ff4e-db72-4324-820b-87a6bd73b055',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101356) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1616}} Dec 16 14:55:23.040872 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-17d81564-39b9-4dfe-93b0-cc875371f231 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 7.260772 Dec 16 14:55:23.041531 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 29/50] 10.222.0.45 () {60 vars in 1137 bytes} [Thu Dec 16 14:55:15 2021] POST /compute/v2.1/servers => generated 383 bytes in 7265 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 16 14:55:23.077542 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-1811dba7-7ce5-485f-854e-eca33b512eb5 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:23.078246 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-1811dba7-7ce5-485f-854e-eca33b512eb5 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] [instance: 8a5137d8-24f6-4b78-abcb-2cf8d939df3e] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:55:23.102963 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1811dba7-7ce5-485f-854e-eca33b512eb5 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:23.103715 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1811dba7-7ce5-485f-854e-eca33b512eb5 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:23.104804 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1811dba7-7ce5-485f-854e-eca33b512eb5 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:23.107017 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1811dba7-7ce5-485f-854e-eca33b512eb5 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:23.578650 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.quota [None req-93507a45-5693-4767-8a68-fd75e87c20b5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Getting quotas for project ff7a06ecc2404836b66f3a06d4f34d63. Resources: {'key_pairs'} {{(pid=101355) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 16 14:55:23.588643 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.quota [None req-93507a45-5693-4767-8a68-fd75e87c20b5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Getting quotas for user 7f435da8bee949fda856a880c75dfa46 and project ff7a06ecc2404836b66f3a06d4f34d63. Resources: {'key_pairs'} {{(pid=101355) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 16 14:55:23.655538 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-93507a45-5693-4767-8a68-fd75e87c20b5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 1.770957 Dec 16 14:55:23.657556 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 22/51] 10.222.0.45 () {62 vars in 1189 bytes} [Thu Dec 16 14:55:21 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 1778 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Dec 16 14:55:23.690514 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-2c51d69b-976f-4be5-a561-32dd59f1dd38 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:23.694116 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-2c51d69b-976f-4be5-a561-32dd59f1dd38 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: 407dd6f1-6f0a-41ba-80e2-9ebe4630fa75] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:55:24.413773 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-2c51d69b-976f-4be5-a561-32dd59f1dd38 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:24.459965 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-2c51d69b-976f-4be5-a561-32dd59f1dd38 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75" status: 200 len: 1221 microversion: 2.1 time: 0.799684 Dec 16 14:55:24.460593 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 23/52] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:55:23 2021] GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75 => generated 1221 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:55:24.851413 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-1811dba7-7ce5-485f-854e-eca33b512eb5 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7623b303ca8244b58179ef0146dd2bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8372f52bdbf443385cd0058e122fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:24.898452 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-1811dba7-7ce5-485f-854e-eca33b512eb5 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] 10.222.0.45 "GET /compute/v2.1/servers/8a5137d8-24f6-4b78-abcb-2cf8d939df3e" status: 200 len: 1314 microversion: 2.1 time: 1.844353 Dec 16 14:55:24.899304 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 30/53] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:55:23 2021] GET /compute/v2.1/servers/8a5137d8-24f6-4b78-abcb-2cf8d939df3e => generated 1314 bytes in 1857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:55:25.090253 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-5e003de4-ea86-4e09-ab38-3f9bfa1afac9 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1342113084", "imageRef": "9b00ff4e-db72-4324-820b-87a6bd73b055", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cfa2cabe-611e-4d60-ae11-c50e41390453"}]}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:55:25.350756 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.network.neutron [None req-5e003de4-ea86-4e09-ab38-3f9bfa1afac9 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] validate_networks() for [('cfa2cabe-611e-4d60-ae11-c50e41390453', None, None, None)] {{(pid=101355) validate_networks /opt/stack/nova/nova/network/neutron.py:2383}} Dec 16 14:55:25.921141 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-0220a282-5b5f-4ae6-bf14-5f7eafa446f8 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:25.921720 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-0220a282-5b5f-4ae6-bf14-5f7eafa446f8 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] [instance: 8a5137d8-24f6-4b78-abcb-2cf8d939df3e] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:55:25.943184 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0220a282-5b5f-4ae6-bf14-5f7eafa446f8 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:25.943829 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0220a282-5b5f-4ae6-bf14-5f7eafa446f8 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:25.944820 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0220a282-5b5f-4ae6-bf14-5f7eafa446f8 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:25.945452 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0220a282-5b5f-4ae6-bf14-5f7eafa446f8 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:27.578927 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.virt.hardware [None req-5e003de4-ea86-4e09-ab38-3f9bfa1afac9 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Flavor limits 0:0:0 {{(pid=101355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:338}} Dec 16 14:55:27.579516 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.virt.hardware [None req-5e003de4-ea86-4e09-ab38-3f9bfa1afac9 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Image limits 0:0:0 {{(pid=101355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:342}} Dec 16 14:55:27.580200 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.virt.hardware [None req-5e003de4-ea86-4e09-ab38-3f9bfa1afac9 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Flavor pref 0:0:0 {{(pid=101355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:378}} Dec 16 14:55:27.580774 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.virt.hardware [None req-5e003de4-ea86-4e09-ab38-3f9bfa1afac9 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Image pref 0:0:0 {{(pid=101355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:382}} Dec 16 14:55:27.581356 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.virt.hardware [None req-5e003de4-ea86-4e09-ab38-3f9bfa1afac9 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=101355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:422}} Dec 16 14:55:27.606525 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5e003de4-ea86-4e09-ab38-3f9bfa1afac9 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:27.606982 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5e003de4-ea86-4e09-ab38-3f9bfa1afac9 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:27.607850 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5e003de4-ea86-4e09-ab38-3f9bfa1afac9 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:27.608348 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5e003de4-ea86-4e09-ab38-3f9bfa1afac9 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:27.639585 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-0220a282-5b5f-4ae6-bf14-5f7eafa446f8 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7623b303ca8244b58179ef0146dd2bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8372f52bdbf443385cd0058e122fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:27.662705 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-0220a282-5b5f-4ae6-bf14-5f7eafa446f8 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] 10.222.0.45 "GET /compute/v2.1/servers/8a5137d8-24f6-4b78-abcb-2cf8d939df3e" status: 200 len: 1314 microversion: 2.1 time: 1.749608 Dec 16 14:55:27.663334 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 31/54] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:55:25 2021] GET /compute/v2.1/servers/8a5137d8-24f6-4b78-abcb-2cf8d939df3e => generated 1314 bytes in 1751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:55:27.700440 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.quota [None req-5e003de4-ea86-4e09-ab38-3f9bfa1afac9 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Getting quotas for project 3a7679aab0dd4c2589d94c145df1f4b9. Resources: {'ram', 'instances', 'cores'} {{(pid=101355) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 16 14:55:27.714775 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.quota [None req-5e003de4-ea86-4e09-ab38-3f9bfa1afac9 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Getting quotas for user 2c77eab7702e4838812d02bac0d5db0a and project 3a7679aab0dd4c2589d94c145df1f4b9. Resources: {'ram', 'instances', 'cores'} {{(pid=101355) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 16 14:55:27.739626 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-5e003de4-ea86-4e09-ab38-3f9bfa1afac9 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Going to run 1 instances... {{(pid=101355) _provision_instances /opt/stack/nova/nova/compute/api.py:1224}} Dec 16 14:55:27.742629 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-5e003de4-ea86-4e09-ab38-3f9bfa1afac9 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: bcaa83bc-5d07-413a-88e5-b7428a5b5d46] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9b00ff4e-db72-4324-820b-87a6bd73b055',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1616}} Dec 16 14:55:27.912499 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-5e003de4-ea86-4e09-ab38-3f9bfa1afac9 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.831583 Dec 16 14:55:27.913500 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 24/55] 10.222.0.45 () {60 vars in 1137 bytes} [Thu Dec 16 14:55:25 2021] POST /compute/v2.1/servers => generated 383 bytes in 2833 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 16 14:55:27.933305 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-529470ad-75eb-41d3-94b2-2c28eb6355bc tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:27.944773 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-529470ad-75eb-41d3-94b2-2c28eb6355bc tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: bcaa83bc-5d07-413a-88e5-b7428a5b5d46] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:55:28.281490 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-529470ad-75eb-41d3-94b2-2c28eb6355bc tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:28.308419 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-529470ad-75eb-41d3-94b2-2c28eb6355bc tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46" status: 200 len: 1222 microversion: 2.1 time: 0.387548 Dec 16 14:55:28.310191 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 32/56] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:55:27 2021] GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46 => generated 1222 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:55:28.762219 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-79cbcae5-a018-4ed2-ba21-9abcf59ca7b6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'create', calling method: .version_select at 0x7f14f74aa730>, body: {"keypair": {"name": "tempest-keypair-193235514"}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:55:28.810719 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.quota [None req-79cbcae5-a018-4ed2-ba21-9abcf59ca7b6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Getting quotas for project fe152d649f134d28bec6b87e62973916. Resources: {'key_pairs'} {{(pid=101355) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 16 14:55:28.817694 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.quota [None req-79cbcae5-a018-4ed2-ba21-9abcf59ca7b6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Getting quotas for user 8eb128a53e7f4e1187d0f6e2f4c4978f and project fe152d649f134d28bec6b87e62973916. Resources: {'key_pairs'} {{(pid=101355) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 16 14:55:28.912242 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [req-77d69081-88e6-4472-9234-9af7518e5824 req-fbb5e9cd-34e4-4366-930c-23bd92ba198e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a5137d8-24f6-4b78-abcb-2cf8d939df3e", "tag": "fe38e090-8b64-4c8e-9be5-fa79544d452c"}]} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:55:28.931968 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:55:28.931968 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: warnings.warn(msg) Dec 16 14:55:28.961123 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-77d69081-88e6-4472-9234-9af7518e5824 req-fbb5e9cd-34e4-4366-930c-23bd92ba198e service nova] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:28.961842 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-77d69081-88e6-4472-9234-9af7518e5824 req-fbb5e9cd-34e4-4366-930c-23bd92ba198e service nova] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:28.986593 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.compute.server_external_events [req-77d69081-88e6-4472-9234-9af7518e5824 req-fbb5e9cd-34e4-4366-930c-23bd92ba198e service nova] Creating event network-changed:fe38e090-8b64-4c8e-9be5-fa79544d452c for instance 8a5137d8-24f6-4b78-abcb-2cf8d939df3e on hv-cinder-82189 Dec 16 14:55:28.987457 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-77d69081-88e6-4472-9234-9af7518e5824 req-fbb5e9cd-34e4-4366-930c-23bd92ba198e service nova] Acquired lock "compute-rpcapi-router" {{(pid=101356) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:265}} Dec 16 14:55:28.989585 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9eae4632-39d8-4054-b6d4-bee027c42055 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:28.990300 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9eae4632-39d8-4054-b6d4-bee027c42055 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:28.991322 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9eae4632-39d8-4054-b6d4-bee027c42055 None None] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:28.991977 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9eae4632-39d8-4054-b6d4-bee027c42055 None None] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:29.014326 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.compute.rpcapi [None req-9eae4632-39d8-4054-b6d4-bee027c42055 None None] Automatically selected compute RPC version 5.11 from minimum service version 51 Dec 16 14:55:29.015308 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9eae4632-39d8-4054-b6d4-bee027c42055 None None] Releasing lock "compute-rpcapi-router" {{(pid=101356) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:281}} Dec 16 14:55:29.061156 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-9eae4632-39d8-4054-b6d4-bee027c42055 None None] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.483471 Dec 16 14:55:29.062145 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 33/57] 10.222.0.45 () {64 vars in 1308 bytes} [Thu Dec 16 14:55:28 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:55:29.071141 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-6ad5f945-1556-4699-940a-b7d1a8bd8a72 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:29.071895 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-6ad5f945-1556-4699-940a-b7d1a8bd8a72 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] [instance: 8a5137d8-24f6-4b78-abcb-2cf8d939df3e] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:55:29.092929 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6ad5f945-1556-4699-940a-b7d1a8bd8a72 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:29.093430 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6ad5f945-1556-4699-940a-b7d1a8bd8a72 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:29.094305 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6ad5f945-1556-4699-940a-b7d1a8bd8a72 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:29.094794 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6ad5f945-1556-4699-940a-b7d1a8bd8a72 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:29.535368 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.quota [None req-79cbcae5-a018-4ed2-ba21-9abcf59ca7b6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Getting quotas for project fe152d649f134d28bec6b87e62973916. Resources: {'key_pairs'} {{(pid=101355) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 16 14:55:29.552330 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.quota [None req-79cbcae5-a018-4ed2-ba21-9abcf59ca7b6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Getting quotas for user 8eb128a53e7f4e1187d0f6e2f4c4978f and project fe152d649f134d28bec6b87e62973916. Resources: {'key_pairs'} {{(pid=101355) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 16 14:55:29.568326 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-79cbcae5-a018-4ed2-ba21-9abcf59ca7b6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 1.309331 Dec 16 14:55:29.569204 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 25/58] 10.222.0.45 () {60 vars in 1148 bytes} [Thu Dec 16 14:55:28 2021] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:55:29.579528 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-ca0e8f55-0456-4f52-a5ab-60d3fe057947 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:29.580472 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-ca0e8f55-0456-4f52-a5ab-60d3fe057947 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: bcaa83bc-5d07-413a-88e5-b7428a5b5d46] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:55:29.604958 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ca0e8f55-0456-4f52-a5ab-60d3fe057947 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:29.610764 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ca0e8f55-0456-4f52-a5ab-60d3fe057947 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:29.611898 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ca0e8f55-0456-4f52-a5ab-60d3fe057947 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:29.612535 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ca0e8f55-0456-4f52-a5ab-60d3fe057947 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:29.632935 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-6ad5f945-1556-4699-940a-b7d1a8bd8a72 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7623b303ca8244b58179ef0146dd2bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8372f52bdbf443385cd0058e122fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:29.649336 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-6ad5f945-1556-4699-940a-b7d1a8bd8a72 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] 10.222.0.45 "GET /compute/v2.1/servers/8a5137d8-24f6-4b78-abcb-2cf8d939df3e" status: 200 len: 1314 microversion: 2.1 time: 0.585940 Dec 16 14:55:29.658021 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 34/59] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:55:29 2021] GET /compute/v2.1/servers/8a5137d8-24f6-4b78-abcb-2cf8d939df3e => generated 1314 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:55:29.865244 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-ca0e8f55-0456-4f52-a5ab-60d3fe057947 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:29.889207 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-ca0e8f55-0456-4f52-a5ab-60d3fe057947 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46" status: 200 len: 1226 microversion: 2.1 time: 0.315750 Dec 16 14:55:29.900045 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 26/60] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:55:29 2021] GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46 => generated 1226 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:55:30.344757 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-22f3fe4b-72c3-4309-bdf7-16d681cfd635 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-789475456", "imageRef": "9b00ff4e-db72-4324-820b-87a6bd73b055", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1ab48171-7751-49dd-8d19-babe4bef5701"}], "security_groups": [{"name": "tempest-securitygroup--594755578"}], "key_name": "tempest-keypair-491906442", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:55:30.681116 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-cabeb9c4-af4e-440b-aa7a-a39755b84dd1 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:30.685381 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-cabeb9c4-af4e-440b-aa7a-a39755b84dd1 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] [instance: 8a5137d8-24f6-4b78-abcb-2cf8d939df3e] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:55:30.703721 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cabeb9c4-af4e-440b-aa7a-a39755b84dd1 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:30.706658 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cabeb9c4-af4e-440b-aa7a-a39755b84dd1 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:30.708572 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cabeb9c4-af4e-440b-aa7a-a39755b84dd1 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:30.709838 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cabeb9c4-af4e-440b-aa7a-a39755b84dd1 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:30.739293 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.network.neutron [None req-22f3fe4b-72c3-4309-bdf7-16d681cfd635 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] validate_networks() for [('1ab48171-7751-49dd-8d19-babe4bef5701', None, None, None)] {{(pid=101356) validate_networks /opt/stack/nova/nova/network/neutron.py:2383}} Dec 16 14:55:31.035700 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-cabeb9c4-af4e-440b-aa7a-a39755b84dd1 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7623b303ca8244b58179ef0146dd2bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8372f52bdbf443385cd0058e122fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:31.055636 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-cabeb9c4-af4e-440b-aa7a-a39755b84dd1 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] 10.222.0.45 "GET /compute/v2.1/servers/8a5137d8-24f6-4b78-abcb-2cf8d939df3e" status: 200 len: 1314 microversion: 2.1 time: 0.383977 Dec 16 14:55:31.058549 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 27/61] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:55:30 2021] GET /compute/v2.1/servers/8a5137d8-24f6-4b78-abcb-2cf8d939df3e => generated 1314 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:55:31.082348 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-f518acad-0334-4e0a-9f6f-b5b0f2b9ad0a tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:31.083244 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-f518acad-0334-4e0a-9f6f-b5b0f2b9ad0a tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: bcaa83bc-5d07-413a-88e5-b7428a5b5d46] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:55:31.102720 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f518acad-0334-4e0a-9f6f-b5b0f2b9ad0a tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:31.107625 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f518acad-0334-4e0a-9f6f-b5b0f2b9ad0a tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:31.110379 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f518acad-0334-4e0a-9f6f-b5b0f2b9ad0a tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:31.113051 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f518acad-0334-4e0a-9f6f-b5b0f2b9ad0a tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:31.436339 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-f518acad-0334-4e0a-9f6f-b5b0f2b9ad0a tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:31.444951 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-f518acad-0334-4e0a-9f6f-b5b0f2b9ad0a tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46" status: 200 len: 1226 microversion: 2.1 time: 0.384979 Dec 16 14:55:31.445535 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 28/62] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:55:31 2021] GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46 => generated 1226 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:55:32.100353 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-b4b3d452-1f4f-4e73-86c3-f819b029433b tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:32.103666 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-b4b3d452-1f4f-4e73-86c3-f819b029433b tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] [instance: 8a5137d8-24f6-4b78-abcb-2cf8d939df3e] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:55:32.122902 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b4b3d452-1f4f-4e73-86c3-f819b029433b tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:32.147965 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b4b3d452-1f4f-4e73-86c3-f819b029433b tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:32.148909 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b4b3d452-1f4f-4e73-86c3-f819b029433b tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:32.149411 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b4b3d452-1f4f-4e73-86c3-f819b029433b tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:33.236760 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.virt.hardware [None req-22f3fe4b-72c3-4309-bdf7-16d681cfd635 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Flavor limits 0:0:0 {{(pid=101356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:338}} Dec 16 14:55:33.237231 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.virt.hardware [None req-22f3fe4b-72c3-4309-bdf7-16d681cfd635 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Image limits 0:0:0 {{(pid=101356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:342}} Dec 16 14:55:33.237734 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.virt.hardware [None req-22f3fe4b-72c3-4309-bdf7-16d681cfd635 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Flavor pref 0:0:0 {{(pid=101356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:378}} Dec 16 14:55:33.238253 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.virt.hardware [None req-22f3fe4b-72c3-4309-bdf7-16d681cfd635 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Image pref 0:0:0 {{(pid=101356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:382}} Dec 16 14:55:33.244181 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.virt.hardware [None req-22f3fe4b-72c3-4309-bdf7-16d681cfd635 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=101356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:422}} Dec 16 14:55:33.260548 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-22f3fe4b-72c3-4309-bdf7-16d681cfd635 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:33.261059 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-22f3fe4b-72c3-4309-bdf7-16d681cfd635 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:33.261941 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-22f3fe4b-72c3-4309-bdf7-16d681cfd635 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:33.262433 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-22f3fe4b-72c3-4309-bdf7-16d681cfd635 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:33.309552 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.quota [None req-22f3fe4b-72c3-4309-bdf7-16d681cfd635 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Getting quotas for project ff7a06ecc2404836b66f3a06d4f34d63. Resources: {'ram', 'instances', 'cores'} {{(pid=101356) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 16 14:55:33.314529 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.quota [None req-22f3fe4b-72c3-4309-bdf7-16d681cfd635 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Getting quotas for user 7f435da8bee949fda856a880c75dfa46 and project ff7a06ecc2404836b66f3a06d4f34d63. Resources: {'ram', 'instances', 'cores'} {{(pid=101356) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 16 14:55:33.329576 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-22f3fe4b-72c3-4309-bdf7-16d681cfd635 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Going to run 1 instances... {{(pid=101356) _provision_instances /opt/stack/nova/nova/compute/api.py:1224}} Dec 16 14:55:33.332476 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-22f3fe4b-72c3-4309-bdf7-16d681cfd635 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9b00ff4e-db72-4324-820b-87a6bd73b055',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101356) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1616}} Dec 16 14:55:33.365762 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-b4b3d452-1f4f-4e73-86c3-f819b029433b tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7623b303ca8244b58179ef0146dd2bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8372f52bdbf443385cd0058e122fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:33.377931 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-b4b3d452-1f4f-4e73-86c3-f819b029433b tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] 10.222.0.45 "GET /compute/v2.1/servers/8a5137d8-24f6-4b78-abcb-2cf8d939df3e" status: 200 len: 1314 microversion: 2.1 time: 1.303505 Dec 16 14:55:33.388506 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 29/63] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:55:32 2021] GET /compute/v2.1/servers/8a5137d8-24f6-4b78-abcb-2cf8d939df3e => generated 1314 bytes in 1315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:55:33.399725 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-bf4dc2f9-b225-4153-b372-4cc156a80800 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:33.400607 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-bf4dc2f9-b225-4153-b372-4cc156a80800 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: bcaa83bc-5d07-413a-88e5-b7428a5b5d46] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:55:33.409768 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-bf4dc2f9-b225-4153-b372-4cc156a80800 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:33.410583 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-bf4dc2f9-b225-4153-b372-4cc156a80800 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:33.411664 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-bf4dc2f9-b225-4153-b372-4cc156a80800 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:33.412351 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-bf4dc2f9-b225-4153-b372-4cc156a80800 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:33.420127 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-22f3fe4b-72c3-4309-bdf7-16d681cfd635 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 3.085583 Dec 16 14:55:33.425717 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 35/64] 10.222.0.45 () {62 vars in 1178 bytes} [Thu Dec 16 14:55:30 2021] POST /compute/v2.1/servers => generated 401 bytes in 3092 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Dec 16 14:55:33.447695 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-e16918ed-68d8-4042-9b5f-c15ac99b9002 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:33.448385 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-e16918ed-68d8-4042-9b5f-c15ac99b9002 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:55:33.836170 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-bf4dc2f9-b225-4153-b372-4cc156a80800 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:33.852443 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-bf4dc2f9-b225-4153-b372-4cc156a80800 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46" status: 200 len: 1226 microversion: 2.1 time: 0.462333 Dec 16 14:55:33.852989 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 30/65] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:55:33 2021] GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46 => generated 1226 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:55:34.022313 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-e16918ed-68d8-4042-9b5f-c15ac99b9002 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:34.055175 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-e16918ed-68d8-4042-9b5f-c15ac99b9002 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:34.060888 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-e16918ed-68d8-4042-9b5f-c15ac99b9002 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:34.062539 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-e16918ed-68d8-4042-9b5f-c15ac99b9002 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1280 microversion: 2.20 time: 0.627579 Dec 16 14:55:34.079442 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 36/66] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 14:55:33 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1280 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:55:34.400061 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-4bf5ea32-8b07-4cac-b16a-938afb56106e tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:34.400737 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-4bf5ea32-8b07-4cac-b16a-938afb56106e tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] [instance: 8a5137d8-24f6-4b78-abcb-2cf8d939df3e] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:55:34.437887 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4bf5ea32-8b07-4cac-b16a-938afb56106e tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:34.438460 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4bf5ea32-8b07-4cac-b16a-938afb56106e tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:34.439351 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4bf5ea32-8b07-4cac-b16a-938afb56106e tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:34.440098 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4bf5ea32-8b07-4cac-b16a-938afb56106e tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:34.878535 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-655acfc5-c3e9-4adc-96a6-f08f41922b25 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:34.886247 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-655acfc5-c3e9-4adc-96a6-f08f41922b25 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: bcaa83bc-5d07-413a-88e5-b7428a5b5d46] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:55:34.909756 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-655acfc5-c3e9-4adc-96a6-f08f41922b25 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:34.915606 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-655acfc5-c3e9-4adc-96a6-f08f41922b25 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:34.918828 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-655acfc5-c3e9-4adc-96a6-f08f41922b25 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:34.920648 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-655acfc5-c3e9-4adc-96a6-f08f41922b25 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:35.747034 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-655acfc5-c3e9-4adc-96a6-f08f41922b25 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:35.809180 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-655acfc5-c3e9-4adc-96a6-f08f41922b25 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46" status: 200 len: 1274 microversion: 2.1 time: 0.936651 Dec 16 14:55:35.811318 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 37/67] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:55:34 2021] GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46 => generated 1274 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:55:35.853492 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-54dff66b-e12b-423e-81ee-30a4adcd8100 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:35.854257 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-54dff66b-e12b-423e-81ee-30a4adcd8100 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:55:35.902639 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-54dff66b-e12b-423e-81ee-30a4adcd8100 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:35.907748 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-54dff66b-e12b-423e-81ee-30a4adcd8100 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:35.909975 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-54dff66b-e12b-423e-81ee-30a4adcd8100 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:35.912611 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-54dff66b-e12b-423e-81ee-30a4adcd8100 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:36.097485 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-4bf5ea32-8b07-4cac-b16a-938afb56106e tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7623b303ca8244b58179ef0146dd2bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8372f52bdbf443385cd0058e122fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:36.127141 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-4bf5ea32-8b07-4cac-b16a-938afb56106e tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] 10.222.0.45 "GET /compute/v2.1/servers/8a5137d8-24f6-4b78-abcb-2cf8d939df3e" status: 200 len: 1314 microversion: 2.1 time: 1.734930 Dec 16 14:55:36.136145 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 31/68] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:55:34 2021] GET /compute/v2.1/servers/8a5137d8-24f6-4b78-abcb-2cf8d939df3e => generated 1314 bytes in 1744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:55:36.212559 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-54dff66b-e12b-423e-81ee-30a4adcd8100 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:36.252764 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-54dff66b-e12b-423e-81ee-30a4adcd8100 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:36.269941 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-54dff66b-e12b-423e-81ee-30a4adcd8100 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:36.275542 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-54dff66b-e12b-423e-81ee-30a4adcd8100 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1276 microversion: 2.20 time: 0.463088 Dec 16 14:55:36.277813 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 38/69] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 14:55:35 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1276 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:55:36.832537 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-9f948de0-34db-4712-b0d7-a8c1d834a6af tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:36.834417 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-9f948de0-34db-4712-b0d7-a8c1d834a6af tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: bcaa83bc-5d07-413a-88e5-b7428a5b5d46] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:55:36.845801 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9f948de0-34db-4712-b0d7-a8c1d834a6af tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:36.846554 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9f948de0-34db-4712-b0d7-a8c1d834a6af tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:36.847986 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9f948de0-34db-4712-b0d7-a8c1d834a6af tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:36.848762 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9f948de0-34db-4712-b0d7-a8c1d834a6af tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:37.155714 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-6eddde9d-499d-4501-a8e8-83765e26c6fd tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:37.156670 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-6eddde9d-499d-4501-a8e8-83765e26c6fd tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] [instance: 8a5137d8-24f6-4b78-abcb-2cf8d939df3e] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:55:37.176491 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6eddde9d-499d-4501-a8e8-83765e26c6fd tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:37.177504 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6eddde9d-499d-4501-a8e8-83765e26c6fd tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:37.179537 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6eddde9d-499d-4501-a8e8-83765e26c6fd tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:37.180392 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6eddde9d-499d-4501-a8e8-83765e26c6fd tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:37.355705 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-9f948de0-34db-4712-b0d7-a8c1d834a6af tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:37.369666 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-9f948de0-34db-4712-b0d7-a8c1d834a6af tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46" status: 200 len: 1282 microversion: 2.1 time: 0.544901 Dec 16 14:55:37.375658 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 32/70] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:55:36 2021] GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46 => generated 1282 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:55:37.410967 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-ce958e24-0cc7-4d99-85ca-5e15b730fbb7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:37.411746 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-ce958e24-0cc7-4d99-85ca-5e15b730fbb7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:55:37.440464 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ce958e24-0cc7-4d99-85ca-5e15b730fbb7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:37.441990 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ce958e24-0cc7-4d99-85ca-5e15b730fbb7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:37.443006 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ce958e24-0cc7-4d99-85ca-5e15b730fbb7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:37.446863 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ce958e24-0cc7-4d99-85ca-5e15b730fbb7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:37.660734 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-ce958e24-0cc7-4d99-85ca-5e15b730fbb7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:37.677050 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-ce958e24-0cc7-4d99-85ca-5e15b730fbb7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:37.682469 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-ce958e24-0cc7-4d99-85ca-5e15b730fbb7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:37.684015 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-ce958e24-0cc7-4d99-85ca-5e15b730fbb7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1340 microversion: 2.20 time: 0.297394 Dec 16 14:55:37.684785 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 33/71] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 14:55:37 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1340 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:55:37.695084 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-d8b8c7cc-788b-42a1-ab1b-ae0b200a76cf tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1515833165", "imageRef": "9b00ff4e-db72-4324-820b-87a6bd73b055", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "22640b1c-4c47-4c71-9861-b248ec975b5d"}], "security_groups": [{"name": "tempest-securitygroup--1426580430"}], "key_name": "tempest-keypair-193235514", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:55:37.861522 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-6eddde9d-499d-4501-a8e8-83765e26c6fd tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7623b303ca8244b58179ef0146dd2bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8372f52bdbf443385cd0058e122fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:37.869569 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-6eddde9d-499d-4501-a8e8-83765e26c6fd tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] 10.222.0.45 "GET /compute/v2.1/servers/8a5137d8-24f6-4b78-abcb-2cf8d939df3e" status: 200 len: 1314 microversion: 2.1 time: 0.723384 Dec 16 14:55:37.870399 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 39/72] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:55:37 2021] GET /compute/v2.1/servers/8a5137d8-24f6-4b78-abcb-2cf8d939df3e => generated 1314 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:55:37.946633 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.network.neutron [None req-d8b8c7cc-788b-42a1-ab1b-ae0b200a76cf tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] validate_networks() for [('22640b1c-4c47-4c71-9861-b248ec975b5d', None, None, None)] {{(pid=101355) validate_networks /opt/stack/nova/nova/network/neutron.py:2383}} Dec 16 14:55:38.396850 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-b2d36456-25b9-4c84-bc47-c31b39f768b1 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:38.397789 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-b2d36456-25b9-4c84-bc47-c31b39f768b1 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: bcaa83bc-5d07-413a-88e5-b7428a5b5d46] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:55:38.410464 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b2d36456-25b9-4c84-bc47-c31b39f768b1 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:38.411383 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b2d36456-25b9-4c84-bc47-c31b39f768b1 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:38.412223 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b2d36456-25b9-4c84-bc47-c31b39f768b1 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:38.419068 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b2d36456-25b9-4c84-bc47-c31b39f768b1 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:38.690453 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.virt.hardware [None req-d8b8c7cc-788b-42a1-ab1b-ae0b200a76cf tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Flavor limits 0:0:0 {{(pid=101355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:338}} Dec 16 14:55:38.690927 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.virt.hardware [None req-d8b8c7cc-788b-42a1-ab1b-ae0b200a76cf tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Image limits 0:0:0 {{(pid=101355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:342}} Dec 16 14:55:38.691471 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.virt.hardware [None req-d8b8c7cc-788b-42a1-ab1b-ae0b200a76cf tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Flavor pref 0:0:0 {{(pid=101355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:378}} Dec 16 14:55:38.692009 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.virt.hardware [None req-d8b8c7cc-788b-42a1-ab1b-ae0b200a76cf tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Image pref 0:0:0 {{(pid=101355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:382}} Dec 16 14:55:38.692471 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.virt.hardware [None req-d8b8c7cc-788b-42a1-ab1b-ae0b200a76cf tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=101355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:422}} Dec 16 14:55:38.701293 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d8b8c7cc-788b-42a1-ab1b-ae0b200a76cf tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:38.701802 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d8b8c7cc-788b-42a1-ab1b-ae0b200a76cf tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:38.702743 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d8b8c7cc-788b-42a1-ab1b-ae0b200a76cf tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:38.703239 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d8b8c7cc-788b-42a1-ab1b-ae0b200a76cf tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:38.722463 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.quota [None req-d8b8c7cc-788b-42a1-ab1b-ae0b200a76cf tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Getting quotas for project fe152d649f134d28bec6b87e62973916. Resources: {'ram', 'instances', 'cores'} {{(pid=101355) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 16 14:55:38.726501 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.quota [None req-d8b8c7cc-788b-42a1-ab1b-ae0b200a76cf tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Getting quotas for user 8eb128a53e7f4e1187d0f6e2f4c4978f and project fe152d649f134d28bec6b87e62973916. Resources: {'ram', 'instances', 'cores'} {{(pid=101355) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 16 14:55:38.738241 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-d8b8c7cc-788b-42a1-ab1b-ae0b200a76cf tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Going to run 1 instances... {{(pid=101355) _provision_instances /opt/stack/nova/nova/compute/api.py:1224}} Dec 16 14:55:38.740680 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-d8b8c7cc-788b-42a1-ab1b-ae0b200a76cf tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9b00ff4e-db72-4324-820b-87a6bd73b055',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1616}} Dec 16 14:55:39.275953 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-b2d36456-25b9-4c84-bc47-c31b39f768b1 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:39.292455 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-b2d36456-25b9-4c84-bc47-c31b39f768b1 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46" status: 200 len: 1280 microversion: 2.1 time: 0.903297 Dec 16 14:55:39.297242 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 40/73] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:55:38 2021] GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46 => generated 1280 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:55:39.319778 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-d8b8c7cc-788b-42a1-ab1b-ae0b200a76cf tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.633604 Dec 16 14:55:39.327181 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 34/74] 10.222.0.45 () {60 vars in 1137 bytes} [Thu Dec 16 14:55:37 2021] POST /compute/v2.1/servers => generated 402 bytes in 1637 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 16 14:55:39.334848 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-3caaad1c-53f7-43fe-9545-c11d52fb5b31 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:39.343255 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-3caaad1c-53f7-43fe-9545-c11d52fb5b31 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] [instance: 8a5137d8-24f6-4b78-abcb-2cf8d939df3e] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:55:39.343407 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-5f630236-6217-4542-9b47-21a9b1305fc6 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:39.343407 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-5f630236-6217-4542-9b47-21a9b1305fc6 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:55:39.355413 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5f630236-6217-4542-9b47-21a9b1305fc6 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:39.355918 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5f630236-6217-4542-9b47-21a9b1305fc6 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:39.356916 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5f630236-6217-4542-9b47-21a9b1305fc6 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:39.357407 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5f630236-6217-4542-9b47-21a9b1305fc6 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:39.383691 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3caaad1c-53f7-43fe-9545-c11d52fb5b31 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:39.384198 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3caaad1c-53f7-43fe-9545-c11d52fb5b31 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:39.385043 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3caaad1c-53f7-43fe-9545-c11d52fb5b31 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:39.386251 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3caaad1c-53f7-43fe-9545-c11d52fb5b31 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:39.592783 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-5f630236-6217-4542-9b47-21a9b1305fc6 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:39.621643 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-5f630236-6217-4542-9b47-21a9b1305fc6 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:39.637954 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-5f630236-6217-4542-9b47-21a9b1305fc6 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:39.651365 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-5f630236-6217-4542-9b47-21a9b1305fc6 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1340 microversion: 2.20 time: 0.345823 Dec 16 14:55:39.651365 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 41/75] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 14:55:39 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1340 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:55:39.657900 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-684ca47c-fde3-41ce-94b2-7c7fc047c7cc tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:39.658506 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-684ca47c-fde3-41ce-94b2-7c7fc047c7cc tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:55:39.770000 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-3caaad1c-53f7-43fe-9545-c11d52fb5b31 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7623b303ca8244b58179ef0146dd2bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8372f52bdbf443385cd0058e122fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:39.789664 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-3caaad1c-53f7-43fe-9545-c11d52fb5b31 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] 10.222.0.45 "GET /compute/v2.1/servers/8a5137d8-24f6-4b78-abcb-2cf8d939df3e" status: 200 len: 1314 microversion: 2.1 time: 0.454298 Dec 16 14:55:39.789664 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 35/76] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:55:39 2021] GET /compute/v2.1/servers/8a5137d8-24f6-4b78-abcb-2cf8d939df3e => generated 1314 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:55:39.829907 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-684ca47c-fde3-41ce-94b2-7c7fc047c7cc tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:39.847300 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-684ca47c-fde3-41ce-94b2-7c7fc047c7cc tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14" status: 200 len: 1237 microversion: 2.1 time: 0.201844 Dec 16 14:55:39.847922 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 42/77] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:55:39 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14 => generated 1237 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:55:40.317285 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-a40d3a83-d4fb-4c89-8abc-6626d9096a02 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:40.318504 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-a40d3a83-d4fb-4c89-8abc-6626d9096a02 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: bcaa83bc-5d07-413a-88e5-b7428a5b5d46] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:55:40.326943 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a40d3a83-d4fb-4c89-8abc-6626d9096a02 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:40.327527 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a40d3a83-d4fb-4c89-8abc-6626d9096a02 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:40.328442 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a40d3a83-d4fb-4c89-8abc-6626d9096a02 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:40.329054 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a40d3a83-d4fb-4c89-8abc-6626d9096a02 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:40.514287 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-a40d3a83-d4fb-4c89-8abc-6626d9096a02 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:40.523563 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-a40d3a83-d4fb-4c89-8abc-6626d9096a02 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46" status: 200 len: 1280 microversion: 2.1 time: 0.216919 Dec 16 14:55:40.524124 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 36/78] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:55:40 2021] GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46 => generated 1280 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:55:40.673319 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-a271c4ec-907f-43b1-afee-f29f6699656c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:40.673978 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-a271c4ec-907f-43b1-afee-f29f6699656c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:55:40.681736 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a271c4ec-907f-43b1-afee-f29f6699656c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:40.682624 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a271c4ec-907f-43b1-afee-f29f6699656c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:40.683907 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a271c4ec-907f-43b1-afee-f29f6699656c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:40.684603 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a271c4ec-907f-43b1-afee-f29f6699656c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:40.808978 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-7f4b6995-86ae-49f5-ba69-cbba9ae14ced tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:40.809877 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-7f4b6995-86ae-49f5-ba69-cbba9ae14ced tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] [instance: 8a5137d8-24f6-4b78-abcb-2cf8d939df3e] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:55:40.819080 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7f4b6995-86ae-49f5-ba69-cbba9ae14ced tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:40.820146 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7f4b6995-86ae-49f5-ba69-cbba9ae14ced tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:40.821265 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7f4b6995-86ae-49f5-ba69-cbba9ae14ced tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:40.821950 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7f4b6995-86ae-49f5-ba69-cbba9ae14ced tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:40.867004 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-a271c4ec-907f-43b1-afee-f29f6699656c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:40.888084 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-a271c4ec-907f-43b1-afee-f29f6699656c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:40.894287 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-a271c4ec-907f-43b1-afee-f29f6699656c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:40.895816 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-a271c4ec-907f-43b1-afee-f29f6699656c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1340 microversion: 2.20 time: 0.230856 Dec 16 14:55:40.896600 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 43/79] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 14:55:40 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1340 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:55:40.906648 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-a48db757-b91b-4dad-87d6-924283b602b5 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:40.907509 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-a48db757-b91b-4dad-87d6-924283b602b5 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:55:40.916954 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a48db757-b91b-4dad-87d6-924283b602b5 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:40.917463 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a48db757-b91b-4dad-87d6-924283b602b5 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:40.918347 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a48db757-b91b-4dad-87d6-924283b602b5 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:40.918840 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a48db757-b91b-4dad-87d6-924283b602b5 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:41.059865 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-a48db757-b91b-4dad-87d6-924283b602b5 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:41.063874 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-7f4b6995-86ae-49f5-ba69-cbba9ae14ced tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7623b303ca8244b58179ef0146dd2bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8372f52bdbf443385cd0058e122fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:41.068857 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-a48db757-b91b-4dad-87d6-924283b602b5 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14" status: 200 len: 1241 microversion: 2.1 time: 0.170690 Dec 16 14:55:41.069445 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 44/80] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:55:40 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14 => generated 1241 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:55:41.075600 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-7f4b6995-86ae-49f5-ba69-cbba9ae14ced tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] 10.222.0.45 "GET /compute/v2.1/servers/8a5137d8-24f6-4b78-abcb-2cf8d939df3e" status: 200 len: 1314 microversion: 2.1 time: 0.275317 Dec 16 14:55:41.076320 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 37/81] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:55:40 2021] GET /compute/v2.1/servers/8a5137d8-24f6-4b78-abcb-2cf8d939df3e => generated 1314 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:55:41.545817 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-f6e44d15-b46c-4536-ac85-7b1283e4951e tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:41.547134 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-f6e44d15-b46c-4536-ac85-7b1283e4951e tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: bcaa83bc-5d07-413a-88e5-b7428a5b5d46] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:55:41.555450 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f6e44d15-b46c-4536-ac85-7b1283e4951e tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:41.556197 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f6e44d15-b46c-4536-ac85-7b1283e4951e tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:41.557867 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f6e44d15-b46c-4536-ac85-7b1283e4951e tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:41.558603 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f6e44d15-b46c-4536-ac85-7b1283e4951e tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:41.740552 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-f6e44d15-b46c-4536-ac85-7b1283e4951e tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:41.750066 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-f6e44d15-b46c-4536-ac85-7b1283e4951e tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46" status: 200 len: 1280 microversion: 2.1 time: 0.213099 Dec 16 14:55:41.772277 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 45/82] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:55:41 2021] GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46 => generated 1280 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:55:41.921751 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-8542fa5f-c167-4895-bf76-a6655cd47df3 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:41.923239 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-8542fa5f-c167-4895-bf76-a6655cd47df3 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:55:41.933117 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8542fa5f-c167-4895-bf76-a6655cd47df3 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:41.933626 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8542fa5f-c167-4895-bf76-a6655cd47df3 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:41.934515 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8542fa5f-c167-4895-bf76-a6655cd47df3 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:41.935014 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8542fa5f-c167-4895-bf76-a6655cd47df3 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:42.092693 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-e6f0037c-2d13-441c-9754-70cb4cec1a94 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:42.093665 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-e6f0037c-2d13-441c-9754-70cb4cec1a94 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:55:42.103561 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e6f0037c-2d13-441c-9754-70cb4cec1a94 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:42.104982 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e6f0037c-2d13-441c-9754-70cb4cec1a94 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:42.120205 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e6f0037c-2d13-441c-9754-70cb4cec1a94 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:42.126534 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e6f0037c-2d13-441c-9754-70cb4cec1a94 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:42.323724 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-e6f0037c-2d13-441c-9754-70cb4cec1a94 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:42.336253 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-e6f0037c-2d13-441c-9754-70cb4cec1a94 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14" status: 200 len: 1233 microversion: 2.1 time: 0.253089 Dec 16 14:55:42.336956 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 46/83] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:55:42 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14 => generated 1233 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:55:42.356757 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-878fd9db-fb1a-4f41-b271-3112bd08ec52 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:42.357428 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-878fd9db-fb1a-4f41-b271-3112bd08ec52 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] [instance: 8a5137d8-24f6-4b78-abcb-2cf8d939df3e] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:55:42.365705 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-878fd9db-fb1a-4f41-b271-3112bd08ec52 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:42.367827 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-878fd9db-fb1a-4f41-b271-3112bd08ec52 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:42.378584 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-878fd9db-fb1a-4f41-b271-3112bd08ec52 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:42.378584 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-878fd9db-fb1a-4f41-b271-3112bd08ec52 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:42.398457 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-8542fa5f-c167-4895-bf76-a6655cd47df3 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:42.417558 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-8542fa5f-c167-4895-bf76-a6655cd47df3 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:42.431610 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-8542fa5f-c167-4895-bf76-a6655cd47df3 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:42.438830 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-8542fa5f-c167-4895-bf76-a6655cd47df3 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1338 microversion: 2.20 time: 0.527137 Dec 16 14:55:42.439649 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 38/84] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 14:55:41 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1338 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 14:55:42.772636 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-495f137b-8f98-436d-a4cf-8f6c4897539e tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:42.773281 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-495f137b-8f98-436d-a4cf-8f6c4897539e tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: bcaa83bc-5d07-413a-88e5-b7428a5b5d46] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:55:42.797423 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-495f137b-8f98-436d-a4cf-8f6c4897539e tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:42.804620 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-495f137b-8f98-436d-a4cf-8f6c4897539e tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:42.809215 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-495f137b-8f98-436d-a4cf-8f6c4897539e tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:42.809834 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-495f137b-8f98-436d-a4cf-8f6c4897539e tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:43.125786 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-878fd9db-fb1a-4f41-b271-3112bd08ec52 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7623b303ca8244b58179ef0146dd2bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8372f52bdbf443385cd0058e122fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:43.152463 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-878fd9db-fb1a-4f41-b271-3112bd08ec52 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] 10.222.0.45 "GET /compute/v2.1/servers/8a5137d8-24f6-4b78-abcb-2cf8d939df3e" status: 200 len: 1314 microversion: 2.1 time: 0.803323 Dec 16 14:55:43.153079 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 47/85] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:55:42 2021] GET /compute/v2.1/servers/8a5137d8-24f6-4b78-abcb-2cf8d939df3e => generated 1314 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:55:43.362590 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-1b5360b6-94f5-4b7c-b63c-96e49f73d3df tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:43.363593 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-1b5360b6-94f5-4b7c-b63c-96e49f73d3df tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:55:43.377769 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-495f137b-8f98-436d-a4cf-8f6c4897539e tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:43.381857 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1b5360b6-94f5-4b7c-b63c-96e49f73d3df tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:43.382633 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1b5360b6-94f5-4b7c-b63c-96e49f73d3df tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:43.383690 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1b5360b6-94f5-4b7c-b63c-96e49f73d3df tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:43.384380 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1b5360b6-94f5-4b7c-b63c-96e49f73d3df tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:43.403194 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-495f137b-8f98-436d-a4cf-8f6c4897539e tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46" status: 200 len: 1280 microversion: 2.1 time: 0.636585 Dec 16 14:55:43.403779 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 39/86] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:55:42 2021] GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46 => generated 1280 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:55:43.467244 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-cea4380b-e393-4c92-a0ae-31e9d3b4047b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:43.468470 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-cea4380b-e393-4c92-a0ae-31e9d3b4047b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:55:43.480162 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cea4380b-e393-4c92-a0ae-31e9d3b4047b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:43.480899 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cea4380b-e393-4c92-a0ae-31e9d3b4047b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:43.481898 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cea4380b-e393-4c92-a0ae-31e9d3b4047b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:43.482766 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cea4380b-e393-4c92-a0ae-31e9d3b4047b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:43.618338 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-1b5360b6-94f5-4b7c-b63c-96e49f73d3df tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:43.636938 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-1b5360b6-94f5-4b7c-b63c-96e49f73d3df tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14" status: 200 len: 1289 microversion: 2.1 time: 0.283211 Dec 16 14:55:43.637689 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 48/87] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:55:43 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14 => generated 1289 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:55:43.717804 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-cea4380b-e393-4c92-a0ae-31e9d3b4047b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:43.739736 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-cea4380b-e393-4c92-a0ae-31e9d3b4047b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:43.753207 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-cea4380b-e393-4c92-a0ae-31e9d3b4047b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:43.755073 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-cea4380b-e393-4c92-a0ae-31e9d3b4047b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1338 microversion: 2.20 time: 0.299279 Dec 16 14:55:43.756636 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 40/88] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 14:55:43 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1338 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:55:43.820324 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [req-2715acd6-aa8e-4279-9447-5eae97761ab1 req-b43cbedb-1d28-4f1c-b0d4-ac98aaf9eab3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "407dd6f1-6f0a-41ba-80e2-9ebe4630fa75", "tag": "5e762ff6-a901-4d0e-aaba-533a8b07ea32"}]} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:55:43.829035 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:55:43.829035 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: warnings.warn(msg) Dec 16 14:55:43.840285 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-2715acd6-aa8e-4279-9447-5eae97761ab1 req-b43cbedb-1d28-4f1c-b0d4-ac98aaf9eab3 service nova] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:43.842933 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-2715acd6-aa8e-4279-9447-5eae97761ab1 req-b43cbedb-1d28-4f1c-b0d4-ac98aaf9eab3 service nova] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:43.863982 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.compute.server_external_events [req-2715acd6-aa8e-4279-9447-5eae97761ab1 req-b43cbedb-1d28-4f1c-b0d4-ac98aaf9eab3 service nova] Creating event network-changed:5e762ff6-a901-4d0e-aaba-533a8b07ea32 for instance 407dd6f1-6f0a-41ba-80e2-9ebe4630fa75 on hv-cinder-82189 Dec 16 14:55:43.870855 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [req-2715acd6-aa8e-4279-9447-5eae97761ab1 req-b43cbedb-1d28-4f1c-b0d4-ac98aaf9eab3 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058474 Dec 16 14:55:43.874607 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 49/89] 10.222.0.45 () {64 vars in 1308 bytes} [Thu Dec 16 14:55:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:55:44.186295 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-7f62e68a-6c9f-4632-a08d-68032cf59107 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:44.187356 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-7f62e68a-6c9f-4632-a08d-68032cf59107 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] [instance: 8a5137d8-24f6-4b78-abcb-2cf8d939df3e] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:55:44.197356 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7f62e68a-6c9f-4632-a08d-68032cf59107 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:44.198865 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7f62e68a-6c9f-4632-a08d-68032cf59107 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:44.200407 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7f62e68a-6c9f-4632-a08d-68032cf59107 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:44.201046 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7f62e68a-6c9f-4632-a08d-68032cf59107 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:44.428671 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-6405ad68-f79f-4767-bd85-1c6ad404a60a tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:44.429471 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-6405ad68-f79f-4767-bd85-1c6ad404a60a tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: bcaa83bc-5d07-413a-88e5-b7428a5b5d46] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:55:44.449752 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6405ad68-f79f-4767-bd85-1c6ad404a60a tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:44.450448 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6405ad68-f79f-4767-bd85-1c6ad404a60a tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:44.451571 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6405ad68-f79f-4767-bd85-1c6ad404a60a tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:44.451983 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6405ad68-f79f-4767-bd85-1c6ad404a60a tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:44.555672 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-7f62e68a-6c9f-4632-a08d-68032cf59107 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7623b303ca8244b58179ef0146dd2bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8372f52bdbf443385cd0058e122fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:44.566947 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-7f62e68a-6c9f-4632-a08d-68032cf59107 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] 10.222.0.45 "GET /compute/v2.1/servers/8a5137d8-24f6-4b78-abcb-2cf8d939df3e" status: 200 len: 1314 microversion: 2.1 time: 0.397887 Dec 16 14:55:44.568185 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 41/90] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:55:44 2021] GET /compute/v2.1/servers/8a5137d8-24f6-4b78-abcb-2cf8d939df3e => generated 1314 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:55:44.658666 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-ad175dfc-01b6-4968-b25f-b563b59c2be9 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:44.659340 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-ad175dfc-01b6-4968-b25f-b563b59c2be9 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:55:44.675505 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ad175dfc-01b6-4968-b25f-b563b59c2be9 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:44.676017 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ad175dfc-01b6-4968-b25f-b563b59c2be9 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:44.676879 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ad175dfc-01b6-4968-b25f-b563b59c2be9 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:44.677356 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ad175dfc-01b6-4968-b25f-b563b59c2be9 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:44.819376 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-ad175dfc-01b6-4968-b25f-b563b59c2be9 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:44.828445 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-ad175dfc-01b6-4968-b25f-b563b59c2be9 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14" status: 200 len: 1289 microversion: 2.1 time: 0.177303 Dec 16 14:55:44.829242 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 42/91] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:55:44 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14 => generated 1289 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:55:44.837787 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-eb1861ee-7e61-47ba-a8b2-6614fe9efb4d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:44.839036 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-eb1861ee-7e61-47ba-a8b2-6614fe9efb4d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:55:44.846913 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-eb1861ee-7e61-47ba-a8b2-6614fe9efb4d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:44.847422 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-eb1861ee-7e61-47ba-a8b2-6614fe9efb4d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:44.848275 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-eb1861ee-7e61-47ba-a8b2-6614fe9efb4d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:44.848770 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-eb1861ee-7e61-47ba-a8b2-6614fe9efb4d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:44.865258 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-6405ad68-f79f-4767-bd85-1c6ad404a60a tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:44.876903 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-6405ad68-f79f-4767-bd85-1c6ad404a60a tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46" status: 200 len: 1322 microversion: 2.1 time: 0.460649 Dec 16 14:55:44.877553 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 50/92] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:55:44 2021] GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46 => generated 1322 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:55:45.101556 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-eb1861ee-7e61-47ba-a8b2-6614fe9efb4d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:45.116539 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-eb1861ee-7e61-47ba-a8b2-6614fe9efb4d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:45.121512 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-eb1861ee-7e61-47ba-a8b2-6614fe9efb4d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:45.122873 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-eb1861ee-7e61-47ba-a8b2-6614fe9efb4d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1405 microversion: 2.20 time: 0.292708 Dec 16 14:55:45.123619 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 43/93] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 14:55:44 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1405 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:55:45.588947 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-14ff1654-147b-46bf-8dfb-7c7c5480aae6 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:45.589611 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-14ff1654-147b-46bf-8dfb-7c7c5480aae6 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] [instance: 8a5137d8-24f6-4b78-abcb-2cf8d939df3e] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:55:45.597697 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-14ff1654-147b-46bf-8dfb-7c7c5480aae6 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:45.598253 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-14ff1654-147b-46bf-8dfb-7c7c5480aae6 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:45.599088 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-14ff1654-147b-46bf-8dfb-7c7c5480aae6 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:45.599572 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-14ff1654-147b-46bf-8dfb-7c7c5480aae6 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:45.812782 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-14ff1654-147b-46bf-8dfb-7c7c5480aae6 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7623b303ca8244b58179ef0146dd2bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8372f52bdbf443385cd0058e122fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:45.821431 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-14ff1654-147b-46bf-8dfb-7c7c5480aae6 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] 10.222.0.45 "GET /compute/v2.1/servers/8a5137d8-24f6-4b78-abcb-2cf8d939df3e" status: 200 len: 1314 microversion: 2.1 time: 0.240541 Dec 16 14:55:45.822067 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 51/94] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:55:45 2021] GET /compute/v2.1/servers/8a5137d8-24f6-4b78-abcb-2cf8d939df3e => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:55:45.859460 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-6e194f05-4366-402b-bde2-8bf3e0840411 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:45.860135 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-6e194f05-4366-402b-bde2-8bf3e0840411 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:55:45.868492 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6e194f05-4366-402b-bde2-8bf3e0840411 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:45.869066 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6e194f05-4366-402b-bde2-8bf3e0840411 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:45.870375 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6e194f05-4366-402b-bde2-8bf3e0840411 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:45.870864 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6e194f05-4366-402b-bde2-8bf3e0840411 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:45.899086 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-909b37dd-76c1-4d0f-810d-032f1f8a674a tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:45.899678 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-909b37dd-76c1-4d0f-810d-032f1f8a674a tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: bcaa83bc-5d07-413a-88e5-b7428a5b5d46] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:55:45.908251 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-909b37dd-76c1-4d0f-810d-032f1f8a674a tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:45.908745 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-909b37dd-76c1-4d0f-810d-032f1f8a674a tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:45.909829 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-909b37dd-76c1-4d0f-810d-032f1f8a674a tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:45.910338 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-909b37dd-76c1-4d0f-810d-032f1f8a674a tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:46.012493 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-6e194f05-4366-402b-bde2-8bf3e0840411 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:46.021293 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-6e194f05-4366-402b-bde2-8bf3e0840411 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14" status: 200 len: 1289 microversion: 2.1 time: 0.169500 Dec 16 14:55:46.021887 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 44/95] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:55:45 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14 => generated 1289 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:55:46.125791 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-909b37dd-76c1-4d0f-810d-032f1f8a674a tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:46.134534 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-909b37dd-76c1-4d0f-810d-032f1f8a674a tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46" status: 200 len: 1322 microversion: 2.1 time: 0.243451 Dec 16 14:55:46.135627 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 52/96] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:55:45 2021] GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46 => generated 1322 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:55:46.144996 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-21bb855d-497c-4a17-93b3-30e10ddb379d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:46.145663 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-21bb855d-497c-4a17-93b3-30e10ddb379d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:55:46.154145 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-21bb855d-497c-4a17-93b3-30e10ddb379d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:46.154599 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-21bb855d-497c-4a17-93b3-30e10ddb379d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:46.155424 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-21bb855d-497c-4a17-93b3-30e10ddb379d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:46.155913 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-21bb855d-497c-4a17-93b3-30e10ddb379d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:46.493432 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-21bb855d-497c-4a17-93b3-30e10ddb379d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:46.506841 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-21bb855d-497c-4a17-93b3-30e10ddb379d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:46.512043 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-21bb855d-497c-4a17-93b3-30e10ddb379d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:46.513169 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-21bb855d-497c-4a17-93b3-30e10ddb379d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1405 microversion: 2.20 time: 0.375777 Dec 16 14:55:46.513749 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 45/97] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 14:55:46 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1405 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:55:46.844376 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-1cee8a77-8191-428e-8488-251c5c2ed051 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:46.845044 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-1cee8a77-8191-428e-8488-251c5c2ed051 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] [instance: 8a5137d8-24f6-4b78-abcb-2cf8d939df3e] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:55:46.853238 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1cee8a77-8191-428e-8488-251c5c2ed051 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:46.854506 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1cee8a77-8191-428e-8488-251c5c2ed051 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:46.855354 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1cee8a77-8191-428e-8488-251c5c2ed051 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:46.855846 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1cee8a77-8191-428e-8488-251c5c2ed051 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:47.047790 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-3838c922-4b36-453c-b229-d1467b11e2f2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:47.048356 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-3838c922-4b36-453c-b229-d1467b11e2f2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:55:47.059004 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3838c922-4b36-453c-b229-d1467b11e2f2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:47.059519 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3838c922-4b36-453c-b229-d1467b11e2f2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:47.060376 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3838c922-4b36-453c-b229-d1467b11e2f2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:47.060869 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3838c922-4b36-453c-b229-d1467b11e2f2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:47.192860 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-3838c922-4b36-453c-b229-d1467b11e2f2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:47.201852 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-3838c922-4b36-453c-b229-d1467b11e2f2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14" status: 200 len: 1289 microversion: 2.1 time: 0.166079 Dec 16 14:55:47.202473 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 46/98] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:55:47 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14 => generated 1289 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:55:47.218731 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-157a9b68-4eab-4594-a680-33fc97cb1b3a tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:47.219900 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-157a9b68-4eab-4594-a680-33fc97cb1b3a tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: bcaa83bc-5d07-413a-88e5-b7428a5b5d46] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:55:47.227633 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-157a9b68-4eab-4594-a680-33fc97cb1b3a tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:47.228125 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-157a9b68-4eab-4594-a680-33fc97cb1b3a tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:47.229948 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-157a9b68-4eab-4594-a680-33fc97cb1b3a tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:47.230463 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-157a9b68-4eab-4594-a680-33fc97cb1b3a tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:47.284879 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-1cee8a77-8191-428e-8488-251c5c2ed051 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7623b303ca8244b58179ef0146dd2bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8372f52bdbf443385cd0058e122fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:47.299124 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-1cee8a77-8191-428e-8488-251c5c2ed051 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] 10.222.0.45 "GET /compute/v2.1/servers/8a5137d8-24f6-4b78-abcb-2cf8d939df3e" status: 200 len: 1314 microversion: 2.1 time: 0.462496 Dec 16 14:55:47.299825 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 53/99] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:55:46 2021] GET /compute/v2.1/servers/8a5137d8-24f6-4b78-abcb-2cf8d939df3e => generated 1314 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:55:47.537606 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-39de66c3-907b-4431-8f53-998196fac674 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:47.538495 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-39de66c3-907b-4431-8f53-998196fac674 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:55:47.548207 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-39de66c3-907b-4431-8f53-998196fac674 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:47.548952 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-39de66c3-907b-4431-8f53-998196fac674 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:47.549795 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-39de66c3-907b-4431-8f53-998196fac674 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:47.550314 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-39de66c3-907b-4431-8f53-998196fac674 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:47.659235 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-157a9b68-4eab-4594-a680-33fc97cb1b3a tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:47.680263 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-157a9b68-4eab-4594-a680-33fc97cb1b3a tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46" status: 200 len: 1322 microversion: 2.1 time: 0.476643 Dec 16 14:55:47.685108 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 47/100] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:55:47 2021] GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46 => generated 1322 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:55:48.316372 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [req-3eb0a4af-d576-4924-b7b6-6b31e315c250 req-e8d5431d-9e63-4388-898d-b2d664abcfcf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bcaa83bc-5d07-413a-88e5-b7428a5b5d46", "tag": "bfc221af-2174-4f65-91cd-8eeec277367d"}]} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:55:48.328249 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:55:48.328249 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: warnings.warn(msg) Dec 16 14:55:48.339817 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-3eb0a4af-d576-4924-b7b6-6b31e315c250 req-e8d5431d-9e63-4388-898d-b2d664abcfcf service nova] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:48.340541 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-3eb0a4af-d576-4924-b7b6-6b31e315c250 req-e8d5431d-9e63-4388-898d-b2d664abcfcf service nova] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:48.363260 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.compute.server_external_events [req-3eb0a4af-d576-4924-b7b6-6b31e315c250 req-e8d5431d-9e63-4388-898d-b2d664abcfcf service nova] Creating event network-changed:bfc221af-2174-4f65-91cd-8eeec277367d for instance bcaa83bc-5d07-413a-88e5-b7428a5b5d46 on hv-cinder-82189 Dec 16 14:55:48.364103 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-3eb0a4af-d576-4924-b7b6-6b31e315c250 req-e8d5431d-9e63-4388-898d-b2d664abcfcf service nova] Acquired lock "compute-rpcapi-router" {{(pid=101355) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:265}} Dec 16 14:55:48.366387 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5278da25-665f-49da-b10a-ff14a232dacc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:48.367018 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5278da25-665f-49da-b10a-ff14a232dacc None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:48.368014 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5278da25-665f-49da-b10a-ff14a232dacc None None] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:48.368618 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5278da25-665f-49da-b10a-ff14a232dacc None None] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:48.379591 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.compute.rpcapi [None req-5278da25-665f-49da-b10a-ff14a232dacc None None] Automatically selected compute RPC version 5.11 from minimum service version 51 Dec 16 14:55:48.380691 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5278da25-665f-49da-b10a-ff14a232dacc None None] Releasing lock "compute-rpcapi-router" {{(pid=101355) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:281}} Dec 16 14:55:48.440826 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-5278da25-665f-49da-b10a-ff14a232dacc None None] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.312340 Dec 16 14:55:48.443439 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 48/101] 10.222.0.45 () {64 vars in 1308 bytes} [Thu Dec 16 14:55:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 14:55:48.456819 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-d9d3f1d1-42bc-4982-b7a5-cc05a0b48121 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:48.457603 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-d9d3f1d1-42bc-4982-b7a5-cc05a0b48121 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:55:48.478094 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d9d3f1d1-42bc-4982-b7a5-cc05a0b48121 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:48.478094 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d9d3f1d1-42bc-4982-b7a5-cc05a0b48121 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:48.478434 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d9d3f1d1-42bc-4982-b7a5-cc05a0b48121 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:48.479623 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d9d3f1d1-42bc-4982-b7a5-cc05a0b48121 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:48.519803 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-39de66c3-907b-4431-8f53-998196fac674 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:48.548999 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-39de66c3-907b-4431-8f53-998196fac674 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:48.563820 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-39de66c3-907b-4431-8f53-998196fac674 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:48.565001 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-39de66c3-907b-4431-8f53-998196fac674 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1405 microversion: 2.20 time: 1.036001 Dec 16 14:55:48.587134 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 54/102] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 14:55:47 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1405 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 14:55:48.597781 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-70f3a23e-14a6-439b-9b48-1c671f741fa2 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:48.598647 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-70f3a23e-14a6-439b-9b48-1c671f741fa2 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] [instance: 8a5137d8-24f6-4b78-abcb-2cf8d939df3e] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:55:48.614566 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-70f3a23e-14a6-439b-9b48-1c671f741fa2 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:48.615311 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-70f3a23e-14a6-439b-9b48-1c671f741fa2 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:48.616288 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-70f3a23e-14a6-439b-9b48-1c671f741fa2 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:48.616864 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-70f3a23e-14a6-439b-9b48-1c671f741fa2 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:48.967623 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-d9d3f1d1-42bc-4982-b7a5-cc05a0b48121 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:48.976554 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-d9d3f1d1-42bc-4982-b7a5-cc05a0b48121 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14" status: 200 len: 1297 microversion: 2.1 time: 0.530964 Dec 16 14:55:48.977279 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 49/103] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:55:48 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14 => generated 1297 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:55:49.002508 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-a937bdc9-91a5-46df-9787-c6502cba8b64 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:49.006597 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-a937bdc9-91a5-46df-9787-c6502cba8b64 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: bcaa83bc-5d07-413a-88e5-b7428a5b5d46] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:55:49.025335 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a937bdc9-91a5-46df-9787-c6502cba8b64 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:49.030772 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a937bdc9-91a5-46df-9787-c6502cba8b64 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:49.031869 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a937bdc9-91a5-46df-9787-c6502cba8b64 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:49.032544 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a937bdc9-91a5-46df-9787-c6502cba8b64 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:49.127245 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-70f3a23e-14a6-439b-9b48-1c671f741fa2 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7623b303ca8244b58179ef0146dd2bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8372f52bdbf443385cd0058e122fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:49.142361 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-70f3a23e-14a6-439b-9b48-1c671f741fa2 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] 10.222.0.45 "GET /compute/v2.1/servers/8a5137d8-24f6-4b78-abcb-2cf8d939df3e" status: 200 len: 1314 microversion: 2.1 time: 0.553746 Dec 16 14:55:49.144648 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 55/104] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:55:48 2021] GET /compute/v2.1/servers/8a5137d8-24f6-4b78-abcb-2cf8d939df3e => generated 1314 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:55:49.158512 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [req-83954dd7-c0f3-463f-ab45-2ef8fbadddaa req-e39ea4ba-e9df-4edb-86fe-21cf737cc7b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd5ffc87-035a-4e91-8fb5-8e44ed5704ac", "tag": "53c4bcf8-a1ba-44b2-b6d2-735e655c1b9f"}]} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:55:49.178544 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:55:49.178544 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: warnings.warn(msg) Dec 16 14:55:49.203127 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-83954dd7-c0f3-463f-ab45-2ef8fbadddaa req-e39ea4ba-e9df-4edb-86fe-21cf737cc7b8 service nova] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:49.205892 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-83954dd7-c0f3-463f-ab45-2ef8fbadddaa req-e39ea4ba-e9df-4edb-86fe-21cf737cc7b8 service nova] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:49.230133 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.compute.server_external_events [req-83954dd7-c0f3-463f-ab45-2ef8fbadddaa req-e39ea4ba-e9df-4edb-86fe-21cf737cc7b8 service nova] Creating event network-changed:53c4bcf8-a1ba-44b2-b6d2-735e655c1b9f for instance cd5ffc87-035a-4e91-8fb5-8e44ed5704ac on hv-cinder-82189 Dec 16 14:55:49.235933 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [req-83954dd7-c0f3-463f-ab45-2ef8fbadddaa req-e39ea4ba-e9df-4edb-86fe-21cf737cc7b8 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089325 Dec 16 14:55:49.239088 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 56/105] 10.222.0.45 () {64 vars in 1308 bytes} [Thu Dec 16 14:55:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:55:49.593275 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-33a0c5e4-b7ff-4474-86e5-1694626590e2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:49.597951 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-33a0c5e4-b7ff-4474-86e5-1694626590e2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:55:49.617477 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-33a0c5e4-b7ff-4474-86e5-1694626590e2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:49.618032 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-33a0c5e4-b7ff-4474-86e5-1694626590e2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:49.620326 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-33a0c5e4-b7ff-4474-86e5-1694626590e2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:49.620859 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-33a0c5e4-b7ff-4474-86e5-1694626590e2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:49.642489 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-a937bdc9-91a5-46df-9787-c6502cba8b64 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:49.652454 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-a937bdc9-91a5-46df-9787-c6502cba8b64 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46" status: 200 len: 1322 microversion: 2.1 time: 0.674228 Dec 16 14:55:49.653033 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 50/106] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:55:48 2021] GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46 => generated 1322 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:55:49.789326 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-1563a639-484a-4212-baf6-223a02cc78f0 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1835287137", "imageRef": "9b00ff4e-db72-4324-820b-87a6bd73b055", "flavorRef": "452", "networks": [{"uuid": "dccb4f55-43d1-4fdb-b128-a148d791e0a8"}]}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:55:49.868367 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.network.neutron [None req-1563a639-484a-4212-baf6-223a02cc78f0 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] validate_networks() for [('dccb4f55-43d1-4fdb-b128-a148d791e0a8', None, None, None)] {{(pid=101355) validate_networks /opt/stack/nova/nova/network/neutron.py:2383}} Dec 16 14:55:50.302870 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-33a0c5e4-b7ff-4474-86e5-1694626590e2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:50.325539 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-33a0c5e4-b7ff-4474-86e5-1694626590e2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:50.331027 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-33a0c5e4-b7ff-4474-86e5-1694626590e2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:50.332788 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-33a0c5e4-b7ff-4474-86e5-1694626590e2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1405 microversion: 2.20 time: 0.752673 Dec 16 14:55:50.342439 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 57/107] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 14:55:49 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1405 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:55:50.347913 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-012f8006-d531-4c87-904f-62f8073de2fb tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:50.347913 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-012f8006-d531-4c87-904f-62f8073de2fb tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:55:50.358683 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-012f8006-d531-4c87-904f-62f8073de2fb tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:50.359187 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-012f8006-d531-4c87-904f-62f8073de2fb tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:50.360043 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-012f8006-d531-4c87-904f-62f8073de2fb tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:50.360868 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-012f8006-d531-4c87-904f-62f8073de2fb tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:50.602896 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-012f8006-d531-4c87-904f-62f8073de2fb tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:50.613349 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-012f8006-d531-4c87-904f-62f8073de2fb tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14" status: 200 len: 1295 microversion: 2.1 time: 0.277452 Dec 16 14:55:50.613934 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 58/108] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:55:50 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14 => generated 1295 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:55:50.622840 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-187b1aab-09dc-49cc-971c-5b39c2e7558c tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:50.623853 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-187b1aab-09dc-49cc-971c-5b39c2e7558c tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] [instance: 8a5137d8-24f6-4b78-abcb-2cf8d939df3e] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:55:50.632449 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-187b1aab-09dc-49cc-971c-5b39c2e7558c tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:50.633404 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-187b1aab-09dc-49cc-971c-5b39c2e7558c tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:50.634492 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-187b1aab-09dc-49cc-971c-5b39c2e7558c tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:50.635708 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-187b1aab-09dc-49cc-971c-5b39c2e7558c tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:51.082380 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-187b1aab-09dc-49cc-971c-5b39c2e7558c tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7623b303ca8244b58179ef0146dd2bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8372f52bdbf443385cd0058e122fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:51.093627 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-187b1aab-09dc-49cc-971c-5b39c2e7558c tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] 10.222.0.45 "GET /compute/v2.1/servers/8a5137d8-24f6-4b78-abcb-2cf8d939df3e" status: 200 len: 1314 microversion: 2.1 time: 0.478252 Dec 16 14:55:51.094651 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 59/109] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:55:50 2021] GET /compute/v2.1/servers/8a5137d8-24f6-4b78-abcb-2cf8d939df3e => generated 1314 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:55:51.103846 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-396cbceb-fdcd-4526-bc44-b755f6e84671 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:51.105047 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-396cbceb-fdcd-4526-bc44-b755f6e84671 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: bcaa83bc-5d07-413a-88e5-b7428a5b5d46] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:55:51.117564 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-396cbceb-fdcd-4526-bc44-b755f6e84671 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:51.118309 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-396cbceb-fdcd-4526-bc44-b755f6e84671 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:51.120122 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-396cbceb-fdcd-4526-bc44-b755f6e84671 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:51.120772 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-396cbceb-fdcd-4526-bc44-b755f6e84671 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:51.165270 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.virt.hardware [None req-1563a639-484a-4212-baf6-223a02cc78f0 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Flavor limits 0:0:0 {{(pid=101355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:338}} Dec 16 14:55:51.166218 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.virt.hardware [None req-1563a639-484a-4212-baf6-223a02cc78f0 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Image limits 0:0:0 {{(pid=101355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:342}} Dec 16 14:55:51.166954 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.virt.hardware [None req-1563a639-484a-4212-baf6-223a02cc78f0 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Flavor pref 0:0:0 {{(pid=101355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:378}} Dec 16 14:55:51.167619 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.virt.hardware [None req-1563a639-484a-4212-baf6-223a02cc78f0 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Image pref 0:0:0 {{(pid=101355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:382}} Dec 16 14:55:51.168304 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.virt.hardware [None req-1563a639-484a-4212-baf6-223a02cc78f0 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=101355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:422}} Dec 16 14:55:51.188689 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1563a639-484a-4212-baf6-223a02cc78f0 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:51.188689 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1563a639-484a-4212-baf6-223a02cc78f0 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:51.189407 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1563a639-484a-4212-baf6-223a02cc78f0 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:51.189881 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1563a639-484a-4212-baf6-223a02cc78f0 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:51.213640 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.quota [None req-1563a639-484a-4212-baf6-223a02cc78f0 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Getting quotas for project 4732b1ccb145414ba7d9f3d93df9f8d5. Resources: {'ram', 'instances', 'cores'} {{(pid=101355) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 16 14:55:51.218255 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.quota [None req-1563a639-484a-4212-baf6-223a02cc78f0 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Getting quotas for user 8e94f83a79ca42c691dc29a189a64a35 and project 4732b1ccb145414ba7d9f3d93df9f8d5. Resources: {'ram', 'instances', 'cores'} {{(pid=101355) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 16 14:55:51.230917 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-1563a639-484a-4212-baf6-223a02cc78f0 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Going to run 1 instances... {{(pid=101355) _provision_instances /opt/stack/nova/nova/compute/api.py:1224}} Dec 16 14:55:51.233483 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-1563a639-484a-4212-baf6-223a02cc78f0 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] [instance: 07dfd5e5-b751-4ebb-a023-9e0dbe8abc65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9b00ff4e-db72-4324-820b-87a6bd73b055',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1616}} Dec 16 14:55:51.323634 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-1563a639-484a-4212-baf6-223a02cc78f0 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.541764 Dec 16 14:55:51.324503 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 51/110] 10.222.0.45 () {60 vars in 1137 bytes} [Thu Dec 16 14:55:49 2021] POST /compute/v2.1/servers => generated 380 bytes in 1543 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 16 14:55:51.356171 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-99931bc9-3322-40ef-af96-d4f04be40b43 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:51.356762 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-99931bc9-3322-40ef-af96-d4f04be40b43 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] [instance: 07dfd5e5-b751-4ebb-a023-9e0dbe8abc65] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:55:51.376077 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-396cbceb-fdcd-4526-bc44-b755f6e84671 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:51.386466 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-396cbceb-fdcd-4526-bc44-b755f6e84671 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46" status: 200 len: 1322 microversion: 2.1 time: 0.290178 Dec 16 14:55:51.396401 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 60/111] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:55:51 2021] GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46 => generated 1322 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:55:51.396401 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-8fff87f5-7d5d-4edf-bdaa-0b4f9a25212b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:51.397286 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-8fff87f5-7d5d-4edf-bdaa-0b4f9a25212b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:55:51.405372 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8fff87f5-7d5d-4edf-bdaa-0b4f9a25212b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:51.406306 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8fff87f5-7d5d-4edf-bdaa-0b4f9a25212b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:51.406961 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8fff87f5-7d5d-4edf-bdaa-0b4f9a25212b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:51.407448 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8fff87f5-7d5d-4edf-bdaa-0b4f9a25212b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:51.447426 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-99931bc9-3322-40ef-af96-d4f04be40b43 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e94f83a79ca42c691dc29a189a64a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4732b1ccb145414ba7d9f3d93df9f8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:51.457277 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-99931bc9-3322-40ef-af96-d4f04be40b43 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] 10.222.0.45 "GET /compute/v2.1/servers/07dfd5e5-b751-4ebb-a023-9e0dbe8abc65" status: 200 len: 1214 microversion: 2.1 time: 0.126096 Dec 16 14:55:51.462519 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 52/112] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:55:51 2021] GET /compute/v2.1/servers/07dfd5e5-b751-4ebb-a023-9e0dbe8abc65 => generated 1214 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:55:51.635967 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-092ca151-03d5-44a5-87ec-20d144256b5a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:51.636805 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-092ca151-03d5-44a5-87ec-20d144256b5a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:55:51.645590 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-092ca151-03d5-44a5-87ec-20d144256b5a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:51.646408 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-092ca151-03d5-44a5-87ec-20d144256b5a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:51.647294 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-092ca151-03d5-44a5-87ec-20d144256b5a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:51.647790 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-092ca151-03d5-44a5-87ec-20d144256b5a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:51.834473 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-8fff87f5-7d5d-4edf-bdaa-0b4f9a25212b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:51.847849 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-8fff87f5-7d5d-4edf-bdaa-0b4f9a25212b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:51.852422 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-8fff87f5-7d5d-4edf-bdaa-0b4f9a25212b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:51.854263 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-8fff87f5-7d5d-4edf-bdaa-0b4f9a25212b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1405 microversion: 2.20 time: 0.465201 Dec 16 14:55:51.854840 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 61/113] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 14:55:51 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1405 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:55:51.974787 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-092ca151-03d5-44a5-87ec-20d144256b5a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:51.983912 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-092ca151-03d5-44a5-87ec-20d144256b5a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14" status: 200 len: 1363 microversion: 2.1 time: 0.356091 Dec 16 14:55:51.986546 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 53/114] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:55:51 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14 => generated 1363 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:55:52.115490 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-ee0e5cda-cb9c-46a5-ab8b-489ad1d2068f tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:52.116194 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-ee0e5cda-cb9c-46a5-ab8b-489ad1d2068f tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] [instance: 8a5137d8-24f6-4b78-abcb-2cf8d939df3e] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:55:52.123997 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ee0e5cda-cb9c-46a5-ab8b-489ad1d2068f tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:52.124500 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ee0e5cda-cb9c-46a5-ab8b-489ad1d2068f tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:52.125380 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ee0e5cda-cb9c-46a5-ab8b-489ad1d2068f tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:52.125903 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ee0e5cda-cb9c-46a5-ab8b-489ad1d2068f tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:52.359098 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-ee0e5cda-cb9c-46a5-ab8b-489ad1d2068f tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7623b303ca8244b58179ef0146dd2bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8372f52bdbf443385cd0058e122fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:52.367818 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-ee0e5cda-cb9c-46a5-ab8b-489ad1d2068f tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] 10.222.0.45 "GET /compute/v2.1/servers/8a5137d8-24f6-4b78-abcb-2cf8d939df3e" status: 200 len: 1314 microversion: 2.1 time: 0.260006 Dec 16 14:55:52.368415 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 62/115] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:55:52 2021] GET /compute/v2.1/servers/8a5137d8-24f6-4b78-abcb-2cf8d939df3e => generated 1314 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:55:52.408197 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-f74c658e-9418-4686-b11d-b6b0cbadee0b tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:52.408909 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-f74c658e-9418-4686-b11d-b6b0cbadee0b tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: bcaa83bc-5d07-413a-88e5-b7428a5b5d46] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:55:52.416718 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f74c658e-9418-4686-b11d-b6b0cbadee0b tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:52.417221 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f74c658e-9418-4686-b11d-b6b0cbadee0b tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:52.418081 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f74c658e-9418-4686-b11d-b6b0cbadee0b tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:52.418598 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f74c658e-9418-4686-b11d-b6b0cbadee0b tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:52.479070 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-47ad3dba-84ae-4b3b-a083-1c6523027aa2 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:52.480328 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-47ad3dba-84ae-4b3b-a083-1c6523027aa2 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] [instance: 07dfd5e5-b751-4ebb-a023-9e0dbe8abc65] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:55:52.487541 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-47ad3dba-84ae-4b3b-a083-1c6523027aa2 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:52.488043 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-47ad3dba-84ae-4b3b-a083-1c6523027aa2 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:52.488879 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-47ad3dba-84ae-4b3b-a083-1c6523027aa2 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:52.489349 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-47ad3dba-84ae-4b3b-a083-1c6523027aa2 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:52.629287 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-47ad3dba-84ae-4b3b-a083-1c6523027aa2 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e94f83a79ca42c691dc29a189a64a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4732b1ccb145414ba7d9f3d93df9f8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:52.638700 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-47ad3dba-84ae-4b3b-a083-1c6523027aa2 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] 10.222.0.45 "GET /compute/v2.1/servers/07dfd5e5-b751-4ebb-a023-9e0dbe8abc65" status: 200 len: 1218 microversion: 2.1 time: 0.167281 Dec 16 14:55:52.639303 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 63/116] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:55:52 2021] GET /compute/v2.1/servers/07dfd5e5-b751-4ebb-a023-9e0dbe8abc65 => generated 1218 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:55:52.657394 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-f74c658e-9418-4686-b11d-b6b0cbadee0b tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:52.666897 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-f74c658e-9418-4686-b11d-b6b0cbadee0b tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46" status: 200 len: 1322 microversion: 2.1 time: 0.266470 Dec 16 14:55:52.667488 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 54/117] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:55:52 2021] GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46 => generated 1322 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:55:52.877524 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-e27f7d1e-abca-4f64-8cff-7a68152c4dde tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:52.878219 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-e27f7d1e-abca-4f64-8cff-7a68152c4dde tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:55:52.885868 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e27f7d1e-abca-4f64-8cff-7a68152c4dde tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:52.886405 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e27f7d1e-abca-4f64-8cff-7a68152c4dde tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:52.887312 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e27f7d1e-abca-4f64-8cff-7a68152c4dde tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:52.887807 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e27f7d1e-abca-4f64-8cff-7a68152c4dde tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:53.005498 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-0e4f154a-b0e8-48da-a4bd-5b1c08eac1a0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:53.006317 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-0e4f154a-b0e8-48da-a4bd-5b1c08eac1a0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:55:53.014455 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0e4f154a-b0e8-48da-a4bd-5b1c08eac1a0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:53.015578 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0e4f154a-b0e8-48da-a4bd-5b1c08eac1a0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:53.020053 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0e4f154a-b0e8-48da-a4bd-5b1c08eac1a0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:53.020053 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0e4f154a-b0e8-48da-a4bd-5b1c08eac1a0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:53.127112 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-e27f7d1e-abca-4f64-8cff-7a68152c4dde tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:53.140172 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-e27f7d1e-abca-4f64-8cff-7a68152c4dde tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:53.144906 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-e27f7d1e-abca-4f64-8cff-7a68152c4dde tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:53.146127 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-e27f7d1e-abca-4f64-8cff-7a68152c4dde tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1405 microversion: 2.20 time: 0.276820 Dec 16 14:55:53.146735 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 64/118] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 14:55:52 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1405 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:55:53.389802 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-4406f3c8-2484-470d-8bab-b4685ccc04d9 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:53.390504 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-4406f3c8-2484-470d-8bab-b4685ccc04d9 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] [instance: 8a5137d8-24f6-4b78-abcb-2cf8d939df3e] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:55:53.399104 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4406f3c8-2484-470d-8bab-b4685ccc04d9 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:53.399611 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4406f3c8-2484-470d-8bab-b4685ccc04d9 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:53.400973 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4406f3c8-2484-470d-8bab-b4685ccc04d9 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:53.401876 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4406f3c8-2484-470d-8bab-b4685ccc04d9 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:53.453442 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-0e4f154a-b0e8-48da-a4bd-5b1c08eac1a0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:53.463522 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-0e4f154a-b0e8-48da-a4bd-5b1c08eac1a0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14" status: 200 len: 1363 microversion: 2.1 time: 0.465164 Dec 16 14:55:53.464148 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 55/119] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:55:52 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14 => generated 1363 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:55:53.642449 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-4406f3c8-2484-470d-8bab-b4685ccc04d9 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7623b303ca8244b58179ef0146dd2bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8372f52bdbf443385cd0058e122fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:53.657330 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-4406f3c8-2484-470d-8bab-b4685ccc04d9 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] 10.222.0.45 "GET /compute/v2.1/servers/8a5137d8-24f6-4b78-abcb-2cf8d939df3e" status: 200 len: 1314 microversion: 2.1 time: 0.274933 Dec 16 14:55:53.660929 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-043f6a44-dd54-4fcf-9bd6-e52ba7102a82 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:53.667552 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-043f6a44-dd54-4fcf-9bd6-e52ba7102a82 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] [instance: 07dfd5e5-b751-4ebb-a023-9e0dbe8abc65] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:55:53.668000 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 65/120] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:55:53 2021] GET /compute/v2.1/servers/8a5137d8-24f6-4b78-abcb-2cf8d939df3e => generated 1314 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:55:53.679621 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-043f6a44-dd54-4fcf-9bd6-e52ba7102a82 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:53.680127 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-043f6a44-dd54-4fcf-9bd6-e52ba7102a82 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:53.680980 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-043f6a44-dd54-4fcf-9bd6-e52ba7102a82 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:53.681465 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-043f6a44-dd54-4fcf-9bd6-e52ba7102a82 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:53.689083 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-730dc25e-11e9-47be-9130-d0f8087acb46 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:53.689751 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-730dc25e-11e9-47be-9130-d0f8087acb46 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: bcaa83bc-5d07-413a-88e5-b7428a5b5d46] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:55:53.699047 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-730dc25e-11e9-47be-9130-d0f8087acb46 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:53.699548 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-730dc25e-11e9-47be-9130-d0f8087acb46 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:53.700400 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-730dc25e-11e9-47be-9130-d0f8087acb46 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:53.701034 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-730dc25e-11e9-47be-9130-d0f8087acb46 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:53.904132 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-043f6a44-dd54-4fcf-9bd6-e52ba7102a82 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e94f83a79ca42c691dc29a189a64a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4732b1ccb145414ba7d9f3d93df9f8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:53.917621 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-043f6a44-dd54-4fcf-9bd6-e52ba7102a82 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] 10.222.0.45 "GET /compute/v2.1/servers/07dfd5e5-b751-4ebb-a023-9e0dbe8abc65" status: 200 len: 1218 microversion: 2.1 time: 0.263700 Dec 16 14:55:53.919396 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 56/121] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:55:53 2021] GET /compute/v2.1/servers/07dfd5e5-b751-4ebb-a023-9e0dbe8abc65 => generated 1218 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:55:54.169441 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-75e579db-c735-4463-bf85-b567096338bc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:54.170027 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-75e579db-c735-4463-bf85-b567096338bc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:55:54.178093 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-75e579db-c735-4463-bf85-b567096338bc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:54.178615 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-75e579db-c735-4463-bf85-b567096338bc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:54.179457 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-75e579db-c735-4463-bf85-b567096338bc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:54.179849 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-730dc25e-11e9-47be-9130-d0f8087acb46 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:54.180137 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-75e579db-c735-4463-bf85-b567096338bc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:54.191002 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-730dc25e-11e9-47be-9130-d0f8087acb46 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46" status: 200 len: 1322 microversion: 2.1 time: 0.509960 Dec 16 14:55:54.199685 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 66/122] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:55:53 2021] GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46 => generated 1322 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:55:54.435971 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-75e579db-c735-4463-bf85-b567096338bc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:54.470437 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-75e579db-c735-4463-bf85-b567096338bc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:54.477096 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-75e579db-c735-4463-bf85-b567096338bc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:54.479323 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-75e579db-c735-4463-bf85-b567096338bc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1405 microversion: 2.20 time: 0.317825 Dec 16 14:55:54.492403 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-4d226d98-3393-48af-9ce1-262e4be0b925 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:54.492403 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-4d226d98-3393-48af-9ce1-262e4be0b925 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:55:54.493680 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 57/123] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 14:55:54 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1405 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 14:55:54.499363 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4d226d98-3393-48af-9ce1-262e4be0b925 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:54.499866 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4d226d98-3393-48af-9ce1-262e4be0b925 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:54.501501 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4d226d98-3393-48af-9ce1-262e4be0b925 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:54.501990 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4d226d98-3393-48af-9ce1-262e4be0b925 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:54.679761 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-e0e78b6d-c95b-4aeb-9812-d36740b65923 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:54.681171 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-e0e78b6d-c95b-4aeb-9812-d36740b65923 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] [instance: 8a5137d8-24f6-4b78-abcb-2cf8d939df3e] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:55:54.693057 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e0e78b6d-c95b-4aeb-9812-d36740b65923 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:54.693770 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e0e78b6d-c95b-4aeb-9812-d36740b65923 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:54.694708 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e0e78b6d-c95b-4aeb-9812-d36740b65923 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:54.695408 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e0e78b6d-c95b-4aeb-9812-d36740b65923 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:54.938826 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-4d226d98-3393-48af-9ce1-262e4be0b925 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:54.948204 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-4d226d98-3393-48af-9ce1-262e4be0b925 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14" status: 200 len: 1363 microversion: 2.1 time: 0.467329 Dec 16 14:55:54.961641 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 67/124] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:55:54 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14 => generated 1363 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:55:54.971443 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [req-b4a29e0c-8505-4f2a-8a78-3020555bac59 req-469bde89-06a4-4fa5-9932-0bf00c35f11c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2989cd04-6526-4aca-8f1f-771371323c14", "tag": "d2035528-d3ab-4af2-aaf2-d63a3fd8324b"}]} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:55:54.976416 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:55:54.976416 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: warnings.warn(msg) Dec 16 14:55:54.977925 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-e0e78b6d-c95b-4aeb-9812-d36740b65923 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7623b303ca8244b58179ef0146dd2bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8372f52bdbf443385cd0058e122fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:54.986942 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-b4a29e0c-8505-4f2a-8a78-3020555bac59 req-469bde89-06a4-4fa5-9932-0bf00c35f11c service nova] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:54.987652 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-b4a29e0c-8505-4f2a-8a78-3020555bac59 req-469bde89-06a4-4fa5-9932-0bf00c35f11c service nova] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:54.991349 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-e0e78b6d-c95b-4aeb-9812-d36740b65923 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] 10.222.0.45 "GET /compute/v2.1/servers/8a5137d8-24f6-4b78-abcb-2cf8d939df3e" status: 200 len: 1314 microversion: 2.1 time: 0.320124 Dec 16 14:55:54.991947 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 58/125] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:55:54 2021] GET /compute/v2.1/servers/8a5137d8-24f6-4b78-abcb-2cf8d939df3e => generated 1314 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:55:55.001772 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-312f581f-632f-42f0-87b1-f8ff8dc50c98 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:55.002633 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-312f581f-632f-42f0-87b1-f8ff8dc50c98 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] [instance: 07dfd5e5-b751-4ebb-a023-9e0dbe8abc65] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:55:55.011212 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-312f581f-632f-42f0-87b1-f8ff8dc50c98 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:55.011902 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-312f581f-632f-42f0-87b1-f8ff8dc50c98 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:55.013053 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-312f581f-632f-42f0-87b1-f8ff8dc50c98 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:55.013691 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-312f581f-632f-42f0-87b1-f8ff8dc50c98 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:55.017818 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.compute.server_external_events [req-b4a29e0c-8505-4f2a-8a78-3020555bac59 req-469bde89-06a4-4fa5-9932-0bf00c35f11c service nova] Creating event network-changed:d2035528-d3ab-4af2-aaf2-d63a3fd8324b for instance 2989cd04-6526-4aca-8f1f-771371323c14 on hv-cinder-82189 Dec 16 14:55:55.023112 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [req-b4a29e0c-8505-4f2a-8a78-3020555bac59 req-469bde89-06a4-4fa5-9932-0bf00c35f11c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060910 Dec 16 14:55:55.024315 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 68/126] 10.222.0.45 () {64 vars in 1308 bytes} [Thu Dec 16 14:55:54 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:55:55.152906 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-312f581f-632f-42f0-87b1-f8ff8dc50c98 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e94f83a79ca42c691dc29a189a64a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4732b1ccb145414ba7d9f3d93df9f8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:55.163684 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-312f581f-632f-42f0-87b1-f8ff8dc50c98 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] 10.222.0.45 "GET /compute/v2.1/servers/07dfd5e5-b751-4ebb-a023-9e0dbe8abc65" status: 200 len: 1218 microversion: 2.1 time: 0.170333 Dec 16 14:55:55.164570 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 59/127] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:55:54 2021] GET /compute/v2.1/servers/07dfd5e5-b751-4ebb-a023-9e0dbe8abc65 => generated 1218 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:55:55.213988 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-ec518754-7fc0-406f-b687-1ca895d530f6 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:55.214774 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-ec518754-7fc0-406f-b687-1ca895d530f6 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: bcaa83bc-5d07-413a-88e5-b7428a5b5d46] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:55:55.222832 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ec518754-7fc0-406f-b687-1ca895d530f6 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:55.223349 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ec518754-7fc0-406f-b687-1ca895d530f6 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:55.224190 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ec518754-7fc0-406f-b687-1ca895d530f6 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:55.224685 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ec518754-7fc0-406f-b687-1ca895d530f6 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:55.445400 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-ec518754-7fc0-406f-b687-1ca895d530f6 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:55.454178 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-ec518754-7fc0-406f-b687-1ca895d530f6 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46" status: 200 len: 1322 microversion: 2.1 time: 0.248879 Dec 16 14:55:55.454904 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 69/128] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:55:55 2021] GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46 => generated 1322 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:55:55.503372 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-6bbbf8d8-7117-450b-9f8a-03bb370f81bb tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:55.504235 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-6bbbf8d8-7117-450b-9f8a-03bb370f81bb tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:55:55.512306 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6bbbf8d8-7117-450b-9f8a-03bb370f81bb tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:55.517245 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6bbbf8d8-7117-450b-9f8a-03bb370f81bb tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:55.517245 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6bbbf8d8-7117-450b-9f8a-03bb370f81bb tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:55.517245 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6bbbf8d8-7117-450b-9f8a-03bb370f81bb tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:55.970162 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-b5d91916-8720-4e42-ba37-6accc1ac519a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:55.971424 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-b5d91916-8720-4e42-ba37-6accc1ac519a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:55:55.992420 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b5d91916-8720-4e42-ba37-6accc1ac519a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:55.993698 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b5d91916-8720-4e42-ba37-6accc1ac519a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:55.995374 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b5d91916-8720-4e42-ba37-6accc1ac519a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:55.996051 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b5d91916-8720-4e42-ba37-6accc1ac519a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:56.101912 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-6bbbf8d8-7117-450b-9f8a-03bb370f81bb tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:56.115311 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-6bbbf8d8-7117-450b-9f8a-03bb370f81bb tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:56.119849 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-6bbbf8d8-7117-450b-9f8a-03bb370f81bb tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:56.120985 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-6bbbf8d8-7117-450b-9f8a-03bb370f81bb tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1405 microversion: 2.20 time: 0.625702 Dec 16 14:55:56.121942 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 60/129] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 14:55:55 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1405 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:55:56.130322 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-5e13135d-2dbb-43a7-b2cf-f4bf3ac20c63 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:56.130989 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-5e13135d-2dbb-43a7-b2cf-f4bf3ac20c63 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] [instance: 8a5137d8-24f6-4b78-abcb-2cf8d939df3e] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:55:56.138791 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5e13135d-2dbb-43a7-b2cf-f4bf3ac20c63 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:56.139301 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5e13135d-2dbb-43a7-b2cf-f4bf3ac20c63 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:56.140152 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5e13135d-2dbb-43a7-b2cf-f4bf3ac20c63 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:56.140641 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5e13135d-2dbb-43a7-b2cf-f4bf3ac20c63 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:56.236552 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-b5d91916-8720-4e42-ba37-6accc1ac519a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:56.245685 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-b5d91916-8720-4e42-ba37-6accc1ac519a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14" status: 200 len: 1363 microversion: 2.1 time: 0.283135 Dec 16 14:55:56.246317 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 70/130] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:55:55 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14 => generated 1363 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:55:56.255703 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-d2181912-2409-4bdb-a560-f8748e666b0e tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:56.256640 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-d2181912-2409-4bdb-a560-f8748e666b0e tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] [instance: 07dfd5e5-b751-4ebb-a023-9e0dbe8abc65] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:55:56.265408 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d2181912-2409-4bdb-a560-f8748e666b0e tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:56.269853 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d2181912-2409-4bdb-a560-f8748e666b0e tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:56.269853 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d2181912-2409-4bdb-a560-f8748e666b0e tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:56.269853 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d2181912-2409-4bdb-a560-f8748e666b0e tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:56.484709 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-d2181912-2409-4bdb-a560-f8748e666b0e tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e94f83a79ca42c691dc29a189a64a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4732b1ccb145414ba7d9f3d93df9f8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:56.495618 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-d2181912-2409-4bdb-a560-f8748e666b0e tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] 10.222.0.45 "GET /compute/v2.1/servers/07dfd5e5-b751-4ebb-a023-9e0dbe8abc65" status: 200 len: 1210 microversion: 2.1 time: 0.247706 Dec 16 14:55:56.496792 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 71/131] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:55:56 2021] GET /compute/v2.1/servers/07dfd5e5-b751-4ebb-a023-9e0dbe8abc65 => generated 1210 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:55:56.506060 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-c6e5cc33-32ba-4af7-a5ad-9ccd2a4f4072 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:56.506788 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-c6e5cc33-32ba-4af7-a5ad-9ccd2a4f4072 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: bcaa83bc-5d07-413a-88e5-b7428a5b5d46] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:55:56.516219 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c6e5cc33-32ba-4af7-a5ad-9ccd2a4f4072 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:56.517009 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c6e5cc33-32ba-4af7-a5ad-9ccd2a4f4072 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:56.517943 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c6e5cc33-32ba-4af7-a5ad-9ccd2a4f4072 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:56.518559 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c6e5cc33-32ba-4af7-a5ad-9ccd2a4f4072 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:56.735753 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-5e13135d-2dbb-43a7-b2cf-f4bf3ac20c63 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7623b303ca8244b58179ef0146dd2bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8372f52bdbf443385cd0058e122fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:56.758243 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-5e13135d-2dbb-43a7-b2cf-f4bf3ac20c63 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] 10.222.0.45 "GET /compute/v2.1/servers/8a5137d8-24f6-4b78-abcb-2cf8d939df3e" status: 200 len: 1314 microversion: 2.1 time: 0.632181 Dec 16 14:55:56.759070 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 61/132] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:55:56 2021] GET /compute/v2.1/servers/8a5137d8-24f6-4b78-abcb-2cf8d939df3e => generated 1314 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:55:56.835585 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-c6e5cc33-32ba-4af7-a5ad-9ccd2a4f4072 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:56.851520 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-c6e5cc33-32ba-4af7-a5ad-9ccd2a4f4072 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46" status: 200 len: 1322 microversion: 2.1 time: 0.353523 Dec 16 14:55:56.852127 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 72/133] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:55:56 2021] GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46 => generated 1322 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:55:57.145787 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-840512da-333c-4ed8-97e5-1ff9ebd40aa1 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:57.146496 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-840512da-333c-4ed8-97e5-1ff9ebd40aa1 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:55:57.155072 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-840512da-333c-4ed8-97e5-1ff9ebd40aa1 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:57.155577 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-840512da-333c-4ed8-97e5-1ff9ebd40aa1 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:57.156434 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-840512da-333c-4ed8-97e5-1ff9ebd40aa1 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:57.156925 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-840512da-333c-4ed8-97e5-1ff9ebd40aa1 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:57.267374 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-0cf43c81-1a16-4759-8e72-c001efde6c92 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:57.268255 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-0cf43c81-1a16-4759-8e72-c001efde6c92 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:55:57.276645 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0cf43c81-1a16-4759-8e72-c001efde6c92 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:57.277422 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0cf43c81-1a16-4759-8e72-c001efde6c92 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:57.278469 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0cf43c81-1a16-4759-8e72-c001efde6c92 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:57.279128 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0cf43c81-1a16-4759-8e72-c001efde6c92 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:57.401836 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-840512da-333c-4ed8-97e5-1ff9ebd40aa1 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:57.416718 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-840512da-333c-4ed8-97e5-1ff9ebd40aa1 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:57.421688 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-840512da-333c-4ed8-97e5-1ff9ebd40aa1 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:57.422877 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-840512da-333c-4ed8-97e5-1ff9ebd40aa1 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1405 microversion: 2.20 time: 0.286391 Dec 16 14:55:57.426697 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 62/134] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 14:55:57 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1405 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:55:57.523714 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-17b2a80f-ed56-49d5-9d44-a2cd064f090e tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:57.524578 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-17b2a80f-ed56-49d5-9d44-a2cd064f090e tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] [instance: 07dfd5e5-b751-4ebb-a023-9e0dbe8abc65] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:55:57.533202 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-17b2a80f-ed56-49d5-9d44-a2cd064f090e tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:57.533778 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-17b2a80f-ed56-49d5-9d44-a2cd064f090e tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:57.534661 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-17b2a80f-ed56-49d5-9d44-a2cd064f090e tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:57.535160 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-17b2a80f-ed56-49d5-9d44-a2cd064f090e tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:57.544178 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-0cf43c81-1a16-4759-8e72-c001efde6c92 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:57.553024 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-0cf43c81-1a16-4759-8e72-c001efde6c92 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14" status: 200 len: 1363 microversion: 2.1 time: 0.293471 Dec 16 14:55:57.553616 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 73/135] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:55:57 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14 => generated 1363 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:55:57.668286 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-17b2a80f-ed56-49d5-9d44-a2cd064f090e tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e94f83a79ca42c691dc29a189a64a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4732b1ccb145414ba7d9f3d93df9f8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:57.677645 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-17b2a80f-ed56-49d5-9d44-a2cd064f090e tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] 10.222.0.45 "GET /compute/v2.1/servers/07dfd5e5-b751-4ebb-a023-9e0dbe8abc65" status: 200 len: 1266 microversion: 2.1 time: 0.163117 Dec 16 14:55:57.678279 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 63/136] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:55:57 2021] GET /compute/v2.1/servers/07dfd5e5-b751-4ebb-a023-9e0dbe8abc65 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:55:57.782790 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-492a6dea-9db5-4598-a2a6-0582e9166de2 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:57.783866 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-492a6dea-9db5-4598-a2a6-0582e9166de2 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] [instance: 8a5137d8-24f6-4b78-abcb-2cf8d939df3e] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:55:57.795544 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-492a6dea-9db5-4598-a2a6-0582e9166de2 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:57.796146 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-492a6dea-9db5-4598-a2a6-0582e9166de2 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:57.797240 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-492a6dea-9db5-4598-a2a6-0582e9166de2 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:57.797807 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-492a6dea-9db5-4598-a2a6-0582e9166de2 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:57.877950 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-c23ec638-ce64-45e1-b0c2-a72acdc03a06 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:57.878553 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-c23ec638-ce64-45e1-b0c2-a72acdc03a06 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: bcaa83bc-5d07-413a-88e5-b7428a5b5d46] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:55:57.897681 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c23ec638-ce64-45e1-b0c2-a72acdc03a06 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:57.903966 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c23ec638-ce64-45e1-b0c2-a72acdc03a06 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:57.905138 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c23ec638-ce64-45e1-b0c2-a72acdc03a06 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:57.905794 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c23ec638-ce64-45e1-b0c2-a72acdc03a06 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:58.195494 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-c23ec638-ce64-45e1-b0c2-a72acdc03a06 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:58.205760 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-c23ec638-ce64-45e1-b0c2-a72acdc03a06 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46" status: 200 len: 1322 microversion: 2.1 time: 0.340477 Dec 16 14:55:58.206977 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 64/137] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:55:57 2021] GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46 => generated 1322 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:55:58.321653 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-492a6dea-9db5-4598-a2a6-0582e9166de2 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7623b303ca8244b58179ef0146dd2bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8372f52bdbf443385cd0058e122fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:58.337097 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-492a6dea-9db5-4598-a2a6-0582e9166de2 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] 10.222.0.45 "GET /compute/v2.1/servers/8a5137d8-24f6-4b78-abcb-2cf8d939df3e" status: 200 len: 1314 microversion: 2.1 time: 0.564120 Dec 16 14:55:58.341208 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 74/138] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:55:57 2021] GET /compute/v2.1/servers/8a5137d8-24f6-4b78-abcb-2cf8d939df3e => generated 1314 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:55:58.448084 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-23a846cd-5894-4ef9-ae79-937431884ae0 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:58.449893 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-23a846cd-5894-4ef9-ae79-937431884ae0 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:55:58.460458 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-23a846cd-5894-4ef9-ae79-937431884ae0 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:58.461382 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-23a846cd-5894-4ef9-ae79-937431884ae0 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:58.461880 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-23a846cd-5894-4ef9-ae79-937431884ae0 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:58.462397 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-23a846cd-5894-4ef9-ae79-937431884ae0 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:58.588197 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-6bcd61f1-e7ae-4f8f-a557-5d479df3abe3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:58.589099 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-6bcd61f1-e7ae-4f8f-a557-5d479df3abe3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:55:58.617388 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6bcd61f1-e7ae-4f8f-a557-5d479df3abe3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:58.618692 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6bcd61f1-e7ae-4f8f-a557-5d479df3abe3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:58.621168 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6bcd61f1-e7ae-4f8f-a557-5d479df3abe3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:58.622380 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6bcd61f1-e7ae-4f8f-a557-5d479df3abe3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:58.837082 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-23a846cd-5894-4ef9-ae79-937431884ae0 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:58.852027 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-23a846cd-5894-4ef9-ae79-937431884ae0 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:58.858067 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-23a846cd-5894-4ef9-ae79-937431884ae0 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:58.859562 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-23a846cd-5894-4ef9-ae79-937431884ae0 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1405 microversion: 2.20 time: 0.421802 Dec 16 14:55:58.860331 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 65/139] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 14:55:58 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1405 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:55:58.883780 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-421c18e1-ef73-41cc-aa00-01ddc17bdfea tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:58.884757 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-421c18e1-ef73-41cc-aa00-01ddc17bdfea tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] [instance: 07dfd5e5-b751-4ebb-a023-9e0dbe8abc65] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:55:58.893638 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-421c18e1-ef73-41cc-aa00-01ddc17bdfea tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:58.894433 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-421c18e1-ef73-41cc-aa00-01ddc17bdfea tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:58.895465 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-421c18e1-ef73-41cc-aa00-01ddc17bdfea tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:58.896110 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-421c18e1-ef73-41cc-aa00-01ddc17bdfea tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:59.065321 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-421c18e1-ef73-41cc-aa00-01ddc17bdfea tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e94f83a79ca42c691dc29a189a64a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4732b1ccb145414ba7d9f3d93df9f8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:59.079778 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-421c18e1-ef73-41cc-aa00-01ddc17bdfea tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] 10.222.0.45 "GET /compute/v2.1/servers/07dfd5e5-b751-4ebb-a023-9e0dbe8abc65" status: 200 len: 1272 microversion: 2.1 time: 0.205723 Dec 16 14:55:59.081171 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 66/140] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:55:58 2021] GET /compute/v2.1/servers/07dfd5e5-b751-4ebb-a023-9e0dbe8abc65 => generated 1272 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:55:59.083562 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-6bcd61f1-e7ae-4f8f-a557-5d479df3abe3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:59.112026 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-6bcd61f1-e7ae-4f8f-a557-5d479df3abe3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14" status: 200 len: 1363 microversion: 2.1 time: 0.543208 Dec 16 14:55:59.112950 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 75/141] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:55:58 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14 => generated 1363 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:55:59.229376 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-55804bfb-18a2-4063-84e7-76f905e2149a tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:59.230409 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-55804bfb-18a2-4063-84e7-76f905e2149a tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: bcaa83bc-5d07-413a-88e5-b7428a5b5d46] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:55:59.239721 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-55804bfb-18a2-4063-84e7-76f905e2149a tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:59.240608 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-55804bfb-18a2-4063-84e7-76f905e2149a tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:59.242401 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-55804bfb-18a2-4063-84e7-76f905e2149a tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:59.242909 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-55804bfb-18a2-4063-84e7-76f905e2149a tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:59.365007 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-ad4d8a4a-40c6-4f67-b09f-11c9502b16a2 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:59.366748 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-ad4d8a4a-40c6-4f67-b09f-11c9502b16a2 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] [instance: 8a5137d8-24f6-4b78-abcb-2cf8d939df3e] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:55:59.377922 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ad4d8a4a-40c6-4f67-b09f-11c9502b16a2 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:59.378551 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ad4d8a4a-40c6-4f67-b09f-11c9502b16a2 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:59.379747 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ad4d8a4a-40c6-4f67-b09f-11c9502b16a2 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:59.380681 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ad4d8a4a-40c6-4f67-b09f-11c9502b16a2 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:59.482525 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-55804bfb-18a2-4063-84e7-76f905e2149a tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:59.491701 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-55804bfb-18a2-4063-84e7-76f905e2149a tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46" status: 200 len: 1322 microversion: 2.1 time: 0.271285 Dec 16 14:55:59.492298 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 67/142] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:55:59 2021] GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46 => generated 1322 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:55:59.882595 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-11925150-8900-49a2-9048-f4af64e2a7e8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:55:59.883242 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-11925150-8900-49a2-9048-f4af64e2a7e8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:55:59.885898 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-ad4d8a4a-40c6-4f67-b09f-11c9502b16a2 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7623b303ca8244b58179ef0146dd2bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8372f52bdbf443385cd0058e122fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:55:59.892744 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-11925150-8900-49a2-9048-f4af64e2a7e8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:59.897758 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-11925150-8900-49a2-9048-f4af64e2a7e8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:59.897758 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-11925150-8900-49a2-9048-f4af64e2a7e8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:55:59.897758 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-11925150-8900-49a2-9048-f4af64e2a7e8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:55:59.898226 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-ad4d8a4a-40c6-4f67-b09f-11c9502b16a2 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] 10.222.0.45 "GET /compute/v2.1/servers/8a5137d8-24f6-4b78-abcb-2cf8d939df3e" status: 200 len: 1314 microversion: 2.1 time: 0.542212 Dec 16 14:55:59.898226 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 76/143] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:55:59 2021] GET /compute/v2.1/servers/8a5137d8-24f6-4b78-abcb-2cf8d939df3e => generated 1314 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:00.103570 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-9c15deb5-b938-4714-80a3-37e9366cfcb8 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:00.104635 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-9c15deb5-b938-4714-80a3-37e9366cfcb8 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] [instance: 07dfd5e5-b751-4ebb-a023-9e0dbe8abc65] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:00.112549 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9c15deb5-b938-4714-80a3-37e9366cfcb8 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:00.112714 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9c15deb5-b938-4714-80a3-37e9366cfcb8 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:00.113602 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9c15deb5-b938-4714-80a3-37e9366cfcb8 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:00.114120 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9c15deb5-b938-4714-80a3-37e9366cfcb8 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:00.177521 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-11925150-8900-49a2-9048-f4af64e2a7e8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:00.195075 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-11925150-8900-49a2-9048-f4af64e2a7e8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:00.210913 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-11925150-8900-49a2-9048-f4af64e2a7e8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:00.212109 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-11925150-8900-49a2-9048-f4af64e2a7e8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1405 microversion: 2.20 time: 0.337483 Dec 16 14:56:00.212718 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 68/144] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 14:55:59 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1405 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:56:00.237964 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-3db4b73b-6dd7-4bac-8af6-5e9832f48848 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:00.239397 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-3db4b73b-6dd7-4bac-8af6-5e9832f48848 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:00.256679 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3db4b73b-6dd7-4bac-8af6-5e9832f48848 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:00.257417 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3db4b73b-6dd7-4bac-8af6-5e9832f48848 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:00.258466 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3db4b73b-6dd7-4bac-8af6-5e9832f48848 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:00.259263 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3db4b73b-6dd7-4bac-8af6-5e9832f48848 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:00.539372 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-3db4b73b-6dd7-4bac-8af6-5e9832f48848 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:00.548759 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-3db4b73b-6dd7-4bac-8af6-5e9832f48848 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14" status: 200 len: 1363 microversion: 2.1 time: 0.332203 Dec 16 14:56:00.549539 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 69/145] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:00 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14 => generated 1363 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:00.558912 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-556f1104-b54d-40c6-997d-77af7f883d07 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:00.559717 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-556f1104-b54d-40c6-997d-77af7f883d07 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: bcaa83bc-5d07-413a-88e5-b7428a5b5d46] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:00.567963 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-556f1104-b54d-40c6-997d-77af7f883d07 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:00.568474 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-556f1104-b54d-40c6-997d-77af7f883d07 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:00.569319 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-556f1104-b54d-40c6-997d-77af7f883d07 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:00.569820 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-556f1104-b54d-40c6-997d-77af7f883d07 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:00.683676 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-9c15deb5-b938-4714-80a3-37e9366cfcb8 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e94f83a79ca42c691dc29a189a64a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4732b1ccb145414ba7d9f3d93df9f8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:00.699967 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-9c15deb5-b938-4714-80a3-37e9366cfcb8 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] 10.222.0.45 "GET /compute/v2.1/servers/07dfd5e5-b751-4ebb-a023-9e0dbe8abc65" status: 200 len: 1314 microversion: 2.1 time: 0.604278 Dec 16 14:56:00.700560 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 77/146] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:00 2021] GET /compute/v2.1/servers/07dfd5e5-b751-4ebb-a023-9e0dbe8abc65 => generated 1314 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:56:00.820370 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-556f1104-b54d-40c6-997d-77af7f883d07 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:00.832702 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-556f1104-b54d-40c6-997d-77af7f883d07 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46" status: 200 len: 1322 microversion: 2.1 time: 0.281673 Dec 16 14:56:00.833640 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 70/147] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:00 2021] GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46 => generated 1322 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:00.920366 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-c5cd9731-ab1f-4cfb-95b6-e91b9226ad92 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:00.921042 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-c5cd9731-ab1f-4cfb-95b6-e91b9226ad92 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] [instance: 8a5137d8-24f6-4b78-abcb-2cf8d939df3e] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:00.929762 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c5cd9731-ab1f-4cfb-95b6-e91b9226ad92 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:00.930485 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c5cd9731-ab1f-4cfb-95b6-e91b9226ad92 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:00.931371 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c5cd9731-ab1f-4cfb-95b6-e91b9226ad92 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:00.931866 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c5cd9731-ab1f-4cfb-95b6-e91b9226ad92 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:00.989310 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [req-6830b1b5-1608-4ce0-af79-6a07a78a8c37 req-de908373-17e7-42ba-982f-177ecc79e3fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07dfd5e5-b751-4ebb-a023-9e0dbe8abc65", "tag": "710cb508-8728-4320-ba9e-9fbeb9b340ec"}]} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:56:00.999544 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:56:00.999544 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: warnings.warn(msg) Dec 16 14:56:01.011027 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-6830b1b5-1608-4ce0-af79-6a07a78a8c37 req-de908373-17e7-42ba-982f-177ecc79e3fb service nova] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:01.011027 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-6830b1b5-1608-4ce0-af79-6a07a78a8c37 req-de908373-17e7-42ba-982f-177ecc79e3fb service nova] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:01.030550 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.compute.server_external_events [req-6830b1b5-1608-4ce0-af79-6a07a78a8c37 req-de908373-17e7-42ba-982f-177ecc79e3fb service nova] Creating event network-changed:710cb508-8728-4320-ba9e-9fbeb9b340ec for instance 07dfd5e5-b751-4ebb-a023-9e0dbe8abc65 on hv-cinder-82189 Dec 16 14:56:01.035977 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [req-6830b1b5-1608-4ce0-af79-6a07a78a8c37 req-de908373-17e7-42ba-982f-177ecc79e3fb service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057091 Dec 16 14:56:01.037157 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 71/148] 10.222.0.45 () {64 vars in 1308 bytes} [Thu Dec 16 14:56:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 14:56:01.227564 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-c5cd9731-ab1f-4cfb-95b6-e91b9226ad92 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7623b303ca8244b58179ef0146dd2bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8372f52bdbf443385cd0058e122fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:01.236394 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-3ef79436-a541-42d5-9492-662eff615525 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:01.237143 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-3ef79436-a541-42d5-9492-662eff615525 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:01.240606 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-c5cd9731-ab1f-4cfb-95b6-e91b9226ad92 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] 10.222.0.45 "GET /compute/v2.1/servers/8a5137d8-24f6-4b78-abcb-2cf8d939df3e" status: 200 len: 1314 microversion: 2.1 time: 0.329596 Dec 16 14:56:01.241730 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 78/149] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:00 2021] GET /compute/v2.1/servers/8a5137d8-24f6-4b78-abcb-2cf8d939df3e => generated 1314 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:01.267959 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3ef79436-a541-42d5-9492-662eff615525 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:01.268827 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3ef79436-a541-42d5-9492-662eff615525 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:01.271249 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3ef79436-a541-42d5-9492-662eff615525 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:01.271847 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3ef79436-a541-42d5-9492-662eff615525 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:01.571533 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-1718b5f4-3cc6-4871-b5a9-ba9b2aadfa4b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:01.573119 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-1718b5f4-3cc6-4871-b5a9-ba9b2aadfa4b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:01.582134 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1718b5f4-3cc6-4871-b5a9-ba9b2aadfa4b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:01.582836 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1718b5f4-3cc6-4871-b5a9-ba9b2aadfa4b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:01.584401 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1718b5f4-3cc6-4871-b5a9-ba9b2aadfa4b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:01.584998 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1718b5f4-3cc6-4871-b5a9-ba9b2aadfa4b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:01.602691 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-3ef79436-a541-42d5-9492-662eff615525 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:01.620942 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-3ef79436-a541-42d5-9492-662eff615525 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:01.626838 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-3ef79436-a541-42d5-9492-662eff615525 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:01.628303 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-3ef79436-a541-42d5-9492-662eff615525 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1405 microversion: 2.20 time: 0.400774 Dec 16 14:56:01.629126 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 72/150] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 14:56:01 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1405 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:56:01.722331 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-46dfe2f8-4720-49b4-a293-ef69ecc04b89 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:01.723230 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-46dfe2f8-4720-49b4-a293-ef69ecc04b89 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] [instance: 07dfd5e5-b751-4ebb-a023-9e0dbe8abc65] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:01.731784 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-46dfe2f8-4720-49b4-a293-ef69ecc04b89 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:01.732296 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-46dfe2f8-4720-49b4-a293-ef69ecc04b89 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:01.735829 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-46dfe2f8-4720-49b4-a293-ef69ecc04b89 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:01.736805 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-46dfe2f8-4720-49b4-a293-ef69ecc04b89 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:01.848203 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-1718b5f4-3cc6-4871-b5a9-ba9b2aadfa4b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:01.857695 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-1718b5f4-3cc6-4871-b5a9-ba9b2aadfa4b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14" status: 200 len: 1363 microversion: 2.1 time: 0.293767 Dec 16 14:56:01.858627 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 79/151] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:01 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14 => generated 1363 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:56:01.867235 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-1544bc3d-06b8-4830-a823-4667feb41820 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:01.868174 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-1544bc3d-06b8-4830-a823-4667feb41820 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: bcaa83bc-5d07-413a-88e5-b7428a5b5d46] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:01.876728 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1544bc3d-06b8-4830-a823-4667feb41820 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:01.877226 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1544bc3d-06b8-4830-a823-4667feb41820 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:01.878127 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1544bc3d-06b8-4830-a823-4667feb41820 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:01.878556 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1544bc3d-06b8-4830-a823-4667feb41820 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:02.065883 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-46dfe2f8-4720-49b4-a293-ef69ecc04b89 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e94f83a79ca42c691dc29a189a64a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4732b1ccb145414ba7d9f3d93df9f8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:02.075994 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-46dfe2f8-4720-49b4-a293-ef69ecc04b89 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] 10.222.0.45 "GET /compute/v2.1/servers/07dfd5e5-b751-4ebb-a023-9e0dbe8abc65" status: 200 len: 1314 microversion: 2.1 time: 0.361836 Dec 16 14:56:02.076611 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 73/152] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:01 2021] GET /compute/v2.1/servers/07dfd5e5-b751-4ebb-a023-9e0dbe8abc65 => generated 1314 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:02.144923 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-1544bc3d-06b8-4830-a823-4667feb41820 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:02.153874 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-1544bc3d-06b8-4830-a823-4667feb41820 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46" status: 200 len: 1322 microversion: 2.1 time: 0.293981 Dec 16 14:56:02.156409 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 80/153] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:01 2021] GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46 => generated 1322 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:02.262998 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-6734c4ed-5a20-4257-b4a1-c4a1394e9ba4 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:02.263797 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-6734c4ed-5a20-4257-b4a1-c4a1394e9ba4 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] [instance: 8a5137d8-24f6-4b78-abcb-2cf8d939df3e] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:02.271577 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6734c4ed-5a20-4257-b4a1-c4a1394e9ba4 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:02.272086 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6734c4ed-5a20-4257-b4a1-c4a1394e9ba4 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:02.272971 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6734c4ed-5a20-4257-b4a1-c4a1394e9ba4 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:02.273402 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6734c4ed-5a20-4257-b4a1-c4a1394e9ba4 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:02.652821 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-0956175e-f27e-4a00-8690-ee3acd887aba tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:02.654367 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-0956175e-f27e-4a00-8690-ee3acd887aba tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:02.663248 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0956175e-f27e-4a00-8690-ee3acd887aba tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:02.664020 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0956175e-f27e-4a00-8690-ee3acd887aba tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:02.664955 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0956175e-f27e-4a00-8690-ee3acd887aba tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:02.665525 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0956175e-f27e-4a00-8690-ee3acd887aba tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:02.772354 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-6734c4ed-5a20-4257-b4a1-c4a1394e9ba4 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7623b303ca8244b58179ef0146dd2bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8372f52bdbf443385cd0058e122fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:02.785504 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-6734c4ed-5a20-4257-b4a1-c4a1394e9ba4 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] 10.222.0.45 "GET /compute/v2.1/servers/8a5137d8-24f6-4b78-abcb-2cf8d939df3e" status: 200 len: 1314 microversion: 2.1 time: 0.530632 Dec 16 14:56:02.786442 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 74/154] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:02 2021] GET /compute/v2.1/servers/8a5137d8-24f6-4b78-abcb-2cf8d939df3e => generated 1314 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:02.880081 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-c96b41b9-f373-47ca-a43a-85e4b8d7634d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:02.880731 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-c96b41b9-f373-47ca-a43a-85e4b8d7634d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:02.889462 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c96b41b9-f373-47ca-a43a-85e4b8d7634d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:02.889973 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c96b41b9-f373-47ca-a43a-85e4b8d7634d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:02.890882 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c96b41b9-f373-47ca-a43a-85e4b8d7634d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:02.891363 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c96b41b9-f373-47ca-a43a-85e4b8d7634d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:02.991665 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-0956175e-f27e-4a00-8690-ee3acd887aba tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:03.007656 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-0956175e-f27e-4a00-8690-ee3acd887aba tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:03.012787 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-0956175e-f27e-4a00-8690-ee3acd887aba tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:03.014156 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-0956175e-f27e-4a00-8690-ee3acd887aba tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1405 microversion: 2.20 time: 0.369894 Dec 16 14:56:03.030728 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 81/155] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 14:56:02 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1405 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:56:03.101716 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-c23aeb9a-bbae-4e4d-93fb-7b0f48372b9b tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:03.102876 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-c23aeb9a-bbae-4e4d-93fb-7b0f48372b9b tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] [instance: 07dfd5e5-b751-4ebb-a023-9e0dbe8abc65] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:03.112456 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c23aeb9a-bbae-4e4d-93fb-7b0f48372b9b tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:03.112971 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c23aeb9a-bbae-4e4d-93fb-7b0f48372b9b tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:03.113995 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c23aeb9a-bbae-4e4d-93fb-7b0f48372b9b tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:03.114545 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c23aeb9a-bbae-4e4d-93fb-7b0f48372b9b tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:03.147333 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-c96b41b9-f373-47ca-a43a-85e4b8d7634d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:03.157142 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-c96b41b9-f373-47ca-a43a-85e4b8d7634d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14" status: 200 len: 1363 microversion: 2.1 time: 0.284829 Dec 16 14:56:03.157928 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 75/156] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:02 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14 => generated 1363 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:03.179851 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-7988c9ad-4d88-4e4a-a395-2505576e0196 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:03.180531 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-7988c9ad-4d88-4e4a-a395-2505576e0196 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: bcaa83bc-5d07-413a-88e5-b7428a5b5d46] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:03.189411 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7988c9ad-4d88-4e4a-a395-2505576e0196 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:03.195823 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7988c9ad-4d88-4e4a-a395-2505576e0196 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:03.195823 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7988c9ad-4d88-4e4a-a395-2505576e0196 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:03.195823 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7988c9ad-4d88-4e4a-a395-2505576e0196 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:03.386144 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-c23aeb9a-bbae-4e4d-93fb-7b0f48372b9b tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e94f83a79ca42c691dc29a189a64a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4732b1ccb145414ba7d9f3d93df9f8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:03.396705 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-c23aeb9a-bbae-4e4d-93fb-7b0f48372b9b tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] 10.222.0.45 "GET /compute/v2.1/servers/07dfd5e5-b751-4ebb-a023-9e0dbe8abc65" status: 200 len: 1314 microversion: 2.1 time: 0.305072 Dec 16 14:56:03.397375 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 82/157] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:03 2021] GET /compute/v2.1/servers/07dfd5e5-b751-4ebb-a023-9e0dbe8abc65 => generated 1314 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:56:03.540973 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-7988c9ad-4d88-4e4a-a395-2505576e0196 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:03.550388 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-7988c9ad-4d88-4e4a-a395-2505576e0196 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46" status: 200 len: 1322 microversion: 2.1 time: 0.379356 Dec 16 14:56:03.550970 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 76/158] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:03 2021] GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46 => generated 1322 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:56:03.812644 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-670cccf1-5deb-49f8-b74a-6162af719d5b tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:03.812644 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-670cccf1-5deb-49f8-b74a-6162af719d5b tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] [instance: 8a5137d8-24f6-4b78-abcb-2cf8d939df3e] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:03.817179 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-670cccf1-5deb-49f8-b74a-6162af719d5b tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:03.817678 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-670cccf1-5deb-49f8-b74a-6162af719d5b tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:03.818539 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-670cccf1-5deb-49f8-b74a-6162af719d5b tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:03.819027 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-670cccf1-5deb-49f8-b74a-6162af719d5b tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:04.036748 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-d040e327-6e91-45f6-9895-3a77d9146f84 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:04.037408 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-d040e327-6e91-45f6-9895-3a77d9146f84 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:04.053516 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d040e327-6e91-45f6-9895-3a77d9146f84 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:04.053516 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d040e327-6e91-45f6-9895-3a77d9146f84 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:04.053516 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d040e327-6e91-45f6-9895-3a77d9146f84 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:04.053516 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d040e327-6e91-45f6-9895-3a77d9146f84 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:04.055678 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-670cccf1-5deb-49f8-b74a-6162af719d5b tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7623b303ca8244b58179ef0146dd2bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8372f52bdbf443385cd0058e122fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:04.065798 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-670cccf1-5deb-49f8-b74a-6162af719d5b tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] 10.222.0.45 "GET /compute/v2.1/servers/8a5137d8-24f6-4b78-abcb-2cf8d939df3e" status: 200 len: 1314 microversion: 2.1 time: 0.265598 Dec 16 14:56:04.066613 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 83/159] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:03 2021] GET /compute/v2.1/servers/8a5137d8-24f6-4b78-abcb-2cf8d939df3e => generated 1314 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:04.179710 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-0e5b161d-dd66-4dec-9f0b-19604ae78b49 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:04.180344 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-0e5b161d-dd66-4dec-9f0b-19604ae78b49 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:04.196984 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0e5b161d-dd66-4dec-9f0b-19604ae78b49 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:04.197492 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0e5b161d-dd66-4dec-9f0b-19604ae78b49 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:04.198528 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0e5b161d-dd66-4dec-9f0b-19604ae78b49 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:04.199207 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0e5b161d-dd66-4dec-9f0b-19604ae78b49 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:04.301348 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-d040e327-6e91-45f6-9895-3a77d9146f84 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:04.316313 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-d040e327-6e91-45f6-9895-3a77d9146f84 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:04.321144 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-d040e327-6e91-45f6-9895-3a77d9146f84 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:04.322536 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-d040e327-6e91-45f6-9895-3a77d9146f84 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1405 microversion: 2.20 time: 0.293642 Dec 16 14:56:04.323439 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 77/160] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 14:56:04 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1405 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 14:56:04.424019 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-a821f1b6-77d5-403a-8199-b6e918b35b0d tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:04.424700 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-a821f1b6-77d5-403a-8199-b6e918b35b0d tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] [instance: 07dfd5e5-b751-4ebb-a023-9e0dbe8abc65] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:04.449485 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a821f1b6-77d5-403a-8199-b6e918b35b0d tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:04.450236 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a821f1b6-77d5-403a-8199-b6e918b35b0d tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:04.451110 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a821f1b6-77d5-403a-8199-b6e918b35b0d tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:04.451610 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a821f1b6-77d5-403a-8199-b6e918b35b0d tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:04.499930 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-0e5b161d-dd66-4dec-9f0b-19604ae78b49 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:04.512013 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-0e5b161d-dd66-4dec-9f0b-19604ae78b49 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14" status: 200 len: 1363 microversion: 2.1 time: 0.339544 Dec 16 14:56:04.513090 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 84/161] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:04 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14 => generated 1363 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:56:04.576562 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-7d14606d-afcb-49f9-9598-551a37838419 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:04.577691 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-7d14606d-afcb-49f9-9598-551a37838419 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: bcaa83bc-5d07-413a-88e5-b7428a5b5d46] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:04.596683 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7d14606d-afcb-49f9-9598-551a37838419 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:04.599826 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7d14606d-afcb-49f9-9598-551a37838419 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:04.601123 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7d14606d-afcb-49f9-9598-551a37838419 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:04.601726 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7d14606d-afcb-49f9-9598-551a37838419 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:04.881276 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-a821f1b6-77d5-403a-8199-b6e918b35b0d tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e94f83a79ca42c691dc29a189a64a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4732b1ccb145414ba7d9f3d93df9f8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:04.897335 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-a821f1b6-77d5-403a-8199-b6e918b35b0d tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] 10.222.0.45 "GET /compute/v2.1/servers/07dfd5e5-b751-4ebb-a023-9e0dbe8abc65" status: 200 len: 1314 microversion: 2.1 time: 0.482074 Dec 16 14:56:04.898151 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 78/162] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:04 2021] GET /compute/v2.1/servers/07dfd5e5-b751-4ebb-a023-9e0dbe8abc65 => generated 1314 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:56:05.097131 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-cc484715-ac86-410c-ad77-8553cd856904 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:05.098135 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-cc484715-ac86-410c-ad77-8553cd856904 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] [instance: 8a5137d8-24f6-4b78-abcb-2cf8d939df3e] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:05.112565 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cc484715-ac86-410c-ad77-8553cd856904 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:05.113339 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cc484715-ac86-410c-ad77-8553cd856904 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:05.114550 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cc484715-ac86-410c-ad77-8553cd856904 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:05.115411 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cc484715-ac86-410c-ad77-8553cd856904 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:05.299401 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-7d14606d-afcb-49f9-9598-551a37838419 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:05.311937 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-7d14606d-afcb-49f9-9598-551a37838419 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46" status: 200 len: 1322 microversion: 2.1 time: 0.746439 Dec 16 14:56:05.312561 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 85/163] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:04 2021] GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46 => generated 1322 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:56:05.368036 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-3b699b5e-b3db-4dab-a10a-483520d15618 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:05.368738 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-3b699b5e-b3db-4dab-a10a-483520d15618 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:05.396845 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3b699b5e-b3db-4dab-a10a-483520d15618 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:05.397360 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3b699b5e-b3db-4dab-a10a-483520d15618 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:05.398415 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3b699b5e-b3db-4dab-a10a-483520d15618 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:05.398925 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3b699b5e-b3db-4dab-a10a-483520d15618 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:05.444901 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-cc484715-ac86-410c-ad77-8553cd856904 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7623b303ca8244b58179ef0146dd2bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8372f52bdbf443385cd0058e122fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:05.454685 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-cc484715-ac86-410c-ad77-8553cd856904 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] 10.222.0.45 "GET /compute/v2.1/servers/8a5137d8-24f6-4b78-abcb-2cf8d939df3e" status: 200 len: 1314 microversion: 2.1 time: 0.374655 Dec 16 14:56:05.478325 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 79/164] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:05 2021] GET /compute/v2.1/servers/8a5137d8-24f6-4b78-abcb-2cf8d939df3e => generated 1314 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:05.537630 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-cedf3407-108b-4e87-a9f1-9dfcc83f2b66 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:05.538815 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-cedf3407-108b-4e87-a9f1-9dfcc83f2b66 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:05.553399 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cedf3407-108b-4e87-a9f1-9dfcc83f2b66 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:05.554171 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cedf3407-108b-4e87-a9f1-9dfcc83f2b66 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:05.555707 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cedf3407-108b-4e87-a9f1-9dfcc83f2b66 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:05.556498 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cedf3407-108b-4e87-a9f1-9dfcc83f2b66 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:05.810655 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-3b699b5e-b3db-4dab-a10a-483520d15618 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:05.814491 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-cedf3407-108b-4e87-a9f1-9dfcc83f2b66 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:05.824662 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-3b699b5e-b3db-4dab-a10a-483520d15618 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:05.825768 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-cedf3407-108b-4e87-a9f1-9dfcc83f2b66 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14" status: 200 len: 1363 microversion: 2.1 time: 0.298749 Dec 16 14:56:05.826533 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 80/165] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:05 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14 => generated 1363 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:05.829561 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-3b699b5e-b3db-4dab-a10a-483520d15618 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:05.830861 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-3b699b5e-b3db-4dab-a10a-483520d15618 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1405 microversion: 2.20 time: 0.492264 Dec 16 14:56:05.842664 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 86/166] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 14:56:05 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1405 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:56:05.919599 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-db427da3-073a-4b1c-b385-bb4e691ec3f6 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:05.920408 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-db427da3-073a-4b1c-b385-bb4e691ec3f6 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] [instance: 07dfd5e5-b751-4ebb-a023-9e0dbe8abc65] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:05.929110 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-db427da3-073a-4b1c-b385-bb4e691ec3f6 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:05.929899 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-db427da3-073a-4b1c-b385-bb4e691ec3f6 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:05.930898 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-db427da3-073a-4b1c-b385-bb4e691ec3f6 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:05.931501 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-db427da3-073a-4b1c-b385-bb4e691ec3f6 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:06.266926 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-db427da3-073a-4b1c-b385-bb4e691ec3f6 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e94f83a79ca42c691dc29a189a64a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4732b1ccb145414ba7d9f3d93df9f8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:06.276894 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-db427da3-073a-4b1c-b385-bb4e691ec3f6 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] 10.222.0.45 "GET /compute/v2.1/servers/07dfd5e5-b751-4ebb-a023-9e0dbe8abc65" status: 200 len: 1314 microversion: 2.1 time: 0.365595 Dec 16 14:56:06.277473 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 81/167] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:05 2021] GET /compute/v2.1/servers/07dfd5e5-b751-4ebb-a023-9e0dbe8abc65 => generated 1314 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:06.333922 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-ca6e531f-b1c3-4ce8-b170-5be8c8643101 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:06.334478 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-ca6e531f-b1c3-4ce8-b170-5be8c8643101 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: bcaa83bc-5d07-413a-88e5-b7428a5b5d46] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:06.344025 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ca6e531f-b1c3-4ce8-b170-5be8c8643101 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:06.344691 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ca6e531f-b1c3-4ce8-b170-5be8c8643101 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:06.345367 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ca6e531f-b1c3-4ce8-b170-5be8c8643101 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:06.345889 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ca6e531f-b1c3-4ce8-b170-5be8c8643101 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:06.478021 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-9eaff5fb-b881-4c56-8ade-8605bacc51cf tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:06.478706 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-9eaff5fb-b881-4c56-8ade-8605bacc51cf tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] [instance: 8a5137d8-24f6-4b78-abcb-2cf8d939df3e] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:06.496030 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9eaff5fb-b881-4c56-8ade-8605bacc51cf tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:06.496537 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9eaff5fb-b881-4c56-8ade-8605bacc51cf tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:06.497387 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9eaff5fb-b881-4c56-8ade-8605bacc51cf tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:06.498102 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9eaff5fb-b881-4c56-8ade-8605bacc51cf tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:06.641377 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-ca6e531f-b1c3-4ce8-b170-5be8c8643101 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:06.657449 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-ca6e531f-b1c3-4ce8-b170-5be8c8643101 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46" status: 200 len: 1322 microversion: 2.1 time: 0.332224 Dec 16 14:56:06.660507 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 87/168] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:06 2021] GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46 => generated 1322 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:06.811629 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-9eaff5fb-b881-4c56-8ade-8605bacc51cf tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7623b303ca8244b58179ef0146dd2bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8372f52bdbf443385cd0058e122fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:06.822720 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-9eaff5fb-b881-4c56-8ade-8605bacc51cf tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] 10.222.0.45 "GET /compute/v2.1/servers/8a5137d8-24f6-4b78-abcb-2cf8d939df3e" status: 200 len: 1314 microversion: 2.1 time: 0.351486 Dec 16 14:56:06.823334 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 82/169] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:06 2021] GET /compute/v2.1/servers/8a5137d8-24f6-4b78-abcb-2cf8d939df3e => generated 1314 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:06.853393 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-710be4d3-bf01-432d-af0b-3379bf610fcc tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:06.858375 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-08863e4a-6561-4583-8f46-e83b0cdae012 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:06.858883 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-08863e4a-6561-4583-8f46-e83b0cdae012 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:06.859399 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-710be4d3-bf01-432d-af0b-3379bf610fcc tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:06.885646 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-08863e4a-6561-4583-8f46-e83b0cdae012 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:06.885646 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-08863e4a-6561-4583-8f46-e83b0cdae012 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:06.885646 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-08863e4a-6561-4583-8f46-e83b0cdae012 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:06.885646 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-08863e4a-6561-4583-8f46-e83b0cdae012 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:06.885981 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-710be4d3-bf01-432d-af0b-3379bf610fcc tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:06.885981 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-710be4d3-bf01-432d-af0b-3379bf610fcc tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:06.885981 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-710be4d3-bf01-432d-af0b-3379bf610fcc tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:06.885981 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-710be4d3-bf01-432d-af0b-3379bf610fcc tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:07.183207 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-710be4d3-bf01-432d-af0b-3379bf610fcc tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:07.194146 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-710be4d3-bf01-432d-af0b-3379bf610fcc tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14" status: 200 len: 1363 microversion: 2.1 time: 0.351641 Dec 16 14:56:07.194736 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 88/170] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:06 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14 => generated 1363 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:07.238614 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-08863e4a-6561-4583-8f46-e83b0cdae012 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:07.252724 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-08863e4a-6561-4583-8f46-e83b0cdae012 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:07.258767 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-08863e4a-6561-4583-8f46-e83b0cdae012 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:07.260219 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-08863e4a-6561-4583-8f46-e83b0cdae012 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1405 microversion: 2.20 time: 0.414308 Dec 16 14:56:07.264612 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 83/171] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 14:56:06 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1405 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 14:56:07.299805 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-a994de12-f097-4f7d-a29f-8b285420d679 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:07.300921 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-a994de12-f097-4f7d-a29f-8b285420d679 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] [instance: 07dfd5e5-b751-4ebb-a023-9e0dbe8abc65] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:07.311070 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a994de12-f097-4f7d-a29f-8b285420d679 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:07.312470 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a994de12-f097-4f7d-a29f-8b285420d679 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:07.313471 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a994de12-f097-4f7d-a29f-8b285420d679 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:07.314374 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a994de12-f097-4f7d-a29f-8b285420d679 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:07.618090 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-a994de12-f097-4f7d-a29f-8b285420d679 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e94f83a79ca42c691dc29a189a64a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4732b1ccb145414ba7d9f3d93df9f8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:07.627434 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-a994de12-f097-4f7d-a29f-8b285420d679 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] 10.222.0.45 "GET /compute/v2.1/servers/07dfd5e5-b751-4ebb-a023-9e0dbe8abc65" status: 200 len: 1314 microversion: 2.1 time: 0.335698 Dec 16 14:56:07.634239 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 89/172] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:07 2021] GET /compute/v2.1/servers/07dfd5e5-b751-4ebb-a023-9e0dbe8abc65 => generated 1314 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:07.682769 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-20d742be-bbab-4ea8-98a2-7c1dd4476bdb tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:07.683898 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-20d742be-bbab-4ea8-98a2-7c1dd4476bdb tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: bcaa83bc-5d07-413a-88e5-b7428a5b5d46] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:07.694553 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-20d742be-bbab-4ea8-98a2-7c1dd4476bdb tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:07.697336 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-20d742be-bbab-4ea8-98a2-7c1dd4476bdb tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:07.697831 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-20d742be-bbab-4ea8-98a2-7c1dd4476bdb tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:07.698492 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-20d742be-bbab-4ea8-98a2-7c1dd4476bdb tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:07.849706 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-c20efc62-302b-4540-b50d-2111bdbf1fdd tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:07.850689 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-c20efc62-302b-4540-b50d-2111bdbf1fdd tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] [instance: 8a5137d8-24f6-4b78-abcb-2cf8d939df3e] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:07.860437 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c20efc62-302b-4540-b50d-2111bdbf1fdd tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:07.861214 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c20efc62-302b-4540-b50d-2111bdbf1fdd tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:07.862270 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c20efc62-302b-4540-b50d-2111bdbf1fdd tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:07.862745 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c20efc62-302b-4540-b50d-2111bdbf1fdd tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:07.947805 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-20d742be-bbab-4ea8-98a2-7c1dd4476bdb tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:07.957607 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-20d742be-bbab-4ea8-98a2-7c1dd4476bdb tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46" status: 200 len: 1322 microversion: 2.1 time: 0.283978 Dec 16 14:56:07.958213 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 84/173] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:07 2021] GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46 => generated 1322 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:08.102329 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [req-1a930d4b-5c0e-4748-8c08-970c42618966 req-b6e2f4a1-7748-475c-9126-9b3ee41a249d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a5137d8-24f6-4b78-abcb-2cf8d939df3e", "name": "network-vif-plugged", "status": "completed", "tag": "fe38e090-8b64-4c8e-9be5-fa79544d452c"}]} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:56:08.107226 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:56:08.107226 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: warnings.warn(msg) Dec 16 14:56:08.116962 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-1a930d4b-5c0e-4748-8c08-970c42618966 req-b6e2f4a1-7748-475c-9126-9b3ee41a249d service nova] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:08.118471 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-1a930d4b-5c0e-4748-8c08-970c42618966 req-b6e2f4a1-7748-475c-9126-9b3ee41a249d service nova] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:08.126005 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-c20efc62-302b-4540-b50d-2111bdbf1fdd tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7623b303ca8244b58179ef0146dd2bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8372f52bdbf443385cd0058e122fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:08.136779 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-c20efc62-302b-4540-b50d-2111bdbf1fdd tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] 10.222.0.45 "GET /compute/v2.1/servers/8a5137d8-24f6-4b78-abcb-2cf8d939df3e" status: 200 len: 1314 microversion: 2.1 time: 0.300786 Dec 16 14:56:08.137758 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 90/174] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:07 2021] GET /compute/v2.1/servers/8a5137d8-24f6-4b78-abcb-2cf8d939df3e => generated 1314 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:08.139874 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.compute.server_external_events [req-1a930d4b-5c0e-4748-8c08-970c42618966 req-b6e2f4a1-7748-475c-9126-9b3ee41a249d service nova] Creating event network-vif-plugged:fe38e090-8b64-4c8e-9be5-fa79544d452c for instance 8a5137d8-24f6-4b78-abcb-2cf8d939df3e on hv-cinder-82189 Dec 16 14:56:08.150382 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [req-1a930d4b-5c0e-4748-8c08-970c42618966 req-b6e2f4a1-7748-475c-9126-9b3ee41a249d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.185352 Dec 16 14:56:08.150702 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 85/175] 10.222.0.45 () {64 vars in 1308 bytes} [Thu Dec 16 14:56:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:56:08.218668 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-a2673e83-b8f5-45cf-86b5-1e2820ee2c28 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:08.219674 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-a2673e83-b8f5-45cf-86b5-1e2820ee2c28 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:08.229318 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a2673e83-b8f5-45cf-86b5-1e2820ee2c28 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:08.229903 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a2673e83-b8f5-45cf-86b5-1e2820ee2c28 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:08.230862 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a2673e83-b8f5-45cf-86b5-1e2820ee2c28 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:08.231422 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a2673e83-b8f5-45cf-86b5-1e2820ee2c28 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:08.287713 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-9bad4f3f-ae80-4869-b256-3caa9d6e861a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:08.288688 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-9bad4f3f-ae80-4869-b256-3caa9d6e861a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:08.307579 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9bad4f3f-ae80-4869-b256-3caa9d6e861a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:08.308336 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9bad4f3f-ae80-4869-b256-3caa9d6e861a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:08.315615 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9bad4f3f-ae80-4869-b256-3caa9d6e861a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:08.315615 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9bad4f3f-ae80-4869-b256-3caa9d6e861a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:08.650394 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-9bad4f3f-ae80-4869-b256-3caa9d6e861a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:08.669936 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-9bad4f3f-ae80-4869-b256-3caa9d6e861a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:08.674762 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-9bad4f3f-ae80-4869-b256-3caa9d6e861a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:08.676747 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-9bad4f3f-ae80-4869-b256-3caa9d6e861a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1405 microversion: 2.20 time: 0.398713 Dec 16 14:56:08.677588 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 86/176] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 14:56:08 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1405 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 14:56:08.690337 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-a2673e83-b8f5-45cf-86b5-1e2820ee2c28 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:08.702187 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-ebcba51f-de5d-41fe-8fee-37832804af01 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:08.705145 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-ebcba51f-de5d-41fe-8fee-37832804af01 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] [instance: 07dfd5e5-b751-4ebb-a023-9e0dbe8abc65] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:08.707516 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-a2673e83-b8f5-45cf-86b5-1e2820ee2c28 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14" status: 200 len: 1363 microversion: 2.1 time: 0.497477 Dec 16 14:56:08.708318 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 91/177] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:08 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14 => generated 1363 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:08.724297 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ebcba51f-de5d-41fe-8fee-37832804af01 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:08.726596 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ebcba51f-de5d-41fe-8fee-37832804af01 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:08.731035 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ebcba51f-de5d-41fe-8fee-37832804af01 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:08.731917 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ebcba51f-de5d-41fe-8fee-37832804af01 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:08.981566 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-e4243c22-ea52-49be-aadb-9b99b093e6a6 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:08.987176 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-e4243c22-ea52-49be-aadb-9b99b093e6a6 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: bcaa83bc-5d07-413a-88e5-b7428a5b5d46] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:08.998781 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e4243c22-ea52-49be-aadb-9b99b093e6a6 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:09.004000 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e4243c22-ea52-49be-aadb-9b99b093e6a6 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:09.004914 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e4243c22-ea52-49be-aadb-9b99b093e6a6 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:09.005426 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e4243c22-ea52-49be-aadb-9b99b093e6a6 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:09.053861 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-ebcba51f-de5d-41fe-8fee-37832804af01 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e94f83a79ca42c691dc29a189a64a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4732b1ccb145414ba7d9f3d93df9f8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:09.065115 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-ebcba51f-de5d-41fe-8fee-37832804af01 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] 10.222.0.45 "GET /compute/v2.1/servers/07dfd5e5-b751-4ebb-a023-9e0dbe8abc65" status: 200 len: 1314 microversion: 2.1 time: 0.385761 Dec 16 14:56:09.065722 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 87/178] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:08 2021] GET /compute/v2.1/servers/07dfd5e5-b751-4ebb-a023-9e0dbe8abc65 => generated 1314 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:09.162092 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-edf7407c-69cc-4303-81e8-54a37825928f tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:09.164544 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-edf7407c-69cc-4303-81e8-54a37825928f tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] [instance: 8a5137d8-24f6-4b78-abcb-2cf8d939df3e] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:09.186147 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-edf7407c-69cc-4303-81e8-54a37825928f tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:09.190364 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-edf7407c-69cc-4303-81e8-54a37825928f tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:09.194197 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-edf7407c-69cc-4303-81e8-54a37825928f tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:09.195025 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-edf7407c-69cc-4303-81e8-54a37825928f tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:09.466058 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-e4243c22-ea52-49be-aadb-9b99b093e6a6 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:09.481222 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-e4243c22-ea52-49be-aadb-9b99b093e6a6 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46" status: 200 len: 1322 microversion: 2.1 time: 0.509007 Dec 16 14:56:09.487071 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 92/179] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:08 2021] GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46 => generated 1322 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:56:09.548207 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-edf7407c-69cc-4303-81e8-54a37825928f tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7623b303ca8244b58179ef0146dd2bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8372f52bdbf443385cd0058e122fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:09.561121 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-edf7407c-69cc-4303-81e8-54a37825928f tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] 10.222.0.45 "GET /compute/v2.1/servers/8a5137d8-24f6-4b78-abcb-2cf8d939df3e" status: 200 len: 1314 microversion: 2.1 time: 0.409293 Dec 16 14:56:09.562366 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 88/180] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:09 2021] GET /compute/v2.1/servers/8a5137d8-24f6-4b78-abcb-2cf8d939df3e => generated 1314 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:09.699959 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-14c6fb7e-86f7-4458-9266-ecf8bad5b56f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:09.700623 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-14c6fb7e-86f7-4458-9266-ecf8bad5b56f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:09.708957 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-14c6fb7e-86f7-4458-9266-ecf8bad5b56f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:09.709711 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-14c6fb7e-86f7-4458-9266-ecf8bad5b56f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:09.710772 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-14c6fb7e-86f7-4458-9266-ecf8bad5b56f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:09.711446 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-14c6fb7e-86f7-4458-9266-ecf8bad5b56f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:09.730412 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-ce767895-1dce-4ad9-9de3-770476fd0fea tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:09.731017 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-ce767895-1dce-4ad9-9de3-770476fd0fea tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:09.752358 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ce767895-1dce-4ad9-9de3-770476fd0fea tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:09.752911 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ce767895-1dce-4ad9-9de3-770476fd0fea tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:09.756343 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ce767895-1dce-4ad9-9de3-770476fd0fea tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:09.756875 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ce767895-1dce-4ad9-9de3-770476fd0fea tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:10.129324 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-ce767895-1dce-4ad9-9de3-770476fd0fea tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:10.129324 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-ce767895-1dce-4ad9-9de3-770476fd0fea tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14" status: 200 len: 1363 microversion: 2.1 time: 0.342554 Dec 16 14:56:10.129324 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 89/181] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:09 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14 => generated 1363 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:10.130236 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-14c6fb7e-86f7-4458-9266-ecf8bad5b56f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:10.130236 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-14c6fb7e-86f7-4458-9266-ecf8bad5b56f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:10.131026 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-14c6fb7e-86f7-4458-9266-ecf8bad5b56f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:10.131026 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-14c6fb7e-86f7-4458-9266-ecf8bad5b56f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1405 microversion: 2.20 time: 0.395107 Dec 16 14:56:10.131797 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-2e79132c-11bb-4abd-9056-3d217337e8af tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:10.132011 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 93/182] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 14:56:09 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1405 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:56:10.132308 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-2e79132c-11bb-4abd-9056-3d217337e8af tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] [instance: 07dfd5e5-b751-4ebb-a023-9e0dbe8abc65] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:10.132308 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2e79132c-11bb-4abd-9056-3d217337e8af tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:10.132308 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2e79132c-11bb-4abd-9056-3d217337e8af tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:10.132308 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2e79132c-11bb-4abd-9056-3d217337e8af tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:10.132688 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2e79132c-11bb-4abd-9056-3d217337e8af tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:10.173945 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [req-fcdc1ce0-88c4-477b-a60a-288f549e36e2 req-095f5ff4-43c3-454b-acdd-f580ad3b834e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcaa83bc-5d07-413a-88e5-b7428a5b5d46", "name": "network-vif-plugged", "status": "completed", "tag": "bfc221af-2174-4f65-91cd-8eeec277367d"}]} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:56:10.177128 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:56:10.177128 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: warnings.warn(msg) Dec 16 14:56:10.186791 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-fcdc1ce0-88c4-477b-a60a-288f549e36e2 req-095f5ff4-43c3-454b-acdd-f580ad3b834e service nova] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:10.187277 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-fcdc1ce0-88c4-477b-a60a-288f549e36e2 req-095f5ff4-43c3-454b-acdd-f580ad3b834e service nova] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:10.206472 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.compute.server_external_events [req-fcdc1ce0-88c4-477b-a60a-288f549e36e2 req-095f5ff4-43c3-454b-acdd-f580ad3b834e service nova] Creating event network-vif-plugged:bfc221af-2174-4f65-91cd-8eeec277367d for instance bcaa83bc-5d07-413a-88e5-b7428a5b5d46 on hv-cinder-82189 Dec 16 14:56:10.211810 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [req-fcdc1ce0-88c4-477b-a60a-288f549e36e2 req-095f5ff4-43c3-454b-acdd-f580ad3b834e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047250 Dec 16 14:56:10.212486 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 94/183] 10.222.0.45 () {64 vars in 1308 bytes} [Thu Dec 16 14:56:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 14:56:10.329389 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-2e79132c-11bb-4abd-9056-3d217337e8af tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e94f83a79ca42c691dc29a189a64a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4732b1ccb145414ba7d9f3d93df9f8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:10.339156 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-2e79132c-11bb-4abd-9056-3d217337e8af tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] 10.222.0.45 "GET /compute/v2.1/servers/07dfd5e5-b751-4ebb-a023-9e0dbe8abc65" status: 200 len: 1314 microversion: 2.1 time: 0.260177 Dec 16 14:56:10.339951 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 90/184] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:10 2021] GET /compute/v2.1/servers/07dfd5e5-b751-4ebb-a023-9e0dbe8abc65 => generated 1314 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:10.512356 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-d4f22651-0cba-439a-90e3-30f274447914 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:10.513113 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-d4f22651-0cba-439a-90e3-30f274447914 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: bcaa83bc-5d07-413a-88e5-b7428a5b5d46] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:10.521627 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d4f22651-0cba-439a-90e3-30f274447914 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:10.522297 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d4f22651-0cba-439a-90e3-30f274447914 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:10.523161 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d4f22651-0cba-439a-90e3-30f274447914 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:10.523435 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d4f22651-0cba-439a-90e3-30f274447914 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:10.585415 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-8d754c4d-3e75-4755-b5e0-5a9ee5ce055a tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:10.586103 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-8d754c4d-3e75-4755-b5e0-5a9ee5ce055a tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] [instance: 8a5137d8-24f6-4b78-abcb-2cf8d939df3e] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:10.606909 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8d754c4d-3e75-4755-b5e0-5a9ee5ce055a tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:10.607403 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8d754c4d-3e75-4755-b5e0-5a9ee5ce055a tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:10.608247 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8d754c4d-3e75-4755-b5e0-5a9ee5ce055a tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:10.608730 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8d754c4d-3e75-4755-b5e0-5a9ee5ce055a tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:10.910577 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-8d754c4d-3e75-4755-b5e0-5a9ee5ce055a tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7623b303ca8244b58179ef0146dd2bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8372f52bdbf443385cd0058e122fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:10.919892 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-d4f22651-0cba-439a-90e3-30f274447914 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:10.920689 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-8d754c4d-3e75-4755-b5e0-5a9ee5ce055a tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] 10.222.0.45 "GET /compute/v2.1/servers/8a5137d8-24f6-4b78-abcb-2cf8d939df3e" status: 200 len: 1314 microversion: 2.1 time: 0.343668 Dec 16 14:56:10.921454 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 91/185] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:10 2021] GET /compute/v2.1/servers/8a5137d8-24f6-4b78-abcb-2cf8d939df3e => generated 1314 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:10.942191 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-d4f22651-0cba-439a-90e3-30f274447914 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46" status: 200 len: 1322 microversion: 2.1 time: 0.433043 Dec 16 14:56:10.942191 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 95/186] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:10 2021] GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46 => generated 1322 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:11.144421 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-ed85ecd2-a177-4067-8c84-3c105944b092 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:11.145080 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-ed85ecd2-a177-4067-8c84-3c105944b092 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:11.153235 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ed85ecd2-a177-4067-8c84-3c105944b092 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:11.153557 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-65a799e0-8bd3-4cef-aa2f-55bfbf685912 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:11.153847 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ed85ecd2-a177-4067-8c84-3c105944b092 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:11.154277 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-65a799e0-8bd3-4cef-aa2f-55bfbf685912 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:11.154713 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ed85ecd2-a177-4067-8c84-3c105944b092 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:11.155208 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ed85ecd2-a177-4067-8c84-3c105944b092 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:11.162682 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-65a799e0-8bd3-4cef-aa2f-55bfbf685912 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:11.163136 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-65a799e0-8bd3-4cef-aa2f-55bfbf685912 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:11.163981 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-65a799e0-8bd3-4cef-aa2f-55bfbf685912 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:11.164474 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-65a799e0-8bd3-4cef-aa2f-55bfbf685912 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:11.406800 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-65a799e0-8bd3-4cef-aa2f-55bfbf685912 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:11.417822 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-ed85ecd2-a177-4067-8c84-3c105944b092 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:11.421237 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-65a799e0-8bd3-4cef-aa2f-55bfbf685912 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:11.426290 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-65a799e0-8bd3-4cef-aa2f-55bfbf685912 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:11.426597 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-ed85ecd2-a177-4067-8c84-3c105944b092 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14" status: 200 len: 1363 microversion: 2.1 time: 0.289849 Dec 16 14:56:11.427176 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 92/187] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:11 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14 => generated 1363 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:11.427449 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-65a799e0-8bd3-4cef-aa2f-55bfbf685912 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1405 microversion: 2.20 time: 0.282642 Dec 16 14:56:11.428194 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 96/188] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 14:56:11 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1405 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 14:56:11.442457 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-acb3cc9a-c4d8-4a46-9859-217e5f1a479c tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:11.443209 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-acb3cc9a-c4d8-4a46-9859-217e5f1a479c tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] [instance: 07dfd5e5-b751-4ebb-a023-9e0dbe8abc65] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:11.451814 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-acb3cc9a-c4d8-4a46-9859-217e5f1a479c tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:11.452319 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-acb3cc9a-c4d8-4a46-9859-217e5f1a479c tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:11.453202 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-acb3cc9a-c4d8-4a46-9859-217e5f1a479c tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:11.453880 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-acb3cc9a-c4d8-4a46-9859-217e5f1a479c tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:11.678595 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-acb3cc9a-c4d8-4a46-9859-217e5f1a479c tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e94f83a79ca42c691dc29a189a64a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4732b1ccb145414ba7d9f3d93df9f8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:11.688090 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-acb3cc9a-c4d8-4a46-9859-217e5f1a479c tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] 10.222.0.45 "GET /compute/v2.1/servers/07dfd5e5-b751-4ebb-a023-9e0dbe8abc65" status: 200 len: 1314 microversion: 2.1 time: 0.258970 Dec 16 14:56:11.688674 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 93/189] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:11 2021] GET /compute/v2.1/servers/07dfd5e5-b751-4ebb-a023-9e0dbe8abc65 => generated 1314 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:11.942403 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-50268f73-bb31-41a8-a06d-5f3aa0481f82 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:11.943067 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-50268f73-bb31-41a8-a06d-5f3aa0481f82 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] [instance: 8a5137d8-24f6-4b78-abcb-2cf8d939df3e] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:11.950938 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-50268f73-bb31-41a8-a06d-5f3aa0481f82 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:11.951443 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-50268f73-bb31-41a8-a06d-5f3aa0481f82 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:11.952277 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-50268f73-bb31-41a8-a06d-5f3aa0481f82 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:11.952764 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-50268f73-bb31-41a8-a06d-5f3aa0481f82 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:11.957609 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-38719745-d917-4f94-8eff-dfc03bca25aa tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:11.958397 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-38719745-d917-4f94-8eff-dfc03bca25aa tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: bcaa83bc-5d07-413a-88e5-b7428a5b5d46] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:11.966896 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-38719745-d917-4f94-8eff-dfc03bca25aa tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:11.967397 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-38719745-d917-4f94-8eff-dfc03bca25aa tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:11.968770 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-38719745-d917-4f94-8eff-dfc03bca25aa tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:11.968770 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-38719745-d917-4f94-8eff-dfc03bca25aa tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:12.294224 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-50268f73-bb31-41a8-a06d-5f3aa0481f82 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7623b303ca8244b58179ef0146dd2bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8372f52bdbf443385cd0058e122fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:12.310264 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-50268f73-bb31-41a8-a06d-5f3aa0481f82 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] 10.222.0.45 "GET /compute/v2.1/servers/8a5137d8-24f6-4b78-abcb-2cf8d939df3e" status: 200 len: 1314 microversion: 2.1 time: 0.374125 Dec 16 14:56:12.312394 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 97/190] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:11 2021] GET /compute/v2.1/servers/8a5137d8-24f6-4b78-abcb-2cf8d939df3e => generated 1314 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:12.349444 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-38719745-d917-4f94-8eff-dfc03bca25aa tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:12.378013 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-38719745-d917-4f94-8eff-dfc03bca25aa tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46" status: 200 len: 1322 microversion: 2.1 time: 0.428609 Dec 16 14:56:12.378547 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 94/191] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:11 2021] GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46 => generated 1322 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:12.450891 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-94700442-f397-4557-9a2d-bd01b645f860 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:12.451465 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-94700442-f397-4557-9a2d-bd01b645f860 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:12.453659 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-84a865a0-4201-4768-976e-0abdba39d656 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:12.455039 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-84a865a0-4201-4768-976e-0abdba39d656 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:12.460234 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-94700442-f397-4557-9a2d-bd01b645f860 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:12.460940 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-94700442-f397-4557-9a2d-bd01b645f860 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:12.461776 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-94700442-f397-4557-9a2d-bd01b645f860 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:12.462936 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-94700442-f397-4557-9a2d-bd01b645f860 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:12.467516 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-84a865a0-4201-4768-976e-0abdba39d656 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:12.467516 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-84a865a0-4201-4768-976e-0abdba39d656 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:12.467516 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-84a865a0-4201-4768-976e-0abdba39d656 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:12.467516 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-84a865a0-4201-4768-976e-0abdba39d656 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:12.768303 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-94700442-f397-4557-9a2d-bd01b645f860 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:12.775667 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-84a865a0-4201-4768-976e-0abdba39d656 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:12.777637 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-94700442-f397-4557-9a2d-bd01b645f860 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14" status: 200 len: 1363 microversion: 2.1 time: 0.335029 Dec 16 14:56:12.778653 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 98/192] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:12 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14 => generated 1363 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:12.789474 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-84a865a0-4201-4768-976e-0abdba39d656 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:12.794179 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-84a865a0-4201-4768-976e-0abdba39d656 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:12.794445 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-f7b2b81f-71f6-4545-9791-94dae04f2d13 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:12.795199 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-f7b2b81f-71f6-4545-9791-94dae04f2d13 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] [instance: 07dfd5e5-b751-4ebb-a023-9e0dbe8abc65] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:12.795501 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-84a865a0-4201-4768-976e-0abdba39d656 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1405 microversion: 2.20 time: 0.352787 Dec 16 14:56:12.796506 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 95/193] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 14:56:12 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1405 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 14:56:12.806804 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f7b2b81f-71f6-4545-9791-94dae04f2d13 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:12.807576 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f7b2b81f-71f6-4545-9791-94dae04f2d13 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:12.808492 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f7b2b81f-71f6-4545-9791-94dae04f2d13 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:12.809066 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f7b2b81f-71f6-4545-9791-94dae04f2d13 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:12.872818 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [req-fdbbf96d-8160-4e72-bb59-df6230180d56 req-0f0bb638-7fbb-47ee-bb00-7d94cfb47861 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "407dd6f1-6f0a-41ba-80e2-9ebe4630fa75", "name": "network-vif-plugged", "status": "completed", "tag": "5e762ff6-a901-4d0e-aaba-533a8b07ea32"}]} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:56:12.877819 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:56:12.877819 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: warnings.warn(msg) Dec 16 14:56:12.887407 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-fdbbf96d-8160-4e72-bb59-df6230180d56 req-0f0bb638-7fbb-47ee-bb00-7d94cfb47861 service nova] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:12.887913 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-fdbbf96d-8160-4e72-bb59-df6230180d56 req-0f0bb638-7fbb-47ee-bb00-7d94cfb47861 service nova] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:12.930743 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.compute.server_external_events [req-fdbbf96d-8160-4e72-bb59-df6230180d56 req-0f0bb638-7fbb-47ee-bb00-7d94cfb47861 service nova] Creating event network-vif-plugged:5e762ff6-a901-4d0e-aaba-533a8b07ea32 for instance 407dd6f1-6f0a-41ba-80e2-9ebe4630fa75 on hv-cinder-82189 Dec 16 14:56:12.936945 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [req-fdbbf96d-8160-4e72-bb59-df6230180d56 req-0f0bb638-7fbb-47ee-bb00-7d94cfb47861 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075166 Dec 16 14:56:12.937873 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 96/194] 10.222.0.45 () {64 vars in 1308 bytes} [Thu Dec 16 14:56:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 14:56:13.146985 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-f7b2b81f-71f6-4545-9791-94dae04f2d13 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e94f83a79ca42c691dc29a189a64a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4732b1ccb145414ba7d9f3d93df9f8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:13.158064 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-f7b2b81f-71f6-4545-9791-94dae04f2d13 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] 10.222.0.45 "GET /compute/v2.1/servers/07dfd5e5-b751-4ebb-a023-9e0dbe8abc65" status: 200 len: 1314 microversion: 2.1 time: 0.378126 Dec 16 14:56:13.158908 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 99/195] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:12 2021] GET /compute/v2.1/servers/07dfd5e5-b751-4ebb-a023-9e0dbe8abc65 => generated 1314 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:13.338283 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-6b151f55-0791-4788-a533-ba5878958378 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:13.339271 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-6b151f55-0791-4788-a533-ba5878958378 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] [instance: 8a5137d8-24f6-4b78-abcb-2cf8d939df3e] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:13.347881 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6b151f55-0791-4788-a533-ba5878958378 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:13.348574 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6b151f55-0791-4788-a533-ba5878958378 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:13.349597 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6b151f55-0791-4788-a533-ba5878958378 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:13.350276 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6b151f55-0791-4788-a533-ba5878958378 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:13.400950 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-7f4e650a-694f-4306-a490-efcd13b9fdcf tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:13.401622 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-7f4e650a-694f-4306-a490-efcd13b9fdcf tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: bcaa83bc-5d07-413a-88e5-b7428a5b5d46] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:13.420325 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7f4e650a-694f-4306-a490-efcd13b9fdcf tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:13.420811 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7f4e650a-694f-4306-a490-efcd13b9fdcf tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:13.427151 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7f4e650a-694f-4306-a490-efcd13b9fdcf tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:13.427659 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7f4e650a-694f-4306-a490-efcd13b9fdcf tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:13.678531 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-6b151f55-0791-4788-a533-ba5878958378 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7623b303ca8244b58179ef0146dd2bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8372f52bdbf443385cd0058e122fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:13.689780 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-6b151f55-0791-4788-a533-ba5878958378 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] 10.222.0.45 "GET /compute/v2.1/servers/8a5137d8-24f6-4b78-abcb-2cf8d939df3e" status: 200 len: 1501 microversion: 2.1 time: 0.360379 Dec 16 14:56:13.698106 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 97/196] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:13 2021] GET /compute/v2.1/servers/8a5137d8-24f6-4b78-abcb-2cf8d939df3e => generated 1501 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:13.749736 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-7f4e650a-694f-4306-a490-efcd13b9fdcf tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:13.759225 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-7f4e650a-694f-4306-a490-efcd13b9fdcf tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46" status: 200 len: 1515 microversion: 2.1 time: 0.366005 Dec 16 14:56:13.760198 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 100/197] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:13 2021] GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46 => generated 1515 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:13.781672 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-31a42d00-742f-454d-b3c6-e0adc0f32b28 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:56:13.786608 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-31a42d00-742f-454d-b3c6-e0adc0f32b28 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: bcaa83bc-5d07-413a-88e5-b7428a5b5d46] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:13.802422 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-dc6334ab-72e0-46d1-add3-6225ac80bce2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:13.803100 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-dc6334ab-72e0-46d1-add3-6225ac80bce2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:13.804076 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-31a42d00-742f-454d-b3c6-e0adc0f32b28 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:13.804796 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-31a42d00-742f-454d-b3c6-e0adc0f32b28 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:13.806509 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-31a42d00-742f-454d-b3c6-e0adc0f32b28 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:13.807198 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-31a42d00-742f-454d-b3c6-e0adc0f32b28 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:13.814955 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-dc6334ab-72e0-46d1-add3-6225ac80bce2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:13.818419 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-dc6334ab-72e0-46d1-add3-6225ac80bce2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:13.818419 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-dc6334ab-72e0-46d1-add3-6225ac80bce2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:13.818419 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-dc6334ab-72e0-46d1-add3-6225ac80bce2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:14.110216 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-dc6334ab-72e0-46d1-add3-6225ac80bce2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:14.119459 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-dc6334ab-72e0-46d1-add3-6225ac80bce2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14" status: 200 len: 1363 microversion: 2.1 time: 0.327442 Dec 16 14:56:14.120060 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 101/198] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:13 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14 => generated 1363 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:14.128467 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-9c2a950a-551d-4e0a-9976-7506061af9a9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:14.129125 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-9c2a950a-551d-4e0a-9976-7506061af9a9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:14.137395 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9c2a950a-551d-4e0a-9976-7506061af9a9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:14.137873 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9c2a950a-551d-4e0a-9976-7506061af9a9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:14.139036 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9c2a950a-551d-4e0a-9976-7506061af9a9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:14.139536 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9c2a950a-551d-4e0a-9976-7506061af9a9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:14.166541 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-31a42d00-742f-454d-b3c6-e0adc0f32b28 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "POST /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46/action" status: 200 len: 32 microversion: 2.1 time: 0.392676 Dec 16 14:56:14.169289 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 98/199] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:56:13 2021] POST /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46/action => generated 32 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 14:56:14.187798 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-c4361f02-79fa-4e6c-a2ac-05f16997d344 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:14.192421 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-c4361f02-79fa-4e6c-a2ac-05f16997d344 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] [instance: 07dfd5e5-b751-4ebb-a023-9e0dbe8abc65] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:14.203489 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c4361f02-79fa-4e6c-a2ac-05f16997d344 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:14.204147 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c4361f02-79fa-4e6c-a2ac-05f16997d344 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:14.205127 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c4361f02-79fa-4e6c-a2ac-05f16997d344 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:14.205706 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c4361f02-79fa-4e6c-a2ac-05f16997d344 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:14.447274 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-c4361f02-79fa-4e6c-a2ac-05f16997d344 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e94f83a79ca42c691dc29a189a64a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4732b1ccb145414ba7d9f3d93df9f8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:14.459285 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-c4361f02-79fa-4e6c-a2ac-05f16997d344 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] 10.222.0.45 "GET /compute/v2.1/servers/07dfd5e5-b751-4ebb-a023-9e0dbe8abc65" status: 200 len: 1314 microversion: 2.1 time: 0.282253 Dec 16 14:56:14.460546 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 99/200] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:14 2021] GET /compute/v2.1/servers/07dfd5e5-b751-4ebb-a023-9e0dbe8abc65 => generated 1314 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:56:14.469769 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-ac8f4940-1067-462c-998c-c2a32ec406d7 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:14.470839 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-ac8f4940-1067-462c-998c-c2a32ec406d7 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: bcaa83bc-5d07-413a-88e5-b7428a5b5d46] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:14.481035 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ac8f4940-1067-462c-998c-c2a32ec406d7 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:14.481714 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ac8f4940-1067-462c-998c-c2a32ec406d7 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:14.482957 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ac8f4940-1067-462c-998c-c2a32ec406d7 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:14.483894 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ac8f4940-1067-462c-998c-c2a32ec406d7 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:14.485197 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-9c2a950a-551d-4e0a-9976-7506061af9a9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:14.521119 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-9c2a950a-551d-4e0a-9976-7506061af9a9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:14.525949 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-9c2a950a-551d-4e0a-9976-7506061af9a9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:14.527164 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-9c2a950a-551d-4e0a-9976-7506061af9a9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1405 microversion: 2.20 time: 0.406101 Dec 16 14:56:14.548710 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 102/201] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 14:56:14 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1405 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:56:14.832092 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-ac8f4940-1067-462c-998c-c2a32ec406d7 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:14.855872 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-ac8f4940-1067-462c-998c-c2a32ec406d7 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46" status: 200 len: 1521 microversion: 2.1 time: 0.393953 Dec 16 14:56:14.856511 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 100/202] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:14 2021] GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46 => generated 1521 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:14.958652 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-8be74b91-7e0a-4831-9627-2b737fe22c63 tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1800205744", "imageRef": "9b00ff4e-db72-4324-820b-87a6bd73b055", "flavorRef": "452"}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:56:14.993250 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [req-c7159483-1a5c-4ebd-9c0b-3dd4259f9ab4 req-407987dc-86db-4c9e-8eaf-6a2fe1df8b32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd5ffc87-035a-4e91-8fb5-8e44ed5704ac", "name": "network-vif-plugged", "status": "completed", "tag": "53c4bcf8-a1ba-44b2-b6d2-735e655c1b9f"}, {"server_uuid": "2989cd04-6526-4aca-8f1f-771371323c14", "name": "network-vif-plugged", "status": "completed", "tag": "d2035528-d3ab-4af2-aaf2-d63a3fd8324b"}]} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:56:15.015794 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:56:15.015794 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: warnings.warn(msg) Dec 16 14:56:15.036516 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-c7159483-1a5c-4ebd-9c0b-3dd4259f9ab4 req-407987dc-86db-4c9e-8eaf-6a2fe1df8b32 service nova] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:15.037013 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-c7159483-1a5c-4ebd-9c0b-3dd4259f9ab4 req-407987dc-86db-4c9e-8eaf-6a2fe1df8b32 service nova] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:15.063869 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.compute.server_external_events [req-c7159483-1a5c-4ebd-9c0b-3dd4259f9ab4 req-407987dc-86db-4c9e-8eaf-6a2fe1df8b32 service nova] Creating event network-vif-plugged:53c4bcf8-a1ba-44b2-b6d2-735e655c1b9f for instance cd5ffc87-035a-4e91-8fb5-8e44ed5704ac on hv-cinder-82189 Dec 16 14:56:15.066184 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.compute.server_external_events [req-c7159483-1a5c-4ebd-9c0b-3dd4259f9ab4 req-407987dc-86db-4c9e-8eaf-6a2fe1df8b32 service nova] Creating event network-vif-plugged:d2035528-d3ab-4af2-aaf2-d63a3fd8324b for instance 2989cd04-6526-4aca-8f1f-771371323c14 on hv-cinder-82189 Dec 16 14:56:15.070742 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.network.neutron [None req-8be74b91-7e0a-4831-9627-2b737fe22c63 tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] validate_networks() for None {{(pid=101356) validate_networks /opt/stack/nova/nova/network/neutron.py:2383}} Dec 16 14:56:15.083631 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [req-c7159483-1a5c-4ebd-9c0b-3dd4259f9ab4 req-407987dc-86db-4c9e-8eaf-6a2fe1df8b32 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.098134 Dec 16 14:56:15.092459 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 101/203] 10.222.0.45 () {64 vars in 1308 bytes} [Thu Dec 16 14:56:14 2021] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:56:15.141426 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-eaa4ccab-e239-4eb7-8c98-677d52018486 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:15.142218 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-eaa4ccab-e239-4eb7-8c98-677d52018486 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:15.151097 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-eaa4ccab-e239-4eb7-8c98-677d52018486 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:15.151527 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-eaa4ccab-e239-4eb7-8c98-677d52018486 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:15.152569 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-eaa4ccab-e239-4eb7-8c98-677d52018486 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:15.152928 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-eaa4ccab-e239-4eb7-8c98-677d52018486 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:15.476529 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-eaa4ccab-e239-4eb7-8c98-677d52018486 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:15.486636 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-eaa4ccab-e239-4eb7-8c98-677d52018486 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14" status: 200 len: 1363 microversion: 2.1 time: 0.353205 Dec 16 14:56:15.498338 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 102/204] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:15 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14 => generated 1363 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:56:15.507871 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-adbf431b-64a7-4983-98f0-2bf4a7852c5a tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:15.508794 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-adbf431b-64a7-4983-98f0-2bf4a7852c5a tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] [instance: 07dfd5e5-b751-4ebb-a023-9e0dbe8abc65] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:15.530575 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-adbf431b-64a7-4983-98f0-2bf4a7852c5a tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:15.531086 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-adbf431b-64a7-4983-98f0-2bf4a7852c5a tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:15.531942 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-adbf431b-64a7-4983-98f0-2bf4a7852c5a tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:15.532432 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-adbf431b-64a7-4983-98f0-2bf4a7852c5a tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:15.623933 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.virt.hardware [None req-8be74b91-7e0a-4831-9627-2b737fe22c63 tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Flavor limits 0:0:0 {{(pid=101356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:338}} Dec 16 14:56:15.624405 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.virt.hardware [None req-8be74b91-7e0a-4831-9627-2b737fe22c63 tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Image limits 0:0:0 {{(pid=101356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:342}} Dec 16 14:56:15.625041 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.virt.hardware [None req-8be74b91-7e0a-4831-9627-2b737fe22c63 tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Flavor pref 0:0:0 {{(pid=101356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:378}} Dec 16 14:56:15.625493 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.virt.hardware [None req-8be74b91-7e0a-4831-9627-2b737fe22c63 tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Image pref 0:0:0 {{(pid=101356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:382}} Dec 16 14:56:15.625949 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.virt.hardware [None req-8be74b91-7e0a-4831-9627-2b737fe22c63 tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=101356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:422}} Dec 16 14:56:15.639337 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8be74b91-7e0a-4831-9627-2b737fe22c63 tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:15.639845 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8be74b91-7e0a-4831-9627-2b737fe22c63 tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:15.641065 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8be74b91-7e0a-4831-9627-2b737fe22c63 tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:15.651198 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8be74b91-7e0a-4831-9627-2b737fe22c63 tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:15.679812 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.quota [None req-8be74b91-7e0a-4831-9627-2b737fe22c63 tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Getting quotas for project bb215be9a78b4d7a904be761bb48df83. Resources: {'ram', 'instances', 'cores'} {{(pid=101356) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 16 14:56:15.685598 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.quota [None req-8be74b91-7e0a-4831-9627-2b737fe22c63 tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Getting quotas for user 9595544d411046d18ece73d52fdeaba0 and project bb215be9a78b4d7a904be761bb48df83. Resources: {'ram', 'instances', 'cores'} {{(pid=101356) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 16 14:56:15.710831 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-8be74b91-7e0a-4831-9627-2b737fe22c63 tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Going to run 1 instances... {{(pid=101356) _provision_instances /opt/stack/nova/nova/compute/api.py:1224}} Dec 16 14:56:15.713843 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-8be74b91-7e0a-4831-9627-2b737fe22c63 tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] [instance: 0e5ff6f9-7844-4eb8-863d-3eb7336f13e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9b00ff4e-db72-4324-820b-87a6bd73b055',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101356) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1616}} Dec 16 14:56:15.943099 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-8be74b91-7e0a-4831-9627-2b737fe22c63 tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.995815 Dec 16 14:56:15.949476 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 103/205] 10.222.0.45 () {60 vars in 1137 bytes} [Thu Dec 16 14:56:14 2021] POST /compute/v2.1/servers => generated 380 bytes in 998 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 16 14:56:15.960487 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-297686ea-178d-4303-8278-5fcc5c0348a9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:15.961163 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-297686ea-178d-4303-8278-5fcc5c0348a9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:16.005279 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-297686ea-178d-4303-8278-5fcc5c0348a9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:16.005779 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-297686ea-178d-4303-8278-5fcc5c0348a9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:16.006661 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-297686ea-178d-4303-8278-5fcc5c0348a9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:16.007186 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-297686ea-178d-4303-8278-5fcc5c0348a9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:16.075179 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-adbf431b-64a7-4983-98f0-2bf4a7852c5a tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e94f83a79ca42c691dc29a189a64a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4732b1ccb145414ba7d9f3d93df9f8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:16.085635 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-adbf431b-64a7-4983-98f0-2bf4a7852c5a tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] 10.222.0.45 "GET /compute/v2.1/servers/07dfd5e5-b751-4ebb-a023-9e0dbe8abc65" status: 200 len: 1314 microversion: 2.1 time: 0.589256 Dec 16 14:56:16.092725 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 103/206] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:15 2021] GET /compute/v2.1/servers/07dfd5e5-b751-4ebb-a023-9e0dbe8abc65 => generated 1314 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:16.104489 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-40678e9d-6006-4ddc-806f-655900cbb19c tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:16.105553 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-40678e9d-6006-4ddc-806f-655900cbb19c tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: bcaa83bc-5d07-413a-88e5-b7428a5b5d46] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:16.114869 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-40678e9d-6006-4ddc-806f-655900cbb19c tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:16.115382 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-40678e9d-6006-4ddc-806f-655900cbb19c tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:16.116243 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-40678e9d-6006-4ddc-806f-655900cbb19c tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:16.116776 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-40678e9d-6006-4ddc-806f-655900cbb19c tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:16.279409 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-297686ea-178d-4303-8278-5fcc5c0348a9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:16.293875 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-297686ea-178d-4303-8278-5fcc5c0348a9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:16.299846 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-297686ea-178d-4303-8278-5fcc5c0348a9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:16.301010 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-297686ea-178d-4303-8278-5fcc5c0348a9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1405 microversion: 2.20 time: 0.355713 Dec 16 14:56:16.301573 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 104/207] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 14:56:15 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1405 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:56:16.314246 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-a603f5f4-8ed8-4aed-a954-fb7eedc5e550 tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:16.314953 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-a603f5f4-8ed8-4aed-a954-fb7eedc5e550 tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] [instance: 0e5ff6f9-7844-4eb8-863d-3eb7336f13e9] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:16.346869 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-40678e9d-6006-4ddc-806f-655900cbb19c tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:16.357023 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-40678e9d-6006-4ddc-806f-655900cbb19c tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46" status: 200 len: 1521 microversion: 2.1 time: 0.261301 Dec 16 14:56:16.357318 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 104/208] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:16 2021] GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46 => generated 1521 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:16.427491 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-a603f5f4-8ed8-4aed-a954-fb7eedc5e550 tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9595544d411046d18ece73d52fdeaba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb215be9a78b4d7a904be761bb48df83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:16.446921 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-a603f5f4-8ed8-4aed-a954-fb7eedc5e550 tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] 10.222.0.45 "GET /compute/v2.1/servers/0e5ff6f9-7844-4eb8-863d-3eb7336f13e9" status: 200 len: 1215 microversion: 2.1 time: 0.134324 Dec 16 14:56:16.446921 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 105/209] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:16 2021] GET /compute/v2.1/servers/0e5ff6f9-7844-4eb8-863d-3eb7336f13e9 => generated 1215 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:16.530601 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-41c9545b-432b-4b59-b240-09456cd83954 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:16.531252 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-41c9545b-432b-4b59-b240-09456cd83954 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:16.539241 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-41c9545b-432b-4b59-b240-09456cd83954 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:16.539744 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-41c9545b-432b-4b59-b240-09456cd83954 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:16.540592 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-41c9545b-432b-4b59-b240-09456cd83954 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:16.541082 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-41c9545b-432b-4b59-b240-09456cd83954 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:16.766079 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-41c9545b-432b-4b59-b240-09456cd83954 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:16.775012 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-41c9545b-432b-4b59-b240-09456cd83954 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14" status: 200 len: 1363 microversion: 2.1 time: 0.254395 Dec 16 14:56:16.775605 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 105/210] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:16 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14 => generated 1363 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:16.963599 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-f00f876e-c4ee-429a-a2d2-a3f429586078 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c462ed6d-b2bd-4fd5-a129-1e088f231d7f"}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:56:16.964822 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-f00f876e-c4ee-429a-a2d2-a3f429586078 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] [instance: 8a5137d8-24f6-4b78-abcb-2cf8d939df3e] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:16.972771 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f00f876e-c4ee-429a-a2d2-a3f429586078 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:16.973490 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f00f876e-c4ee-429a-a2d2-a3f429586078 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:16.974355 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f00f876e-c4ee-429a-a2d2-a3f429586078 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:16.974836 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f00f876e-c4ee-429a-a2d2-a3f429586078 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:17.113320 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-5e348788-453b-4f9a-9549-cb49567cc0d6 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:17.113997 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-5e348788-453b-4f9a-9549-cb49567cc0d6 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] [instance: 07dfd5e5-b751-4ebb-a023-9e0dbe8abc65] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:17.131576 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5e348788-453b-4f9a-9549-cb49567cc0d6 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:17.132087 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5e348788-453b-4f9a-9549-cb49567cc0d6 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:17.132946 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5e348788-453b-4f9a-9549-cb49567cc0d6 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:17.133439 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5e348788-453b-4f9a-9549-cb49567cc0d6 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:17.452963 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-5e348788-453b-4f9a-9549-cb49567cc0d6 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e94f83a79ca42c691dc29a189a64a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4732b1ccb145414ba7d9f3d93df9f8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:17.464017 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-5e348788-453b-4f9a-9549-cb49567cc0d6 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] 10.222.0.45 "GET /compute/v2.1/servers/07dfd5e5-b751-4ebb-a023-9e0dbe8abc65" status: 200 len: 1314 microversion: 2.1 time: 0.358485 Dec 16 14:56:17.464600 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 106/211] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:17 2021] GET /compute/v2.1/servers/07dfd5e5-b751-4ebb-a023-9e0dbe8abc65 => generated 1314 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:17.473687 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [req-1ee5c035-9860-4329-afbf-925fa9b36929 req-62fb589b-3313-4c72-b296-3c55ecc7a49a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07dfd5e5-b751-4ebb-a023-9e0dbe8abc65", "name": "network-vif-plugged", "status": "completed", "tag": "710cb508-8728-4320-ba9e-9fbeb9b340ec"}]} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:56:17.478868 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:56:17.478868 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: warnings.warn(msg) Dec 16 14:56:17.489067 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-1ee5c035-9860-4329-afbf-925fa9b36929 req-62fb589b-3313-4c72-b296-3c55ecc7a49a service nova] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:17.489373 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-1ee5c035-9860-4329-afbf-925fa9b36929 req-62fb589b-3313-4c72-b296-3c55ecc7a49a service nova] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:17.519624 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.compute.server_external_events [req-1ee5c035-9860-4329-afbf-925fa9b36929 req-62fb589b-3313-4c72-b296-3c55ecc7a49a service nova] Creating event network-vif-plugged:710cb508-8728-4320-ba9e-9fbeb9b340ec for instance 07dfd5e5-b751-4ebb-a023-9e0dbe8abc65 on hv-cinder-82189 Dec 16 14:56:17.519624 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [req-1ee5c035-9860-4329-afbf-925fa9b36929 req-62fb589b-3313-4c72-b296-3c55ecc7a49a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052693 Dec 16 14:56:17.519624 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 107/212] 10.222.0.45 () {64 vars in 1308 bytes} [Thu Dec 16 14:56:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:56:17.530999 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-fe8f7dba-441f-4da2-a56f-64165e800d6a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:17.531859 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-fe8f7dba-441f-4da2-a56f-64165e800d6a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:17.551043 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fe8f7dba-441f-4da2-a56f-64165e800d6a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:17.551658 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fe8f7dba-441f-4da2-a56f-64165e800d6a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:17.552604 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fe8f7dba-441f-4da2-a56f-64165e800d6a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:17.553245 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fe8f7dba-441f-4da2-a56f-64165e800d6a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:17.768905 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-f00f876e-c4ee-429a-a2d2-a3f429586078 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] 10.222.0.45 "POST /compute/v2.1/servers/8a5137d8-24f6-4b78-abcb-2cf8d939df3e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.813556 Dec 16 14:56:17.769544 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 106/213] 10.222.0.45 () {60 vars in 1313 bytes} [Thu Dec 16 14:56:16 2021] POST /compute/v2.1/servers/8a5137d8-24f6-4b78-abcb-2cf8d939df3e/os-volume_attachments => generated 194 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:56:17.798684 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-334b1dfa-fe9e-4507-8c31-e60aa599de60 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:17.799450 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-334b1dfa-fe9e-4507-8c31-e60aa599de60 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: bcaa83bc-5d07-413a-88e5-b7428a5b5d46] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:17.808864 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-334b1dfa-fe9e-4507-8c31-e60aa599de60 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:17.809372 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-334b1dfa-fe9e-4507-8c31-e60aa599de60 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:17.810249 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-334b1dfa-fe9e-4507-8c31-e60aa599de60 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:17.810747 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-334b1dfa-fe9e-4507-8c31-e60aa599de60 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:17.838513 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-fe8f7dba-441f-4da2-a56f-64165e800d6a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:17.879329 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-fe8f7dba-441f-4da2-a56f-64165e800d6a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:17.884945 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-fe8f7dba-441f-4da2-a56f-64165e800d6a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:17.886640 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-fe8f7dba-441f-4da2-a56f-64165e800d6a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1405 microversion: 2.20 time: 0.365580 Dec 16 14:56:17.887360 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 108/214] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 14:56:17 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1405 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:56:17.896663 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-9f8f42cf-2828-4128-bfa9-601fbed86bc2 tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:17.897496 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-9f8f42cf-2828-4128-bfa9-601fbed86bc2 tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] [instance: 0e5ff6f9-7844-4eb8-863d-3eb7336f13e9] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:17.906088 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9f8f42cf-2828-4128-bfa9-601fbed86bc2 tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:17.906784 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9f8f42cf-2828-4128-bfa9-601fbed86bc2 tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:17.907810 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9f8f42cf-2828-4128-bfa9-601fbed86bc2 tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:17.908452 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9f8f42cf-2828-4128-bfa9-601fbed86bc2 tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:18.115977 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-9f8f42cf-2828-4128-bfa9-601fbed86bc2 tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9595544d411046d18ece73d52fdeaba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb215be9a78b4d7a904be761bb48df83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:18.137587 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-9f8f42cf-2828-4128-bfa9-601fbed86bc2 tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] 10.222.0.45 "GET /compute/v2.1/servers/0e5ff6f9-7844-4eb8-863d-3eb7336f13e9" status: 200 len: 1267 microversion: 2.1 time: 0.249009 Dec 16 14:56:18.138413 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 109/215] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:17 2021] GET /compute/v2.1/servers/0e5ff6f9-7844-4eb8-863d-3eb7336f13e9 => generated 1267 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:18.147662 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-cba174ed-f084-420c-a12c-58d23a0fa266 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:18.148330 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-cba174ed-f084-420c-a12c-58d23a0fa266 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:18.156911 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cba174ed-f084-420c-a12c-58d23a0fa266 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:18.157525 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cba174ed-f084-420c-a12c-58d23a0fa266 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:18.158424 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cba174ed-f084-420c-a12c-58d23a0fa266 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:18.158912 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cba174ed-f084-420c-a12c-58d23a0fa266 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:18.230900 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-334b1dfa-fe9e-4507-8c31-e60aa599de60 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:18.240568 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-334b1dfa-fe9e-4507-8c31-e60aa599de60 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46" status: 200 len: 1521 microversion: 2.1 time: 0.452625 Dec 16 14:56:18.241646 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 107/216] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:17 2021] GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46 => generated 1521 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:18.488310 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-704f147d-f248-452b-8735-b87ec3bdb83b tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:18.488980 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-704f147d-f248-452b-8735-b87ec3bdb83b tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] [instance: 07dfd5e5-b751-4ebb-a023-9e0dbe8abc65] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:18.507374 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-704f147d-f248-452b-8735-b87ec3bdb83b tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:18.507882 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-704f147d-f248-452b-8735-b87ec3bdb83b tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:18.508768 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-704f147d-f248-452b-8735-b87ec3bdb83b tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:18.509262 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-704f147d-f248-452b-8735-b87ec3bdb83b tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:18.612426 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-cba174ed-f084-420c-a12c-58d23a0fa266 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:18.621662 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-cba174ed-f084-420c-a12c-58d23a0fa266 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14" status: 200 len: 1363 microversion: 2.1 time: 0.482180 Dec 16 14:56:18.622295 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 110/217] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:18 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14 => generated 1363 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:18.757036 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-704f147d-f248-452b-8735-b87ec3bdb83b tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e94f83a79ca42c691dc29a189a64a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4732b1ccb145414ba7d9f3d93df9f8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:18.766011 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-704f147d-f248-452b-8735-b87ec3bdb83b tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] 10.222.0.45 "GET /compute/v2.1/servers/07dfd5e5-b751-4ebb-a023-9e0dbe8abc65" status: 200 len: 1314 microversion: 2.1 time: 0.285484 Dec 16 14:56:18.766621 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 108/218] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:18 2021] GET /compute/v2.1/servers/07dfd5e5-b751-4ebb-a023-9e0dbe8abc65 => generated 1314 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:56:18.912875 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-ea9e5b46-d1c3-4423-a82c-af0783fc05c7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:18.913465 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-ea9e5b46-d1c3-4423-a82c-af0783fc05c7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:18.928116 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ea9e5b46-d1c3-4423-a82c-af0783fc05c7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:18.928634 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ea9e5b46-d1c3-4423-a82c-af0783fc05c7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:18.929493 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ea9e5b46-d1c3-4423-a82c-af0783fc05c7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:18.929987 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ea9e5b46-d1c3-4423-a82c-af0783fc05c7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:19.178982 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-f107b8c8-2619-42a4-a5e8-80302fc35a7d tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:19.179800 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-f107b8c8-2619-42a4-a5e8-80302fc35a7d tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] [instance: 0e5ff6f9-7844-4eb8-863d-3eb7336f13e9] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:19.190489 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f107b8c8-2619-42a4-a5e8-80302fc35a7d tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:19.191304 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f107b8c8-2619-42a4-a5e8-80302fc35a7d tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:19.192351 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f107b8c8-2619-42a4-a5e8-80302fc35a7d tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:19.193193 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f107b8c8-2619-42a4-a5e8-80302fc35a7d tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:19.242503 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-ea9e5b46-d1c3-4423-a82c-af0783fc05c7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:19.259765 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-ea9e5b46-d1c3-4423-a82c-af0783fc05c7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:19.265175 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-ea9e5b46-d1c3-4423-a82c-af0783fc05c7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:19.271331 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-ea9e5b46-d1c3-4423-a82c-af0783fc05c7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1405 microversion: 2.20 time: 0.362031 Dec 16 14:56:19.271331 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 111/219] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 14:56:18 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1405 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:56:19.281842 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-a2ed329b-9ffe-4082-87d8-5ee573358729 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:19.282901 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-a2ed329b-9ffe-4082-87d8-5ee573358729 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: bcaa83bc-5d07-413a-88e5-b7428a5b5d46] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:19.291430 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a2ed329b-9ffe-4082-87d8-5ee573358729 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:19.291943 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a2ed329b-9ffe-4082-87d8-5ee573358729 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:19.292812 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a2ed329b-9ffe-4082-87d8-5ee573358729 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:19.293340 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a2ed329b-9ffe-4082-87d8-5ee573358729 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:19.385693 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-f107b8c8-2619-42a4-a5e8-80302fc35a7d tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9595544d411046d18ece73d52fdeaba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb215be9a78b4d7a904be761bb48df83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:19.401854 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-f107b8c8-2619-42a4-a5e8-80302fc35a7d tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] 10.222.0.45 "GET /compute/v2.1/servers/0e5ff6f9-7844-4eb8-863d-3eb7336f13e9" status: 200 len: 1285 microversion: 2.1 time: 0.245863 Dec 16 14:56:19.405436 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 109/220] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:19 2021] GET /compute/v2.1/servers/0e5ff6f9-7844-4eb8-863d-3eb7336f13e9 => generated 1285 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:56:19.643373 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-0f2a25ac-b19e-441a-8628-0c1cbba69194 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:19.644018 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-0f2a25ac-b19e-441a-8628-0c1cbba69194 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:19.653048 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0f2a25ac-b19e-441a-8628-0c1cbba69194 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:19.654008 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0f2a25ac-b19e-441a-8628-0c1cbba69194 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:19.655239 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0f2a25ac-b19e-441a-8628-0c1cbba69194 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:19.655924 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0f2a25ac-b19e-441a-8628-0c1cbba69194 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:19.764515 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-a2ed329b-9ffe-4082-87d8-5ee573358729 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:19.771795 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-a2ed329b-9ffe-4082-87d8-5ee573358729 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46" status: 200 len: 1521 microversion: 2.1 time: 0.502771 Dec 16 14:56:19.772510 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 112/221] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:19 2021] GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46 => generated 1521 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:19.793223 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-58a91eac-fe87-498e-b1ab-5ad2d97dda23 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:19.794055 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-58a91eac-fe87-498e-b1ab-5ad2d97dda23 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] [instance: 07dfd5e5-b751-4ebb-a023-9e0dbe8abc65] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:19.801925 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-58a91eac-fe87-498e-b1ab-5ad2d97dda23 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:19.802470 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-58a91eac-fe87-498e-b1ab-5ad2d97dda23 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:19.803315 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-58a91eac-fe87-498e-b1ab-5ad2d97dda23 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:19.803799 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-58a91eac-fe87-498e-b1ab-5ad2d97dda23 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:19.990476 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-0f2a25ac-b19e-441a-8628-0c1cbba69194 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:20.003157 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-0f2a25ac-b19e-441a-8628-0c1cbba69194 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14" status: 200 len: 1549 microversion: 2.1 time: 0.366771 Dec 16 14:56:20.003938 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 110/222] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:19 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14 => generated 1549 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:20.026003 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-d4405a1c-1d71-4575-941d-18ea828b076e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:20.026698 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-d4405a1c-1d71-4575-941d-18ea828b076e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:20.034985 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d4405a1c-1d71-4575-941d-18ea828b076e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:20.035610 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d4405a1c-1d71-4575-941d-18ea828b076e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:20.036466 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d4405a1c-1d71-4575-941d-18ea828b076e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:20.037623 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d4405a1c-1d71-4575-941d-18ea828b076e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:20.211142 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-d4405a1c-1d71-4575-941d-18ea828b076e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.192703 Dec 16 14:56:20.212651 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 111/223] 10.222.0.45 () {58 vars in 1265 bytes} [Thu Dec 16 14:56:20 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-interface => generated 285 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:56:20.244346 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-58a91eac-fe87-498e-b1ab-5ad2d97dda23 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e94f83a79ca42c691dc29a189a64a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4732b1ccb145414ba7d9f3d93df9f8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:20.263584 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-58a91eac-fe87-498e-b1ab-5ad2d97dda23 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] 10.222.0.45 "GET /compute/v2.1/servers/07dfd5e5-b751-4ebb-a023-9e0dbe8abc65" status: 200 len: 1314 microversion: 2.1 time: 0.478349 Dec 16 14:56:20.264943 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 113/224] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:19 2021] GET /compute/v2.1/servers/07dfd5e5-b751-4ebb-a023-9e0dbe8abc65 => generated 1314 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:56:20.291478 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-020bccba-5138-4ca5-8d74-b6d51f79e1e4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:20.292150 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-020bccba-5138-4ca5-8d74-b6d51f79e1e4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:20.300786 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-020bccba-5138-4ca5-8d74-b6d51f79e1e4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:20.301293 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-020bccba-5138-4ca5-8d74-b6d51f79e1e4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:20.302209 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-020bccba-5138-4ca5-8d74-b6d51f79e1e4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:20.302671 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-020bccba-5138-4ca5-8d74-b6d51f79e1e4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:20.427371 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-57857319-e324-425a-b82e-10b96079d5b4 tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:20.428047 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-57857319-e324-425a-b82e-10b96079d5b4 tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] [instance: 0e5ff6f9-7844-4eb8-863d-3eb7336f13e9] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:20.436518 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-57857319-e324-425a-b82e-10b96079d5b4 tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:20.437037 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-57857319-e324-425a-b82e-10b96079d5b4 tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:20.437886 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-57857319-e324-425a-b82e-10b96079d5b4 tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:20.438463 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-57857319-e324-425a-b82e-10b96079d5b4 tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:20.580706 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-57857319-e324-425a-b82e-10b96079d5b4 tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9595544d411046d18ece73d52fdeaba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb215be9a78b4d7a904be761bb48df83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:20.590784 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-57857319-e324-425a-b82e-10b96079d5b4 tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] 10.222.0.45 "GET /compute/v2.1/servers/0e5ff6f9-7844-4eb8-863d-3eb7336f13e9" status: 200 len: 1273 microversion: 2.1 time: 0.171636 Dec 16 14:56:20.591617 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 114/225] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:20 2021] GET /compute/v2.1/servers/0e5ff6f9-7844-4eb8-863d-3eb7336f13e9 => generated 1273 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:56:20.804689 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-70bc345e-f277-4e9e-95d0-31c8013896b4 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:20.805370 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-70bc345e-f277-4e9e-95d0-31c8013896b4 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: bcaa83bc-5d07-413a-88e5-b7428a5b5d46] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:20.809866 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-020bccba-5138-4ca5-8d74-b6d51f79e1e4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:20.824232 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-70bc345e-f277-4e9e-95d0-31c8013896b4 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:20.824746 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-70bc345e-f277-4e9e-95d0-31c8013896b4 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:20.825989 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-70bc345e-f277-4e9e-95d0-31c8013896b4 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:20.826167 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-70bc345e-f277-4e9e-95d0-31c8013896b4 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:20.854457 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-020bccba-5138-4ca5-8d74-b6d51f79e1e4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:20.881465 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-020bccba-5138-4ca5-8d74-b6d51f79e1e4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:20.890449 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-020bccba-5138-4ca5-8d74-b6d51f79e1e4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1596 microversion: 2.20 time: 0.601309 Dec 16 14:56:20.891742 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 112/226] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 14:56:20 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1596 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:56:20.926763 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-96ec9b19-dbd0-4cdc-b557-c1220bf1f66b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:20.928261 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-96ec9b19-dbd0-4cdc-b557-c1220bf1f66b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:20.951099 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-96ec9b19-dbd0-4cdc-b557-c1220bf1f66b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:20.951603 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-96ec9b19-dbd0-4cdc-b557-c1220bf1f66b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:20.952546 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-96ec9b19-dbd0-4cdc-b557-c1220bf1f66b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:20.953039 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-96ec9b19-dbd0-4cdc-b557-c1220bf1f66b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:21.274165 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-96ec9b19-dbd0-4cdc-b557-c1220bf1f66b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.366491 Dec 16 14:56:21.275208 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 113/227] 10.222.0.45 () {60 vars in 1306 bytes} [Thu Dec 16 14:56:20 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/os-interface => generated 284 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:56:21.288128 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-ce94aeaa-9155-4d6e-a33d-8bbeb6b7cf2e tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:21.294308 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-ce94aeaa-9155-4d6e-a33d-8bbeb6b7cf2e tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] [instance: 07dfd5e5-b751-4ebb-a023-9e0dbe8abc65] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:21.324540 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ce94aeaa-9155-4d6e-a33d-8bbeb6b7cf2e tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:21.328245 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-70bc345e-f277-4e9e-95d0-31c8013896b4 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:21.328383 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ce94aeaa-9155-4d6e-a33d-8bbeb6b7cf2e tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:21.328383 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ce94aeaa-9155-4d6e-a33d-8bbeb6b7cf2e tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:21.331374 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ce94aeaa-9155-4d6e-a33d-8bbeb6b7cf2e tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:21.336295 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-70bc345e-f277-4e9e-95d0-31c8013896b4 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46" status: 200 len: 1521 microversion: 2.1 time: 0.548332 Dec 16 14:56:21.366078 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 115/228] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:20 2021] GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46 => generated 1521 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:56:21.613295 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-86e0efbf-110a-48eb-bcb1-de11531b60fd tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:21.613883 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-86e0efbf-110a-48eb-bcb1-de11531b60fd tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] [instance: 0e5ff6f9-7844-4eb8-863d-3eb7336f13e9] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:21.621852 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-86e0efbf-110a-48eb-bcb1-de11531b60fd tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:21.622389 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-86e0efbf-110a-48eb-bcb1-de11531b60fd tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:21.623246 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-86e0efbf-110a-48eb-bcb1-de11531b60fd tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:21.623890 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-86e0efbf-110a-48eb-bcb1-de11531b60fd tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:22.191956 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-86e0efbf-110a-48eb-bcb1-de11531b60fd tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9595544d411046d18ece73d52fdeaba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb215be9a78b4d7a904be761bb48df83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:22.206033 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-86e0efbf-110a-48eb-bcb1-de11531b60fd tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] 10.222.0.45 "GET /compute/v2.1/servers/0e5ff6f9-7844-4eb8-863d-3eb7336f13e9" status: 200 len: 1315 microversion: 2.1 time: 0.600371 Dec 16 14:56:22.206928 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 116/229] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:21 2021] GET /compute/v2.1/servers/0e5ff6f9-7844-4eb8-863d-3eb7336f13e9 => generated 1315 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:22.282949 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-ce94aeaa-9155-4d6e-a33d-8bbeb6b7cf2e tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e94f83a79ca42c691dc29a189a64a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4732b1ccb145414ba7d9f3d93df9f8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:22.292149 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-ce94aeaa-9155-4d6e-a33d-8bbeb6b7cf2e tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] 10.222.0.45 "GET /compute/v2.1/servers/07dfd5e5-b751-4ebb-a023-9e0dbe8abc65" status: 200 len: 1498 microversion: 2.1 time: 1.014083 Dec 16 14:56:22.292955 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 114/230] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:21 2021] GET /compute/v2.1/servers/07dfd5e5-b751-4ebb-a023-9e0dbe8abc65 => generated 1498 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:22.393189 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-53ca9e80-6e04-441f-830f-ffa4d1482593 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:22.395133 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-53ca9e80-6e04-441f-830f-ffa4d1482593 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: bcaa83bc-5d07-413a-88e5-b7428a5b5d46] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:22.398459 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [req-c5825742-7b54-49ad-96ee-2a02da399f12 req-562baa08-f045-455c-9ec6-b268613880d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e5ff6f9-7844-4eb8-863d-3eb7336f13e9", "tag": "7acef39a-9c04-451d-a9cb-0b2592134f8b"}]} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:56:22.403460 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:56:22.403460 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: warnings.warn(msg) Dec 16 14:56:22.407747 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-53ca9e80-6e04-441f-830f-ffa4d1482593 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:22.409718 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-53ca9e80-6e04-441f-830f-ffa4d1482593 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:22.413010 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-c5825742-7b54-49ad-96ee-2a02da399f12 req-562baa08-f045-455c-9ec6-b268613880d0 service nova] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:22.413569 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-c5825742-7b54-49ad-96ee-2a02da399f12 req-562baa08-f045-455c-9ec6-b268613880d0 service nova] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:22.414590 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-53ca9e80-6e04-441f-830f-ffa4d1482593 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:22.415944 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-53ca9e80-6e04-441f-830f-ffa4d1482593 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:22.442139 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.compute.server_external_events [req-c5825742-7b54-49ad-96ee-2a02da399f12 req-562baa08-f045-455c-9ec6-b268613880d0 service nova] Creating event network-changed:7acef39a-9c04-451d-a9cb-0b2592134f8b for instance 0e5ff6f9-7844-4eb8-863d-3eb7336f13e9 on hv-cinder-82189 Dec 16 14:56:22.448160 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [req-c5825742-7b54-49ad-96ee-2a02da399f12 req-562baa08-f045-455c-9ec6-b268613880d0 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057734 Dec 16 14:56:22.449815 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 115/231] 10.222.0.45 () {64 vars in 1308 bytes} [Thu Dec 16 14:56:22 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 14:56:22.809313 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-53ca9e80-6e04-441f-830f-ffa4d1482593 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:22.818615 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-53ca9e80-6e04-441f-830f-ffa4d1482593 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46" status: 200 len: 1521 microversion: 2.1 time: 0.437570 Dec 16 14:56:22.819499 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 117/232] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:22 2021] GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46 => generated 1521 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:23.229834 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-bb9d76fb-16e9-4e31-86c2-a8c44de1d1fe tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:23.230539 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-bb9d76fb-16e9-4e31-86c2-a8c44de1d1fe tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] [instance: 0e5ff6f9-7844-4eb8-863d-3eb7336f13e9] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:23.238630 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-bb9d76fb-16e9-4e31-86c2-a8c44de1d1fe tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:23.239134 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-bb9d76fb-16e9-4e31-86c2-a8c44de1d1fe tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:23.239985 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-bb9d76fb-16e9-4e31-86c2-a8c44de1d1fe tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:23.240470 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-bb9d76fb-16e9-4e31-86c2-a8c44de1d1fe tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:23.741667 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-bb9d76fb-16e9-4e31-86c2-a8c44de1d1fe tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9595544d411046d18ece73d52fdeaba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb215be9a78b4d7a904be761bb48df83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:23.750427 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-bb9d76fb-16e9-4e31-86c2-a8c44de1d1fe tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] 10.222.0.45 "GET /compute/v2.1/servers/0e5ff6f9-7844-4eb8-863d-3eb7336f13e9" status: 200 len: 1315 microversion: 2.1 time: 0.529489 Dec 16 14:56:23.750956 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 116/233] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:23 2021] GET /compute/v2.1/servers/0e5ff6f9-7844-4eb8-863d-3eb7336f13e9 => generated 1315 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:23.840944 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-6e389f4f-4646-47c9-8433-7bd1aba20c04 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:23.844768 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-6e389f4f-4646-47c9-8433-7bd1aba20c04 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: bcaa83bc-5d07-413a-88e5-b7428a5b5d46] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:23.849876 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6e389f4f-4646-47c9-8433-7bd1aba20c04 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:23.850413 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6e389f4f-4646-47c9-8433-7bd1aba20c04 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:23.851313 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6e389f4f-4646-47c9-8433-7bd1aba20c04 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:23.851809 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6e389f4f-4646-47c9-8433-7bd1aba20c04 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:24.083481 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-6e389f4f-4646-47c9-8433-7bd1aba20c04 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:24.092705 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-6e389f4f-4646-47c9-8433-7bd1aba20c04 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46" status: 200 len: 1521 microversion: 2.1 time: 0.259428 Dec 16 14:56:24.093678 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 118/234] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:23 2021] GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46 => generated 1521 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:24.394266 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-edc67c03-1f51-497f-ae68-e96403a857d4 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:56:24.397161 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-edc67c03-1f51-497f-ae68-e96403a857d4 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:24.398328 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [req-af4091bf-00fb-4701-8347-508438dd02a3 req-4f9aa60a-c229-4ec9-ad43-31ffe14e2248 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2989cd04-6526-4aca-8f1f-771371323c14", "tag": "d2035528-d3ab-4af2-aaf2-d63a3fd8324b"}]} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:56:24.403377 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:56:24.403377 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: warnings.warn(msg) Dec 16 14:56:24.407738 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-edc67c03-1f51-497f-ae68-e96403a857d4 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:24.408619 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-edc67c03-1f51-497f-ae68-e96403a857d4 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:24.409955 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-edc67c03-1f51-497f-ae68-e96403a857d4 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:24.410670 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-edc67c03-1f51-497f-ae68-e96403a857d4 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:24.412359 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-af4091bf-00fb-4701-8347-508438dd02a3 req-4f9aa60a-c229-4ec9-ad43-31ffe14e2248 service nova] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:24.412860 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-af4091bf-00fb-4701-8347-508438dd02a3 req-4f9aa60a-c229-4ec9-ad43-31ffe14e2248 service nova] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:24.432134 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.compute.server_external_events [req-af4091bf-00fb-4701-8347-508438dd02a3 req-4f9aa60a-c229-4ec9-ad43-31ffe14e2248 service nova] Creating event network-changed:d2035528-d3ab-4af2-aaf2-d63a3fd8324b for instance 2989cd04-6526-4aca-8f1f-771371323c14 on hv-cinder-82189 Dec 16 14:56:24.437348 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [req-af4091bf-00fb-4701-8347-508438dd02a3 req-4f9aa60a-c229-4ec9-ad43-31ffe14e2248 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046455 Dec 16 14:56:24.438348 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 119/235] 10.222.0.45 () {64 vars in 1308 bytes} [Thu Dec 16 14:56:24 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 14:56:24.775999 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-4bbcc758-01cf-4f46-a2c3-4d8419a92527 tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:24.776788 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-4bbcc758-01cf-4f46-a2c3-4d8419a92527 tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] [instance: 0e5ff6f9-7844-4eb8-863d-3eb7336f13e9] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:24.787157 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4bbcc758-01cf-4f46-a2c3-4d8419a92527 tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:24.787368 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4bbcc758-01cf-4f46-a2c3-4d8419a92527 tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:24.788120 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4bbcc758-01cf-4f46-a2c3-4d8419a92527 tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:24.788627 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4bbcc758-01cf-4f46-a2c3-4d8419a92527 tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:25.204279 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-4bbcc758-01cf-4f46-a2c3-4d8419a92527 tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9595544d411046d18ece73d52fdeaba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb215be9a78b4d7a904be761bb48df83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:25.213689 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-4bbcc758-01cf-4f46-a2c3-4d8419a92527 tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] 10.222.0.45 "GET /compute/v2.1/servers/0e5ff6f9-7844-4eb8-863d-3eb7336f13e9" status: 200 len: 1315 microversion: 2.1 time: 0.448123 Dec 16 14:56:25.214384 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 120/236] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:24 2021] GET /compute/v2.1/servers/0e5ff6f9-7844-4eb8-863d-3eb7336f13e9 => generated 1315 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:56:25.222953 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-4ff22c98-29c5-40ed-b881-62df42910eb0 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:56:25.224062 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-4ff22c98-29c5-40ed-b881-62df42910eb0 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:25.233131 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4ff22c98-29c5-40ed-b881-62df42910eb0 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:25.233768 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4ff22c98-29c5-40ed-b881-62df42910eb0 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:25.235945 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4ff22c98-29c5-40ed-b881-62df42910eb0 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:25.236458 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4ff22c98-29c5-40ed-b881-62df42910eb0 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:26.957587 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-edc67c03-1f51-497f-ae68-e96403a857d4 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 14 microversion: 2.1 time: 2.573174 Dec 16 14:56:26.958433 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 117/237] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:56:24 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 14 bytes in 2575 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 14:56:26.968056 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-e4c72fca-aec8-40d9-9af4-7bbbf667a158 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:26.968967 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-e4c72fca-aec8-40d9-9af4-7bbbf667a158 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: bcaa83bc-5d07-413a-88e5-b7428a5b5d46] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:26.977890 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e4c72fca-aec8-40d9-9af4-7bbbf667a158 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:26.978499 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e4c72fca-aec8-40d9-9af4-7bbbf667a158 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:26.979349 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e4c72fca-aec8-40d9-9af4-7bbbf667a158 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:26.979836 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e4c72fca-aec8-40d9-9af4-7bbbf667a158 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:26.984606 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-4ff22c98-29c5-40ed-b881-62df42910eb0 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 200 len: 14 microversion: 2.20 time: 1.768767 Dec 16 14:56:26.988001 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 121/238] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:56:25 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 14 bytes in 1770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:27.005431 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-ba7708fc-7837-4fa0-a30a-8613b046587f tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:27.009532 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-ba7708fc-7837-4fa0-a30a-8613b046587f tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] [instance: 0e5ff6f9-7844-4eb8-863d-3eb7336f13e9] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:27.018877 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ba7708fc-7837-4fa0-a30a-8613b046587f tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:27.019363 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ba7708fc-7837-4fa0-a30a-8613b046587f tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:27.020212 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ba7708fc-7837-4fa0-a30a-8613b046587f tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:27.022328 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ba7708fc-7837-4fa0-a30a-8613b046587f tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:27.229605 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-e4c72fca-aec8-40d9-9af4-7bbbf667a158 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:27.240877 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-e4c72fca-aec8-40d9-9af4-7bbbf667a158 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46" status: 200 len: 1521 microversion: 2.1 time: 0.280860 Dec 16 14:56:27.241403 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 118/239] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:26 2021] GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46 => generated 1521 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:27.256288 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [req-38fa0b14-faf8-4797-be6a-8369d5cd001b req-d85b79c1-e84c-41fc-a41d-7474aae9f3ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd5ffc87-035a-4e91-8fb5-8e44ed5704ac", "tag": "53c4bcf8-a1ba-44b2-b6d2-735e655c1b9f"}]} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:56:27.261645 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:56:27.261645 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: warnings.warn(msg) Dec 16 14:56:27.271759 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-38fa0b14-faf8-4797-be6a-8369d5cd001b req-d85b79c1-e84c-41fc-a41d-7474aae9f3ad service nova] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:27.272309 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-38fa0b14-faf8-4797-be6a-8369d5cd001b req-d85b79c1-e84c-41fc-a41d-7474aae9f3ad service nova] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:27.291833 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.compute.server_external_events [req-38fa0b14-faf8-4797-be6a-8369d5cd001b req-d85b79c1-e84c-41fc-a41d-7474aae9f3ad service nova] Creating event network-changed:53c4bcf8-a1ba-44b2-b6d2-735e655c1b9f for instance cd5ffc87-035a-4e91-8fb5-8e44ed5704ac on hv-cinder-82189 Dec 16 14:56:27.297156 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [req-38fa0b14-faf8-4797-be6a-8369d5cd001b req-d85b79c1-e84c-41fc-a41d-7474aae9f3ad service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048650 Dec 16 14:56:27.298296 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 119/240] 10.222.0.45 () {64 vars in 1308 bytes} [Thu Dec 16 14:56:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:56:27.649681 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-ba7708fc-7837-4fa0-a30a-8613b046587f tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9595544d411046d18ece73d52fdeaba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb215be9a78b4d7a904be761bb48df83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:27.660477 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-ba7708fc-7837-4fa0-a30a-8613b046587f tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] 10.222.0.45 "GET /compute/v2.1/servers/0e5ff6f9-7844-4eb8-863d-3eb7336f13e9" status: 200 len: 1315 microversion: 2.1 time: 0.673630 Dec 16 14:56:27.669630 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 122/241] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:26 2021] GET /compute/v2.1/servers/0e5ff6f9-7844-4eb8-863d-3eb7336f13e9 => generated 1315 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:27.896076 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-f1b8565e-e5a2-49c9-a8c8-9331acb9305a tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:27.897132 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-f1b8565e-e5a2-49c9-a8c8-9331acb9305a tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] [instance: 07dfd5e5-b751-4ebb-a023-9e0dbe8abc65] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:27.907285 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f1b8565e-e5a2-49c9-a8c8-9331acb9305a tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:27.908000 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f1b8565e-e5a2-49c9-a8c8-9331acb9305a tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:27.909186 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f1b8565e-e5a2-49c9-a8c8-9331acb9305a tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:27.909833 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f1b8565e-e5a2-49c9-a8c8-9331acb9305a tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:27.973489 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-5e811e4e-2e3f-4e81-a30b-19c224aa54d9 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:56:27.974699 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-5e811e4e-2e3f-4e81-a30b-19c224aa54d9 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:27.983398 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5e811e4e-2e3f-4e81-a30b-19c224aa54d9 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:27.984039 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5e811e4e-2e3f-4e81-a30b-19c224aa54d9 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:27.985006 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5e811e4e-2e3f-4e81-a30b-19c224aa54d9 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:27.985588 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5e811e4e-2e3f-4e81-a30b-19c224aa54d9 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:27.989886 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-f1b8565e-e5a2-49c9-a8c8-9331acb9305a tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] [instance: 07dfd5e5-b751-4ebb-a023-9e0dbe8abc65] Going to try to terminate instance {{(pid=101356) delete /opt/stack/nova/nova/compute/api.py:2496}} Dec 16 14:56:28.144443 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-5e811e4e-2e3f-4e81-a30b-19c224aa54d9 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 14 microversion: 2.1 time: 0.178498 Dec 16 14:56:28.145118 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 123/242] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:56:27 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 14 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 14:56:28.155800 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-fd345809-80f2-4f49-9c4e-420ee579759f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:56:28.156976 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-fd345809-80f2-4f49-9c4e-420ee579759f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:28.165615 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fd345809-80f2-4f49-9c4e-420ee579759f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:28.167628 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fd345809-80f2-4f49-9c4e-420ee579759f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:28.168150 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fd345809-80f2-4f49-9c4e-420ee579759f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:28.169127 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fd345809-80f2-4f49-9c4e-420ee579759f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:28.244195 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-f1b8565e-e5a2-49c9-a8c8-9331acb9305a tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] 10.222.0.45 "DELETE /compute/v2.1/servers/07dfd5e5-b751-4ebb-a023-9e0dbe8abc65" status: 204 len: 0 microversion: 2.1 time: 0.360187 Dec 16 14:56:28.245163 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 120/243] 10.222.0.45 () {58 vars in 1229 bytes} [Thu Dec 16 14:56:27 2021] DELETE /compute/v2.1/servers/07dfd5e5-b751-4ebb-a023-9e0dbe8abc65 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 16 14:56:28.260051 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-5f959601-be6c-4f6f-8b63-210f6663b859 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:28.260979 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-5f959601-be6c-4f6f-8b63-210f6663b859 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] [instance: 07dfd5e5-b751-4ebb-a023-9e0dbe8abc65] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:28.270623 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5f959601-be6c-4f6f-8b63-210f6663b859 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:28.270623 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5f959601-be6c-4f6f-8b63-210f6663b859 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:28.272175 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5f959601-be6c-4f6f-8b63-210f6663b859 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:28.272790 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5f959601-be6c-4f6f-8b63-210f6663b859 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:28.401448 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-fd345809-80f2-4f49-9c4e-420ee579759f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 200 len: 14 microversion: 2.20 time: 0.254441 Dec 16 14:56:28.402818 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 124/244] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:56:28 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 14 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:28.420646 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-971eda9f-19f9-4663-aa21-9acfec1db37b tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:28.421688 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-971eda9f-19f9-4663-aa21-9acfec1db37b tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: bcaa83bc-5d07-413a-88e5-b7428a5b5d46] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:28.440207 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-971eda9f-19f9-4663-aa21-9acfec1db37b tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:28.444913 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-971eda9f-19f9-4663-aa21-9acfec1db37b tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:28.446118 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-971eda9f-19f9-4663-aa21-9acfec1db37b tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:28.452238 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-971eda9f-19f9-4663-aa21-9acfec1db37b tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:28.810425 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-5f959601-be6c-4f6f-8b63-210f6663b859 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e94f83a79ca42c691dc29a189a64a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4732b1ccb145414ba7d9f3d93df9f8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:28.819331 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-5f959601-be6c-4f6f-8b63-210f6663b859 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] 10.222.0.45 "GET /compute/v2.1/servers/07dfd5e5-b751-4ebb-a023-9e0dbe8abc65" status: 200 len: 1504 microversion: 2.1 time: 0.569556 Dec 16 14:56:28.826787 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 121/245] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:28 2021] GET /compute/v2.1/servers/07dfd5e5-b751-4ebb-a023-9e0dbe8abc65 => generated 1504 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:28.834459 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-a2ad4488-e461-4e7d-9d61-71189bc0d360 tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:28.835418 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-a2ad4488-e461-4e7d-9d61-71189bc0d360 tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] [instance: 0e5ff6f9-7844-4eb8-863d-3eb7336f13e9] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:28.843791 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a2ad4488-e461-4e7d-9d61-71189bc0d360 tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:28.844305 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a2ad4488-e461-4e7d-9d61-71189bc0d360 tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:28.845160 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a2ad4488-e461-4e7d-9d61-71189bc0d360 tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:28.845771 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a2ad4488-e461-4e7d-9d61-71189bc0d360 tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:29.084377 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-971eda9f-19f9-4663-aa21-9acfec1db37b tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:29.109887 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-971eda9f-19f9-4663-aa21-9acfec1db37b tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46" status: 200 len: 1521 microversion: 2.1 time: 0.703048 Dec 16 14:56:29.110929 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 125/246] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:28 2021] GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46 => generated 1521 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:29.161910 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-a2ad4488-e461-4e7d-9d61-71189bc0d360 tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9595544d411046d18ece73d52fdeaba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb215be9a78b4d7a904be761bb48df83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:29.172139 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-3eab48c5-8d2f-43cc-bc80-b5f8f0760ec2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:56:29.177878 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-3eab48c5-8d2f-43cc-bc80-b5f8f0760ec2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:29.185631 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-a2ad4488-e461-4e7d-9d61-71189bc0d360 tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] 10.222.0.45 "GET /compute/v2.1/servers/0e5ff6f9-7844-4eb8-863d-3eb7336f13e9" status: 200 len: 1315 microversion: 2.1 time: 0.364288 Dec 16 14:56:29.189750 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 122/247] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:28 2021] GET /compute/v2.1/servers/0e5ff6f9-7844-4eb8-863d-3eb7336f13e9 => generated 1315 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:29.194730 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3eab48c5-8d2f-43cc-bc80-b5f8f0760ec2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:29.195462 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3eab48c5-8d2f-43cc-bc80-b5f8f0760ec2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:29.197042 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3eab48c5-8d2f-43cc-bc80-b5f8f0760ec2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:29.197844 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3eab48c5-8d2f-43cc-bc80-b5f8f0760ec2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:29.387447 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-3eab48c5-8d2f-43cc-bc80-b5f8f0760ec2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 14 microversion: 2.1 time: 0.234030 Dec 16 14:56:29.391103 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 126/248] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:56:29 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 14 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 14:56:29.420305 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-61267c65-079b-45f1-a9cc-79f83c00e178 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:56:29.421448 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-61267c65-079b-45f1-a9cc-79f83c00e178 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:29.439463 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-61267c65-079b-45f1-a9cc-79f83c00e178 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:29.439973 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-61267c65-079b-45f1-a9cc-79f83c00e178 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:29.440840 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-61267c65-079b-45f1-a9cc-79f83c00e178 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:29.441338 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-61267c65-079b-45f1-a9cc-79f83c00e178 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:29.789328 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-61267c65-079b-45f1-a9cc-79f83c00e178 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 200 len: 14 microversion: 2.20 time: 0.376940 Dec 16 14:56:29.793307 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 123/249] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:56:29 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 14 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:29.842307 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-900804fd-3848-471d-a14a-64c73bfcb4c4 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:29.843084 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-900804fd-3848-471d-a14a-64c73bfcb4c4 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] [instance: 07dfd5e5-b751-4ebb-a023-9e0dbe8abc65] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:29.851618 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-900804fd-3848-471d-a14a-64c73bfcb4c4 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:29.852762 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-900804fd-3848-471d-a14a-64c73bfcb4c4 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:29.853630 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-900804fd-3848-471d-a14a-64c73bfcb4c4 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:29.854169 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-900804fd-3848-471d-a14a-64c73bfcb4c4 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:30.065891 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-900804fd-3848-471d-a14a-64c73bfcb4c4 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e94f83a79ca42c691dc29a189a64a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4732b1ccb145414ba7d9f3d93df9f8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:30.074790 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-900804fd-3848-471d-a14a-64c73bfcb4c4 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] 10.222.0.45 "GET /compute/v2.1/servers/07dfd5e5-b751-4ebb-a023-9e0dbe8abc65" status: 200 len: 1504 microversion: 2.1 time: 0.241287 Dec 16 14:56:30.075387 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 127/250] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:29 2021] GET /compute/v2.1/servers/07dfd5e5-b751-4ebb-a023-9e0dbe8abc65 => generated 1504 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:30.132725 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-681260e2-0c75-4bdc-ab60-0fe2ed475679 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:30.133468 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-681260e2-0c75-4bdc-ab60-0fe2ed475679 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: bcaa83bc-5d07-413a-88e5-b7428a5b5d46] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:30.142234 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-681260e2-0c75-4bdc-ab60-0fe2ed475679 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:30.142929 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-681260e2-0c75-4bdc-ab60-0fe2ed475679 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:30.147457 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-681260e2-0c75-4bdc-ab60-0fe2ed475679 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:30.148116 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-681260e2-0c75-4bdc-ab60-0fe2ed475679 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:30.211321 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-89c2e88f-a520-473c-8105-23b869cc2f40 tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:30.212719 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-89c2e88f-a520-473c-8105-23b869cc2f40 tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] [instance: 0e5ff6f9-7844-4eb8-863d-3eb7336f13e9] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:30.220744 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-89c2e88f-a520-473c-8105-23b869cc2f40 tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:30.221263 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-89c2e88f-a520-473c-8105-23b869cc2f40 tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:30.222130 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-89c2e88f-a520-473c-8105-23b869cc2f40 tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:30.222742 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-89c2e88f-a520-473c-8105-23b869cc2f40 tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:30.391806 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-681260e2-0c75-4bdc-ab60-0fe2ed475679 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:30.402848 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-681260e2-0c75-4bdc-ab60-0fe2ed475679 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46" status: 200 len: 1521 microversion: 2.1 time: 0.277984 Dec 16 14:56:30.403560 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 124/251] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:30 2021] GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46 => generated 1521 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:30.421644 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-adab146f-20ab-41d2-ad8d-e2822e272300 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:56:30.421644 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-adab146f-20ab-41d2-ad8d-e2822e272300 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:30.431292 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-adab146f-20ab-41d2-ad8d-e2822e272300 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:30.431804 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-adab146f-20ab-41d2-ad8d-e2822e272300 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:30.432658 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-adab146f-20ab-41d2-ad8d-e2822e272300 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:30.433147 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-adab146f-20ab-41d2-ad8d-e2822e272300 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:30.486825 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-89c2e88f-a520-473c-8105-23b869cc2f40 tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9595544d411046d18ece73d52fdeaba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb215be9a78b4d7a904be761bb48df83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:30.496518 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-89c2e88f-a520-473c-8105-23b869cc2f40 tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] 10.222.0.45 "GET /compute/v2.1/servers/0e5ff6f9-7844-4eb8-863d-3eb7336f13e9" status: 200 len: 1315 microversion: 2.1 time: 0.292905 Dec 16 14:56:30.497461 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 128/252] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:30 2021] GET /compute/v2.1/servers/0e5ff6f9-7844-4eb8-863d-3eb7336f13e9 => generated 1315 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:30.665333 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-adab146f-20ab-41d2-ad8d-e2822e272300 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 14 microversion: 2.1 time: 0.253718 Dec 16 14:56:30.669512 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 125/253] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:56:30 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 14 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 14:56:30.804927 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-5b08eab6-9b30-4489-910d-00c369da3075 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:56:30.806658 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-5b08eab6-9b30-4489-910d-00c369da3075 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:30.814408 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5b08eab6-9b30-4489-910d-00c369da3075 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:30.814890 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5b08eab6-9b30-4489-910d-00c369da3075 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:30.815934 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5b08eab6-9b30-4489-910d-00c369da3075 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:30.816424 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5b08eab6-9b30-4489-910d-00c369da3075 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:30.997127 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-5b08eab6-9b30-4489-910d-00c369da3075 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 200 len: 14 microversion: 2.20 time: 0.199561 Dec 16 14:56:30.997804 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 129/254] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:56:30 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 14 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:31.097559 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-fe732318-e2d1-40a3-bdf3-d7ea2968f1e7 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:31.098352 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-fe732318-e2d1-40a3-bdf3-d7ea2968f1e7 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] [instance: 07dfd5e5-b751-4ebb-a023-9e0dbe8abc65] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:31.107275 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fe732318-e2d1-40a3-bdf3-d7ea2968f1e7 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:31.107798 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fe732318-e2d1-40a3-bdf3-d7ea2968f1e7 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:31.108702 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fe732318-e2d1-40a3-bdf3-d7ea2968f1e7 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:31.109185 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fe732318-e2d1-40a3-bdf3-d7ea2968f1e7 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:31.395321 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-fe732318-e2d1-40a3-bdf3-d7ea2968f1e7 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e94f83a79ca42c691dc29a189a64a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4732b1ccb145414ba7d9f3d93df9f8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:31.405704 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-fe732318-e2d1-40a3-bdf3-d7ea2968f1e7 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] 10.222.0.45 "GET /compute/v2.1/servers/07dfd5e5-b751-4ebb-a023-9e0dbe8abc65" status: 200 len: 1504 microversion: 2.1 time: 0.316081 Dec 16 14:56:31.405941 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 126/255] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:31 2021] GET /compute/v2.1/servers/07dfd5e5-b751-4ebb-a023-9e0dbe8abc65 => generated 1504 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:31.427945 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-b48af91c-a43d-42b5-bfee-14d854ca326f tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:31.428925 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-b48af91c-a43d-42b5-bfee-14d854ca326f tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: bcaa83bc-5d07-413a-88e5-b7428a5b5d46] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:31.449008 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b48af91c-a43d-42b5-bfee-14d854ca326f tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:31.449008 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b48af91c-a43d-42b5-bfee-14d854ca326f tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:31.449008 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b48af91c-a43d-42b5-bfee-14d854ca326f tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:31.449008 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b48af91c-a43d-42b5-bfee-14d854ca326f tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:31.458573 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-29d0bfd0-30d9-4d3f-b852-839ae2cf458e tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:31.459299 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-29d0bfd0-30d9-4d3f-b852-839ae2cf458e tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] [instance: 8a5137d8-24f6-4b78-abcb-2cf8d939df3e] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:31.468193 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-29d0bfd0-30d9-4d3f-b852-839ae2cf458e tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:31.468862 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-29d0bfd0-30d9-4d3f-b852-839ae2cf458e tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:31.470095 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-29d0bfd0-30d9-4d3f-b852-839ae2cf458e tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:31.470732 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-29d0bfd0-30d9-4d3f-b852-839ae2cf458e tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:31.547341 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-29d0bfd0-30d9-4d3f-b852-839ae2cf458e tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] [instance: 8a5137d8-24f6-4b78-abcb-2cf8d939df3e] Going to try to terminate instance {{(pid=101356) delete /opt/stack/nova/nova/compute/api.py:2496}} Dec 16 14:56:31.661014 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-b48af91c-a43d-42b5-bfee-14d854ca326f tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:31.670852 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-b48af91c-a43d-42b5-bfee-14d854ca326f tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46" status: 200 len: 1521 microversion: 2.1 time: 0.252421 Dec 16 14:56:31.677153 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 130/256] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:31 2021] GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46 => generated 1521 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:31.683500 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-0de7007a-f149-4b44-b397-630ae55c9a4d tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:31.683500 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-0de7007a-f149-4b44-b397-630ae55c9a4d tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] [instance: 0e5ff6f9-7844-4eb8-863d-3eb7336f13e9] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:31.688698 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0de7007a-f149-4b44-b397-630ae55c9a4d tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:31.689209 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0de7007a-f149-4b44-b397-630ae55c9a4d tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:31.690075 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0de7007a-f149-4b44-b397-630ae55c9a4d tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:31.690553 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0de7007a-f149-4b44-b397-630ae55c9a4d tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:31.752774 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-29d0bfd0-30d9-4d3f-b852-839ae2cf458e tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] 10.222.0.45 "DELETE /compute/v2.1/servers/8a5137d8-24f6-4b78-abcb-2cf8d939df3e" status: 204 len: 0 microversion: 2.1 time: 0.301549 Dec 16 14:56:31.753717 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 127/257] 10.222.0.45 () {58 vars in 1229 bytes} [Thu Dec 16 14:56:31 2021] DELETE /compute/v2.1/servers/8a5137d8-24f6-4b78-abcb-2cf8d939df3e => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 16 14:56:31.764191 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-0c7326ff-0158-4b79-9212-1665a69dfdd0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:56:31.765466 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-0c7326ff-0158-4b79-9212-1665a69dfdd0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:31.776157 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0c7326ff-0158-4b79-9212-1665a69dfdd0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:31.776683 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0c7326ff-0158-4b79-9212-1665a69dfdd0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:31.777670 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0c7326ff-0158-4b79-9212-1665a69dfdd0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:31.778202 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0c7326ff-0158-4b79-9212-1665a69dfdd0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:31.949130 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-0de7007a-f149-4b44-b397-630ae55c9a4d tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9595544d411046d18ece73d52fdeaba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb215be9a78b4d7a904be761bb48df83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:31.958113 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-0de7007a-f149-4b44-b397-630ae55c9a4d tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] 10.222.0.45 "GET /compute/v2.1/servers/0e5ff6f9-7844-4eb8-863d-3eb7336f13e9" status: 200 len: 1315 microversion: 2.1 time: 0.285742 Dec 16 14:56:31.958828 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 131/258] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:31 2021] GET /compute/v2.1/servers/0e5ff6f9-7844-4eb8-863d-3eb7336f13e9 => generated 1315 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:31.967954 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-b0f69a00-64b3-4cd0-a3e7-c8a5a2fe71d1 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:31.968620 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-b0f69a00-64b3-4cd0-a3e7-c8a5a2fe71d1 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] [instance: 8a5137d8-24f6-4b78-abcb-2cf8d939df3e] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:31.977972 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b0f69a00-64b3-4cd0-a3e7-c8a5a2fe71d1 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:31.978507 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b0f69a00-64b3-4cd0-a3e7-c8a5a2fe71d1 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:31.979353 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b0f69a00-64b3-4cd0-a3e7-c8a5a2fe71d1 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:31.979841 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b0f69a00-64b3-4cd0-a3e7-c8a5a2fe71d1 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:32.061213 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-0c7326ff-0158-4b79-9212-1665a69dfdd0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 14 microversion: 2.1 time: 0.305642 Dec 16 14:56:32.062235 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 128/259] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:56:31 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 14 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 14:56:32.072505 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-6fe0bc89-59ef-4e6c-84b7-91eb9ac3e7af tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:56:32.073623 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-6fe0bc89-59ef-4e6c-84b7-91eb9ac3e7af tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:32.081880 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6fe0bc89-59ef-4e6c-84b7-91eb9ac3e7af tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:32.082410 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6fe0bc89-59ef-4e6c-84b7-91eb9ac3e7af tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:32.083253 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6fe0bc89-59ef-4e6c-84b7-91eb9ac3e7af tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:32.083738 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6fe0bc89-59ef-4e6c-84b7-91eb9ac3e7af tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:32.292415 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-b0f69a00-64b3-4cd0-a3e7-c8a5a2fe71d1 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7623b303ca8244b58179ef0146dd2bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8372f52bdbf443385cd0058e122fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:32.302070 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-b0f69a00-64b3-4cd0-a3e7-c8a5a2fe71d1 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] 10.222.0.45 "GET /compute/v2.1/servers/8a5137d8-24f6-4b78-abcb-2cf8d939df3e" status: 200 len: 1553 microversion: 2.1 time: 0.342171 Dec 16 14:56:32.302683 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 132/260] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:31 2021] GET /compute/v2.1/servers/8a5137d8-24f6-4b78-abcb-2cf8d939df3e => generated 1553 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:32.362803 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-6fe0bc89-59ef-4e6c-84b7-91eb9ac3e7af tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 200 len: 14 microversion: 2.20 time: 0.298973 Dec 16 14:56:32.363515 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 129/261] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:56:32 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 14 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:32.427051 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-88bd91d2-902d-48da-a70a-179718ad2704 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:32.427724 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-88bd91d2-902d-48da-a70a-179718ad2704 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] [instance: 07dfd5e5-b751-4ebb-a023-9e0dbe8abc65] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:32.435517 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-88bd91d2-902d-48da-a70a-179718ad2704 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:32.436028 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-88bd91d2-902d-48da-a70a-179718ad2704 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:32.436881 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-88bd91d2-902d-48da-a70a-179718ad2704 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:32.437379 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-88bd91d2-902d-48da-a70a-179718ad2704 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:32.693173 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-8394dc75-d6cc-4cd4-946a-b19908adba54 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:32.693931 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-8394dc75-d6cc-4cd4-946a-b19908adba54 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: bcaa83bc-5d07-413a-88e5-b7428a5b5d46] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:32.703840 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8394dc75-d6cc-4cd4-946a-b19908adba54 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:32.704538 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8394dc75-d6cc-4cd4-946a-b19908adba54 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:32.705839 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8394dc75-d6cc-4cd4-946a-b19908adba54 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:32.706359 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8394dc75-d6cc-4cd4-946a-b19908adba54 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:32.985950 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-8394dc75-d6cc-4cd4-946a-b19908adba54 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:33.026419 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-88bd91d2-902d-48da-a70a-179718ad2704 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e94f83a79ca42c691dc29a189a64a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4732b1ccb145414ba7d9f3d93df9f8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:33.030012 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-8394dc75-d6cc-4cd4-946a-b19908adba54 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46" status: 200 len: 1521 microversion: 2.1 time: 0.344901 Dec 16 14:56:33.034137 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 130/262] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:32 2021] GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46 => generated 1521 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:33.042496 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-88bd91d2-902d-48da-a70a-179718ad2704 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] 10.222.0.45 "GET /compute/v2.1/servers/07dfd5e5-b751-4ebb-a023-9e0dbe8abc65" status: 200 len: 1504 microversion: 2.1 time: 0.622500 Dec 16 14:56:33.044096 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 133/263] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:32 2021] GET /compute/v2.1/servers/07dfd5e5-b751-4ebb-a023-9e0dbe8abc65 => generated 1504 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:33.051927 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-b33bcc5c-e216-4298-bb45-c9dc8fd416ed tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:33.052698 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-b33bcc5c-e216-4298-bb45-c9dc8fd416ed tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] [instance: 0e5ff6f9-7844-4eb8-863d-3eb7336f13e9] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:33.064524 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b33bcc5c-e216-4298-bb45-c9dc8fd416ed tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:33.077550 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b33bcc5c-e216-4298-bb45-c9dc8fd416ed tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:33.082918 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b33bcc5c-e216-4298-bb45-c9dc8fd416ed tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:33.082918 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b33bcc5c-e216-4298-bb45-c9dc8fd416ed tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:33.083176 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-fe61be6c-67ea-4d12-b7d5-4120b8a02eef tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:56:33.083176 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-fe61be6c-67ea-4d12-b7d5-4120b8a02eef tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:33.092000 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fe61be6c-67ea-4d12-b7d5-4120b8a02eef tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:33.092510 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fe61be6c-67ea-4d12-b7d5-4120b8a02eef tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:33.093424 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fe61be6c-67ea-4d12-b7d5-4120b8a02eef tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:33.093918 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fe61be6c-67ea-4d12-b7d5-4120b8a02eef tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:33.278859 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-fe61be6c-67ea-4d12-b7d5-4120b8a02eef tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 14 microversion: 2.1 time: 0.209209 Dec 16 14:56:33.279593 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 134/264] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:56:33 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 14 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 14:56:33.310761 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [req-1475a285-37bc-425d-8def-a8d93132e40f req-03e60096-e21f-4357-9c14-d0d143e4f8fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07dfd5e5-b751-4ebb-a023-9e0dbe8abc65", "name": "network-vif-deleted", "tag": "710cb508-8728-4320-ba9e-9fbeb9b340ec"}]} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:56:33.316232 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:56:33.316232 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: warnings.warn(msg) Dec 16 14:56:33.336566 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-1475a285-37bc-425d-8def-a8d93132e40f req-03e60096-e21f-4357-9c14-d0d143e4f8fc service nova] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:33.337120 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-1475a285-37bc-425d-8def-a8d93132e40f req-03e60096-e21f-4357-9c14-d0d143e4f8fc service nova] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:33.360194 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.compute.server_external_events [req-1475a285-37bc-425d-8def-a8d93132e40f req-03e60096-e21f-4357-9c14-d0d143e4f8fc service nova] Creating event network-vif-deleted:710cb508-8728-4320-ba9e-9fbeb9b340ec for instance 07dfd5e5-b751-4ebb-a023-9e0dbe8abc65 on hv-cinder-82189 Dec 16 14:56:33.366468 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [req-1475a285-37bc-425d-8def-a8d93132e40f req-03e60096-e21f-4357-9c14-d0d143e4f8fc service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064657 Dec 16 14:56:33.369144 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 135/265] 10.222.0.45 () {64 vars in 1308 bytes} [Thu Dec 16 14:56:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 14:56:33.381599 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-e07c5250-8296-4858-b902-1db950b7c962 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:33.382672 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-e07c5250-8296-4858-b902-1db950b7c962 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] [instance: 8a5137d8-24f6-4b78-abcb-2cf8d939df3e] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:33.391695 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e07c5250-8296-4858-b902-1db950b7c962 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:33.395968 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e07c5250-8296-4858-b902-1db950b7c962 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:33.395968 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e07c5250-8296-4858-b902-1db950b7c962 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:33.395968 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e07c5250-8296-4858-b902-1db950b7c962 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:33.412136 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-b33bcc5c-e216-4298-bb45-c9dc8fd416ed tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9595544d411046d18ece73d52fdeaba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb215be9a78b4d7a904be761bb48df83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:33.422589 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-b33bcc5c-e216-4298-bb45-c9dc8fd416ed tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] 10.222.0.45 "GET /compute/v2.1/servers/0e5ff6f9-7844-4eb8-863d-3eb7336f13e9" status: 200 len: 1315 microversion: 2.1 time: 0.385942 Dec 16 14:56:33.423664 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 131/266] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:33 2021] GET /compute/v2.1/servers/0e5ff6f9-7844-4eb8-863d-3eb7336f13e9 => generated 1315 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:33.432895 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-2b8d29e4-1110-4ba3-9b2e-289ed3eb185d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:56:33.434739 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-2b8d29e4-1110-4ba3-9b2e-289ed3eb185d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:33.444941 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2b8d29e4-1110-4ba3-9b2e-289ed3eb185d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:33.446083 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2b8d29e4-1110-4ba3-9b2e-289ed3eb185d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:33.446994 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2b8d29e4-1110-4ba3-9b2e-289ed3eb185d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:33.447722 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2b8d29e4-1110-4ba3-9b2e-289ed3eb185d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:33.604365 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-2b8d29e4-1110-4ba3-9b2e-289ed3eb185d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 200 len: 14 microversion: 2.20 time: 0.179124 Dec 16 14:56:33.608079 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 132/267] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:56:33 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 14 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:33.677573 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-e07c5250-8296-4858-b902-1db950b7c962 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7623b303ca8244b58179ef0146dd2bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8372f52bdbf443385cd0058e122fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:33.688597 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-e07c5250-8296-4858-b902-1db950b7c962 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] 10.222.0.45 "GET /compute/v2.1/servers/8a5137d8-24f6-4b78-abcb-2cf8d939df3e" status: 200 len: 1553 microversion: 2.1 time: 0.319255 Dec 16 14:56:33.689206 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 136/268] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:33 2021] GET /compute/v2.1/servers/8a5137d8-24f6-4b78-abcb-2cf8d939df3e => generated 1553 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:34.056031 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-07dd1e2d-5ce3-48dd-999f-b512e5d2c004 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:34.056797 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-07dd1e2d-5ce3-48dd-999f-b512e5d2c004 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: bcaa83bc-5d07-413a-88e5-b7428a5b5d46] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:34.065400 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-07dd1e2d-5ce3-48dd-999f-b512e5d2c004 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:34.065921 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-07dd1e2d-5ce3-48dd-999f-b512e5d2c004 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:34.066789 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-07dd1e2d-5ce3-48dd-999f-b512e5d2c004 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:34.067280 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-07dd1e2d-5ce3-48dd-999f-b512e5d2c004 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:34.070454 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-0306ccbb-65a2-4eb8-a7af-2e4f6d6f56c4 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:34.071627 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-0306ccbb-65a2-4eb8-a7af-2e4f6d6f56c4 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] [instance: 07dfd5e5-b751-4ebb-a023-9e0dbe8abc65] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:34.079675 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0306ccbb-65a2-4eb8-a7af-2e4f6d6f56c4 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:34.080183 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0306ccbb-65a2-4eb8-a7af-2e4f6d6f56c4 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:34.081305 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0306ccbb-65a2-4eb8-a7af-2e4f6d6f56c4 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:34.081795 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0306ccbb-65a2-4eb8-a7af-2e4f6d6f56c4 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:34.168262 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0306ccbb-65a2-4eb8-a7af-2e4f6d6f56c4 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:34.168262 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0306ccbb-65a2-4eb8-a7af-2e4f6d6f56c4 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:34.168698 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.objects.instance [None req-0306ccbb-65a2-4eb8-a7af-2e4f6d6f56c4 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lazy-loading 'fault' on Instance uuid 07dfd5e5-b751-4ebb-a023-9e0dbe8abc65 {{(pid=101355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 16 14:56:34.290492 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-07dd1e2d-5ce3-48dd-999f-b512e5d2c004 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:34.309674 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-07dd1e2d-5ce3-48dd-999f-b512e5d2c004 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46" status: 200 len: 1521 microversion: 2.1 time: 0.261780 Dec 16 14:56:34.310602 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 133/269] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:34 2021] GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46 => generated 1521 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:34.319898 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-c11d7a2a-416a-44f2-9e0e-6795d0062f41 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:56:34.322109 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-c11d7a2a-416a-44f2-9e0e-6795d0062f41 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:34.332135 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c11d7a2a-416a-44f2-9e0e-6795d0062f41 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:34.332881 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c11d7a2a-416a-44f2-9e0e-6795d0062f41 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:34.334127 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c11d7a2a-416a-44f2-9e0e-6795d0062f41 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:34.334800 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c11d7a2a-416a-44f2-9e0e-6795d0062f41 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:34.349946 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-0306ccbb-65a2-4eb8-a7af-2e4f6d6f56c4 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e94f83a79ca42c691dc29a189a64a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4732b1ccb145414ba7d9f3d93df9f8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:34.359339 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-0306ccbb-65a2-4eb8-a7af-2e4f6d6f56c4 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] 10.222.0.45 "GET /compute/v2.1/servers/07dfd5e5-b751-4ebb-a023-9e0dbe8abc65" status: 200 len: 1304 microversion: 2.1 time: 0.296407 Dec 16 14:56:34.360164 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 137/270] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:34 2021] GET /compute/v2.1/servers/07dfd5e5-b751-4ebb-a023-9e0dbe8abc65 => generated 1304 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:34.446937 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-7f846f5f-e82b-4987-b9c1-a6f9885c92a6 tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:34.447614 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-7f846f5f-e82b-4987-b9c1-a6f9885c92a6 tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] [instance: 0e5ff6f9-7844-4eb8-863d-3eb7336f13e9] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:34.457153 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7f846f5f-e82b-4987-b9c1-a6f9885c92a6 tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:34.457667 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7f846f5f-e82b-4987-b9c1-a6f9885c92a6 tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:34.458572 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7f846f5f-e82b-4987-b9c1-a6f9885c92a6 tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:34.459076 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7f846f5f-e82b-4987-b9c1-a6f9885c92a6 tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:34.666486 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-c11d7a2a-416a-44f2-9e0e-6795d0062f41 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 14 microversion: 2.1 time: 0.354152 Dec 16 14:56:34.671070 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 134/271] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:56:34 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 14 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 14:56:34.681810 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-31c29e48-c95f-46b1-bd43-6920ed710442 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:56:34.682948 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-31c29e48-c95f-46b1-bd43-6920ed710442 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:34.691825 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-31c29e48-c95f-46b1-bd43-6920ed710442 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:34.692336 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-31c29e48-c95f-46b1-bd43-6920ed710442 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:34.693188 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-31c29e48-c95f-46b1-bd43-6920ed710442 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:34.693884 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-31c29e48-c95f-46b1-bd43-6920ed710442 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:34.849469 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-7f846f5f-e82b-4987-b9c1-a6f9885c92a6 tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9595544d411046d18ece73d52fdeaba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb215be9a78b4d7a904be761bb48df83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:34.859083 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-7f846f5f-e82b-4987-b9c1-a6f9885c92a6 tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] 10.222.0.45 "GET /compute/v2.1/servers/0e5ff6f9-7844-4eb8-863d-3eb7336f13e9" status: 200 len: 1315 microversion: 2.1 time: 0.420715 Dec 16 14:56:34.859665 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 138/272] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:34 2021] GET /compute/v2.1/servers/0e5ff6f9-7844-4eb8-863d-3eb7336f13e9 => generated 1315 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:56:34.870520 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-0f75c2c9-4b47-42db-af30-8e708e0f6466 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:34.871204 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-0f75c2c9-4b47-42db-af30-8e708e0f6466 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] [instance: 8a5137d8-24f6-4b78-abcb-2cf8d939df3e] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:34.878391 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-31c29e48-c95f-46b1-bd43-6920ed710442 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 200 len: 14 microversion: 2.20 time: 0.205653 Dec 16 14:56:34.879069 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 135/273] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:56:34 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 14 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:34.883957 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0f75c2c9-4b47-42db-af30-8e708e0f6466 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:34.884411 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0f75c2c9-4b47-42db-af30-8e708e0f6466 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:34.885360 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0f75c2c9-4b47-42db-af30-8e708e0f6466 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:34.885857 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0f75c2c9-4b47-42db-af30-8e708e0f6466 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:35.124462 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-0f75c2c9-4b47-42db-af30-8e708e0f6466 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7623b303ca8244b58179ef0146dd2bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8372f52bdbf443385cd0058e122fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:35.133956 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-0f75c2c9-4b47-42db-af30-8e708e0f6466 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] 10.222.0.45 "GET /compute/v2.1/servers/8a5137d8-24f6-4b78-abcb-2cf8d939df3e" status: 200 len: 1553 microversion: 2.1 time: 0.272969 Dec 16 14:56:35.134641 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 139/274] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:34 2021] GET /compute/v2.1/servers/8a5137d8-24f6-4b78-abcb-2cf8d939df3e => generated 1553 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:35.335744 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-6f7abe4f-6937-481b-be5d-dd0213c59c15 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:35.347416 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-6f7abe4f-6937-481b-be5d-dd0213c59c15 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: bcaa83bc-5d07-413a-88e5-b7428a5b5d46] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:35.356718 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6f7abe4f-6937-481b-be5d-dd0213c59c15 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:35.357402 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6f7abe4f-6937-481b-be5d-dd0213c59c15 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:35.358550 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6f7abe4f-6937-481b-be5d-dd0213c59c15 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:35.359191 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6f7abe4f-6937-481b-be5d-dd0213c59c15 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:35.397818 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-92165b1b-4177-469e-8b0e-d5bd90bbc215 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:35.399487 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-92165b1b-4177-469e-8b0e-d5bd90bbc215 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] [instance: 07dfd5e5-b751-4ebb-a023-9e0dbe8abc65] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:35.408912 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-92165b1b-4177-469e-8b0e-d5bd90bbc215 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:35.409417 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-92165b1b-4177-469e-8b0e-d5bd90bbc215 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:35.410304 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-92165b1b-4177-469e-8b0e-d5bd90bbc215 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:35.410793 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-92165b1b-4177-469e-8b0e-d5bd90bbc215 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:35.473013 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.wsgi [None req-92165b1b-4177-469e-8b0e-d5bd90bbc215 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] HTTP exception thrown: Instance 07dfd5e5-b751-4ebb-a023-9e0dbe8abc65 could not be found. Dec 16 14:56:35.473471 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-92165b1b-4177-469e-8b0e-d5bd90bbc215 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Returning 404 to user: Instance 07dfd5e5-b751-4ebb-a023-9e0dbe8abc65 could not be found. {{(pid=101355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:941}} Dec 16 14:56:35.474389 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-92165b1b-4177-469e-8b0e-d5bd90bbc215 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] 10.222.0.45 "GET /compute/v2.1/servers/07dfd5e5-b751-4ebb-a023-9e0dbe8abc65" status: 404 len: 111 microversion: 2.1 time: 0.099902 Dec 16 14:56:35.475090 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 140/275] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:35 2021] GET /compute/v2.1/servers/07dfd5e5-b751-4ebb-a023-9e0dbe8abc65 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 14:56:35.606031 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-6f7abe4f-6937-481b-be5d-dd0213c59c15 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:35.612410 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-4e72df6c-dd53-443b-a185-f0931ca67dde tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1754951760", "imageRef": "9b00ff4e-db72-4324-820b-87a6bd73b055", "flavorRef": "452", "networks": [{"uuid": "dccb4f55-43d1-4fdb-b128-a148d791e0a8"}]}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:56:35.615865 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-6f7abe4f-6937-481b-be5d-dd0213c59c15 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46" status: 200 len: 1521 microversion: 2.1 time: 0.288500 Dec 16 14:56:35.616473 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 136/276] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:35 2021] GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46 => generated 1521 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:35.682801 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-39a58d42-9347-485c-99b8-ab0cfbf89bd8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:56:35.686192 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-39a58d42-9347-485c-99b8-ab0cfbf89bd8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:35.697120 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-39a58d42-9347-485c-99b8-ab0cfbf89bd8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:35.703764 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-39a58d42-9347-485c-99b8-ab0cfbf89bd8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:35.710236 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-39a58d42-9347-485c-99b8-ab0cfbf89bd8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:35.710236 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-39a58d42-9347-485c-99b8-ab0cfbf89bd8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:35.717553 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.network.neutron [None req-4e72df6c-dd53-443b-a185-f0931ca67dde tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] validate_networks() for [('dccb4f55-43d1-4fdb-b128-a148d791e0a8', None, None, None)] {{(pid=101355) validate_networks /opt/stack/nova/nova/network/neutron.py:2383}} Dec 16 14:56:35.875428 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-39a58d42-9347-485c-99b8-ab0cfbf89bd8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 14 microversion: 2.1 time: 0.199967 Dec 16 14:56:35.876113 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 137/277] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:56:35 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 14 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 14:56:35.888463 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-562ed675-4830-4b75-ba99-c3081f53ea2e tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:35.889387 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-562ed675-4830-4b75-ba99-c3081f53ea2e tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] [instance: 0e5ff6f9-7844-4eb8-863d-3eb7336f13e9] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:35.900650 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-562ed675-4830-4b75-ba99-c3081f53ea2e tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:35.901097 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-562ed675-4830-4b75-ba99-c3081f53ea2e tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:35.901942 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-562ed675-4830-4b75-ba99-c3081f53ea2e tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:35.902560 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-562ed675-4830-4b75-ba99-c3081f53ea2e tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:36.142990 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-562ed675-4830-4b75-ba99-c3081f53ea2e tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9595544d411046d18ece73d52fdeaba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb215be9a78b4d7a904be761bb48df83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:36.154678 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-562ed675-4830-4b75-ba99-c3081f53ea2e tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] 10.222.0.45 "GET /compute/v2.1/servers/0e5ff6f9-7844-4eb8-863d-3eb7336f13e9" status: 200 len: 1315 microversion: 2.1 time: 0.276755 Dec 16 14:56:36.165512 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 138/278] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:35 2021] GET /compute/v2.1/servers/0e5ff6f9-7844-4eb8-863d-3eb7336f13e9 => generated 1315 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:36.165512 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-deaa96f6-db26-4fb7-b263-7aa969b01a2a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:56:36.165512 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-deaa96f6-db26-4fb7-b263-7aa969b01a2a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:36.173655 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-deaa96f6-db26-4fb7-b263-7aa969b01a2a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:36.174198 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-deaa96f6-db26-4fb7-b263-7aa969b01a2a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:36.175146 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-deaa96f6-db26-4fb7-b263-7aa969b01a2a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:36.175534 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-deaa96f6-db26-4fb7-b263-7aa969b01a2a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:36.313977 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-deaa96f6-db26-4fb7-b263-7aa969b01a2a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 200 len: 14 microversion: 2.20 time: 0.157248 Dec 16 14:56:36.317879 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 139/279] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:56:36 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 14 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:36.326105 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-e6460d61-b863-4b68-ae80-685ec96dc1c3 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:36.326885 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-e6460d61-b863-4b68-ae80-685ec96dc1c3 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] [instance: 8a5137d8-24f6-4b78-abcb-2cf8d939df3e] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:36.337597 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e6460d61-b863-4b68-ae80-685ec96dc1c3 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:36.337597 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e6460d61-b863-4b68-ae80-685ec96dc1c3 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:36.338790 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e6460d61-b863-4b68-ae80-685ec96dc1c3 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:36.338901 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e6460d61-b863-4b68-ae80-685ec96dc1c3 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:36.600540 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-e6460d61-b863-4b68-ae80-685ec96dc1c3 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7623b303ca8244b58179ef0146dd2bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8372f52bdbf443385cd0058e122fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:36.612109 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-e6460d61-b863-4b68-ae80-685ec96dc1c3 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] 10.222.0.45 "GET /compute/v2.1/servers/8a5137d8-24f6-4b78-abcb-2cf8d939df3e" status: 200 len: 1553 microversion: 2.1 time: 0.295722 Dec 16 14:56:36.613020 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 140/280] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:36 2021] GET /compute/v2.1/servers/8a5137d8-24f6-4b78-abcb-2cf8d939df3e => generated 1553 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:36.636832 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-513af724-78b4-4b45-ae65-83205812e5d1 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:36.637770 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-513af724-78b4-4b45-ae65-83205812e5d1 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: bcaa83bc-5d07-413a-88e5-b7428a5b5d46] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:36.645864 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-513af724-78b4-4b45-ae65-83205812e5d1 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:36.646413 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-513af724-78b4-4b45-ae65-83205812e5d1 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:36.647253 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-513af724-78b4-4b45-ae65-83205812e5d1 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:36.647749 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-513af724-78b4-4b45-ae65-83205812e5d1 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:36.900048 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-513af724-78b4-4b45-ae65-83205812e5d1 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:36.921453 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-513af724-78b4-4b45-ae65-83205812e5d1 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46" status: 200 len: 1521 microversion: 2.1 time: 0.292269 Dec 16 14:56:36.922079 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 141/281] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:36 2021] GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46 => generated 1521 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:56:36.941719 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-4cc411ad-be23-4248-b7ae-c1059f811717 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:56:36.943489 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-4cc411ad-be23-4248-b7ae-c1059f811717 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:36.956259 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4cc411ad-be23-4248-b7ae-c1059f811717 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:36.956889 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4cc411ad-be23-4248-b7ae-c1059f811717 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:36.959695 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4cc411ad-be23-4248-b7ae-c1059f811717 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:36.959695 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4cc411ad-be23-4248-b7ae-c1059f811717 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:36.996677 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.virt.hardware [None req-4e72df6c-dd53-443b-a185-f0931ca67dde tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Flavor limits 0:0:0 {{(pid=101355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:338}} Dec 16 14:56:36.997146 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.virt.hardware [None req-4e72df6c-dd53-443b-a185-f0931ca67dde tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Image limits 0:0:0 {{(pid=101355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:342}} Dec 16 14:56:36.997684 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.virt.hardware [None req-4e72df6c-dd53-443b-a185-f0931ca67dde tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Flavor pref 0:0:0 {{(pid=101355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:378}} Dec 16 14:56:36.998147 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.virt.hardware [None req-4e72df6c-dd53-443b-a185-f0931ca67dde tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Image pref 0:0:0 {{(pid=101355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:382}} Dec 16 14:56:36.998993 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.virt.hardware [None req-4e72df6c-dd53-443b-a185-f0931ca67dde tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=101355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:422}} Dec 16 14:56:37.008564 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4e72df6c-dd53-443b-a185-f0931ca67dde tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:37.009278 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4e72df6c-dd53-443b-a185-f0931ca67dde tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:37.011774 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4e72df6c-dd53-443b-a185-f0931ca67dde tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:37.014002 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4e72df6c-dd53-443b-a185-f0931ca67dde tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:37.035695 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.quota [None req-4e72df6c-dd53-443b-a185-f0931ca67dde tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Getting quotas for project 4732b1ccb145414ba7d9f3d93df9f8d5. Resources: {'ram', 'instances', 'cores'} {{(pid=101355) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 16 14:56:37.040462 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.quota [None req-4e72df6c-dd53-443b-a185-f0931ca67dde tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Getting quotas for user 8e94f83a79ca42c691dc29a189a64a35 and project 4732b1ccb145414ba7d9f3d93df9f8d5. Resources: {'ram', 'instances', 'cores'} {{(pid=101355) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 16 14:56:37.052457 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-4e72df6c-dd53-443b-a185-f0931ca67dde tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Going to run 1 instances... {{(pid=101355) _provision_instances /opt/stack/nova/nova/compute/api.py:1224}} Dec 16 14:56:37.055181 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-4e72df6c-dd53-443b-a185-f0931ca67dde tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] [instance: ebac3c82-8804-4181-82ec-ca1f3bf55076] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9b00ff4e-db72-4324-820b-87a6bd73b055',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1616}} Dec 16 14:56:37.127326 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-4cc411ad-be23-4248-b7ae-c1059f811717 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 6451 microversion: 2.1 time: 0.193022 Dec 16 14:56:37.128027 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 142/282] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:56:36 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 6451 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:37.142000 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-4e72df6c-dd53-443b-a185-f0931ca67dde tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.538042 Dec 16 14:56:37.146850 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 141/283] 10.222.0.45 () {60 vars in 1137 bytes} [Thu Dec 16 14:56:35 2021] POST /compute/v2.1/servers => generated 380 bytes in 1544 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 16 14:56:37.168035 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [req-f88d1b00-12c3-4182-84d4-60b228cabffc req-7844c75c-ffe3-41b2-82b0-6f0b9b7f523b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e5ff6f9-7844-4eb8-863d-3eb7336f13e9", "name": "network-vif-plugged", "status": "completed", "tag": "7acef39a-9c04-451d-a9cb-0b2592134f8b"}]} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:56:37.173006 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:56:37.173006 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: warnings.warn(msg) Dec 16 14:56:37.186953 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-03053e74-ecc9-44f6-9863-ce3883f36938 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:37.191964 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-03053e74-ecc9-44f6-9863-ce3883f36938 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] [instance: ebac3c82-8804-4181-82ec-ca1f3bf55076] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:37.222695 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-f88d1b00-12c3-4182-84d4-60b228cabffc req-7844c75c-ffe3-41b2-82b0-6f0b9b7f523b service nova] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:37.225672 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-f88d1b00-12c3-4182-84d4-60b228cabffc req-7844c75c-ffe3-41b2-82b0-6f0b9b7f523b service nova] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:37.277868 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.compute.server_external_events [req-f88d1b00-12c3-4182-84d4-60b228cabffc req-7844c75c-ffe3-41b2-82b0-6f0b9b7f523b service nova] Creating event network-vif-plugged:7acef39a-9c04-451d-a9cb-0b2592134f8b for instance 0e5ff6f9-7844-4eb8-863d-3eb7336f13e9 on hv-cinder-82189 Dec 16 14:56:37.290470 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [req-f88d1b00-12c3-4182-84d4-60b228cabffc req-7844c75c-ffe3-41b2-82b0-6f0b9b7f523b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155502 Dec 16 14:56:37.291366 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 143/284] 10.222.0.45 () {64 vars in 1308 bytes} [Thu Dec 16 14:56:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 14:56:37.310133 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-ce294361-0f2d-4f4b-bc5d-315e884ab10f tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:37.320462 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-ce294361-0f2d-4f4b-bc5d-315e884ab10f tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] [instance: 0e5ff6f9-7844-4eb8-863d-3eb7336f13e9] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:37.358521 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ce294361-0f2d-4f4b-bc5d-315e884ab10f tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:37.367255 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ce294361-0f2d-4f4b-bc5d-315e884ab10f tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:37.370010 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ce294361-0f2d-4f4b-bc5d-315e884ab10f tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:37.372407 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ce294361-0f2d-4f4b-bc5d-315e884ab10f tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:37.394374 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-03053e74-ecc9-44f6-9863-ce3883f36938 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e94f83a79ca42c691dc29a189a64a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4732b1ccb145414ba7d9f3d93df9f8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:37.413327 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-03053e74-ecc9-44f6-9863-ce3883f36938 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] 10.222.0.45 "GET /compute/v2.1/servers/ebac3c82-8804-4181-82ec-ca1f3bf55076" status: 200 len: 1214 microversion: 2.1 time: 0.258703 Dec 16 14:56:37.414655 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 142/285] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:37 2021] GET /compute/v2.1/servers/ebac3c82-8804-4181-82ec-ca1f3bf55076 => generated 1214 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:37.432148 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [req-93daf83f-f001-4016-b74b-851108d18d13 req-f6f1c8ec-aaa7-40ca-a656-a4aaf94a14b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a5137d8-24f6-4b78-abcb-2cf8d939df3e", "name": "network-vif-deleted", "tag": "fe38e090-8b64-4c8e-9be5-fa79544d452c"}]} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:56:37.448344 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:56:37.448344 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: warnings.warn(msg) Dec 16 14:56:37.470329 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-93daf83f-f001-4016-b74b-851108d18d13 req-f6f1c8ec-aaa7-40ca-a656-a4aaf94a14b1 service nova] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:37.471202 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-93daf83f-f001-4016-b74b-851108d18d13 req-f6f1c8ec-aaa7-40ca-a656-a4aaf94a14b1 service nova] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:37.497944 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.compute.server_external_events [req-93daf83f-f001-4016-b74b-851108d18d13 req-f6f1c8ec-aaa7-40ca-a656-a4aaf94a14b1 service nova] Creating event network-vif-deleted:fe38e090-8b64-4c8e-9be5-fa79544d452c for instance 8a5137d8-24f6-4b78-abcb-2cf8d939df3e on hv-cinder-82189 Dec 16 14:56:37.506642 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [req-93daf83f-f001-4016-b74b-851108d18d13 req-f6f1c8ec-aaa7-40ca-a656-a4aaf94a14b1 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089416 Dec 16 14:56:37.510690 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 143/286] 10.222.0.45 () {64 vars in 1308 bytes} [Thu Dec 16 14:56:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:56:37.520156 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-338efcd3-d13f-48f2-be0c-44dd417224a8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:56:37.521341 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-338efcd3-d13f-48f2-be0c-44dd417224a8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:37.532711 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-338efcd3-d13f-48f2-be0c-44dd417224a8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:37.533222 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-338efcd3-d13f-48f2-be0c-44dd417224a8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:37.534138 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-338efcd3-d13f-48f2-be0c-44dd417224a8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:37.534755 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-338efcd3-d13f-48f2-be0c-44dd417224a8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:37.712942 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-ce294361-0f2d-4f4b-bc5d-315e884ab10f tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9595544d411046d18ece73d52fdeaba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb215be9a78b4d7a904be761bb48df83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:37.724154 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-ce294361-0f2d-4f4b-bc5d-315e884ab10f tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] 10.222.0.45 "GET /compute/v2.1/servers/0e5ff6f9-7844-4eb8-863d-3eb7336f13e9" status: 200 len: 1315 microversion: 2.1 time: 0.429085 Dec 16 14:56:37.724969 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 144/287] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:37 2021] GET /compute/v2.1/servers/0e5ff6f9-7844-4eb8-863d-3eb7336f13e9 => generated 1315 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:37.734264 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-49c09c69-dde2-4956-8ee1-11e3f62529cf tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:37.734936 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-49c09c69-dde2-4956-8ee1-11e3f62529cf tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] [instance: 8a5137d8-24f6-4b78-abcb-2cf8d939df3e] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:37.743353 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-49c09c69-dde2-4956-8ee1-11e3f62529cf tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:37.743884 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-49c09c69-dde2-4956-8ee1-11e3f62529cf tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:37.744726 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-49c09c69-dde2-4956-8ee1-11e3f62529cf tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:37.745218 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-49c09c69-dde2-4956-8ee1-11e3f62529cf tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:37.757398 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-338efcd3-d13f-48f2-be0c-44dd417224a8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 200 len: 7796 microversion: 2.20 time: 0.245086 Dec 16 14:56:37.762316 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 144/288] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:56:37 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 7796 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:56:37.934609 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-49c09c69-dde2-4956-8ee1-11e3f62529cf tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7623b303ca8244b58179ef0146dd2bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8372f52bdbf443385cd0058e122fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:37.944557 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-49c09c69-dde2-4956-8ee1-11e3f62529cf tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] 10.222.0.45 "GET /compute/v2.1/servers/8a5137d8-24f6-4b78-abcb-2cf8d939df3e" status: 200 len: 1345 microversion: 2.1 time: 0.218668 Dec 16 14:56:37.950408 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 145/289] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:37 2021] GET /compute/v2.1/servers/8a5137d8-24f6-4b78-abcb-2cf8d939df3e => generated 1345 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:37.953628 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-9bf72b92-1f38-413d-b7bb-ec5d95806059 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:37.954226 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-9bf72b92-1f38-413d-b7bb-ec5d95806059 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: bcaa83bc-5d07-413a-88e5-b7428a5b5d46] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:37.964177 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9bf72b92-1f38-413d-b7bb-ec5d95806059 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:37.964688 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9bf72b92-1f38-413d-b7bb-ec5d95806059 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:37.965573 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9bf72b92-1f38-413d-b7bb-ec5d95806059 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:37.966148 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9bf72b92-1f38-413d-b7bb-ec5d95806059 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:38.142450 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-bf2453f4-8cdd-4e35-8b1f-396dbcfec0b0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:56:38.143579 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-bf2453f4-8cdd-4e35-8b1f-396dbcfec0b0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:38.152226 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-bf2453f4-8cdd-4e35-8b1f-396dbcfec0b0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:38.152732 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-bf2453f4-8cdd-4e35-8b1f-396dbcfec0b0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:38.153572 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-bf2453f4-8cdd-4e35-8b1f-396dbcfec0b0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:38.154076 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-bf2453f4-8cdd-4e35-8b1f-396dbcfec0b0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:38.237425 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-9bf72b92-1f38-413d-b7bb-ec5d95806059 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:38.246838 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-9bf72b92-1f38-413d-b7bb-ec5d95806059 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46" status: 200 len: 1521 microversion: 2.1 time: 0.310904 Dec 16 14:56:38.247405 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 145/290] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:37 2021] GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46 => generated 1521 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:38.438735 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-bc59cbee-0977-400c-879c-860574b4c8cd tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:38.438735 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-bc59cbee-0977-400c-879c-860574b4c8cd tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] [instance: ebac3c82-8804-4181-82ec-ca1f3bf55076] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:38.447304 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-bc59cbee-0977-400c-879c-860574b4c8cd tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:38.447779 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-bc59cbee-0977-400c-879c-860574b4c8cd tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:38.448651 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-bc59cbee-0977-400c-879c-860574b4c8cd tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:38.449150 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-bc59cbee-0977-400c-879c-860574b4c8cd tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:38.483236 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-bf2453f4-8cdd-4e35-8b1f-396dbcfec0b0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 13311 microversion: 2.1 time: 0.348276 Dec 16 14:56:38.487509 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 146/291] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:56:38 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 13311 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:56:38.596970 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-bc59cbee-0977-400c-879c-860574b4c8cd tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e94f83a79ca42c691dc29a189a64a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4732b1ccb145414ba7d9f3d93df9f8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:38.606300 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-bc59cbee-0977-400c-879c-860574b4c8cd tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] 10.222.0.45 "GET /compute/v2.1/servers/ebac3c82-8804-4181-82ec-ca1f3bf55076" status: 200 len: 1218 microversion: 2.1 time: 0.179503 Dec 16 14:56:38.606913 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 146/292] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:38 2021] GET /compute/v2.1/servers/ebac3c82-8804-4181-82ec-ca1f3bf55076 => generated 1218 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:38.746476 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-770efe0c-adc7-4771-bffb-c412dae9e10f tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:38.747337 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-770efe0c-adc7-4771-bffb-c412dae9e10f tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] [instance: 0e5ff6f9-7844-4eb8-863d-3eb7336f13e9] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:38.757623 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-770efe0c-adc7-4771-bffb-c412dae9e10f tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:38.758765 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-770efe0c-adc7-4771-bffb-c412dae9e10f tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:38.759707 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-770efe0c-adc7-4771-bffb-c412dae9e10f tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:38.760204 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-770efe0c-adc7-4771-bffb-c412dae9e10f tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:38.775896 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-953ec05f-2903-4bb0-94a2-a36c6f521939 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:56:38.776277 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-953ec05f-2903-4bb0-94a2-a36c6f521939 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:38.784352 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-953ec05f-2903-4bb0-94a2-a36c6f521939 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:38.784894 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-953ec05f-2903-4bb0-94a2-a36c6f521939 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:38.785677 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-953ec05f-2903-4bb0-94a2-a36c6f521939 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:38.786177 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-953ec05f-2903-4bb0-94a2-a36c6f521939 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:38.983058 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-953ec05f-2903-4bb0-94a2-a36c6f521939 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 200 len: 14028 microversion: 2.20 time: 0.217652 Dec 16 14:56:38.983855 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 147/293] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:56:38 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 14028 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:56:38.989121 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-770efe0c-adc7-4771-bffb-c412dae9e10f tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9595544d411046d18ece73d52fdeaba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb215be9a78b4d7a904be761bb48df83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:38.996380 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-2c73fe8b-6ef5-45f5-970d-9f326cad0504 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:38.996380 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-2c73fe8b-6ef5-45f5-970d-9f326cad0504 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] [instance: 8a5137d8-24f6-4b78-abcb-2cf8d939df3e] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:38.999591 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-770efe0c-adc7-4771-bffb-c412dae9e10f tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] 10.222.0.45 "GET /compute/v2.1/servers/0e5ff6f9-7844-4eb8-863d-3eb7336f13e9" status: 200 len: 1315 microversion: 2.1 time: 0.261813 Dec 16 14:56:39.000508 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 147/294] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:38 2021] GET /compute/v2.1/servers/0e5ff6f9-7844-4eb8-863d-3eb7336f13e9 => generated 1315 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:39.014514 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2c73fe8b-6ef5-45f5-970d-9f326cad0504 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:39.015032 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2c73fe8b-6ef5-45f5-970d-9f326cad0504 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:39.015948 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2c73fe8b-6ef5-45f5-970d-9f326cad0504 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:39.016446 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2c73fe8b-6ef5-45f5-970d-9f326cad0504 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:39.097430 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2c73fe8b-6ef5-45f5-970d-9f326cad0504 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:39.097951 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2c73fe8b-6ef5-45f5-970d-9f326cad0504 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:39.098495 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.objects.instance [None req-2c73fe8b-6ef5-45f5-970d-9f326cad0504 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lazy-loading 'fault' on Instance uuid 8a5137d8-24f6-4b78-abcb-2cf8d939df3e {{(pid=101355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 16 14:56:39.208759 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-2c73fe8b-6ef5-45f5-970d-9f326cad0504 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7623b303ca8244b58179ef0146dd2bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8372f52bdbf443385cd0058e122fbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:39.221120 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-2c73fe8b-6ef5-45f5-970d-9f326cad0504 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] 10.222.0.45 "GET /compute/v2.1/servers/8a5137d8-24f6-4b78-abcb-2cf8d939df3e" status: 200 len: 1350 microversion: 2.1 time: 0.235982 Dec 16 14:56:39.221897 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 148/295] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:38 2021] GET /compute/v2.1/servers/8a5137d8-24f6-4b78-abcb-2cf8d939df3e => generated 1350 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:39.268818 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-308df239-4887-405f-bd67-a13d2517f900 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:39.270212 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-308df239-4887-405f-bd67-a13d2517f900 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: bcaa83bc-5d07-413a-88e5-b7428a5b5d46] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:39.283555 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-308df239-4887-405f-bd67-a13d2517f900 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:39.284440 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-308df239-4887-405f-bd67-a13d2517f900 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:39.285663 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-308df239-4887-405f-bd67-a13d2517f900 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:39.286381 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-308df239-4887-405f-bd67-a13d2517f900 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:39.500461 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-3762aba2-9ab9-4e9c-8efb-887fd9bf0571 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:56:39.501525 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-3762aba2-9ab9-4e9c-8efb-887fd9bf0571 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:39.509842 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3762aba2-9ab9-4e9c-8efb-887fd9bf0571 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:39.510537 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3762aba2-9ab9-4e9c-8efb-887fd9bf0571 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:39.511403 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3762aba2-9ab9-4e9c-8efb-887fd9bf0571 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:39.511901 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3762aba2-9ab9-4e9c-8efb-887fd9bf0571 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:39.608322 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-308df239-4887-405f-bd67-a13d2517f900 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:39.621902 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-308df239-4887-405f-bd67-a13d2517f900 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46" status: 200 len: 1521 microversion: 2.1 time: 0.361192 Dec 16 14:56:39.629557 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 148/296] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:39 2021] GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46 => generated 1521 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:39.631530 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-a4531b39-ba8c-427d-816d-354415400de8 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:39.632205 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-a4531b39-ba8c-427d-816d-354415400de8 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] [instance: ebac3c82-8804-4181-82ec-ca1f3bf55076] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:39.641299 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a4531b39-ba8c-427d-816d-354415400de8 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:39.641813 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a4531b39-ba8c-427d-816d-354415400de8 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:39.642673 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a4531b39-ba8c-427d-816d-354415400de8 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:39.643332 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a4531b39-ba8c-427d-816d-354415400de8 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:39.777539 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-a4531b39-ba8c-427d-816d-354415400de8 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e94f83a79ca42c691dc29a189a64a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4732b1ccb145414ba7d9f3d93df9f8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:39.786711 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-a4531b39-ba8c-427d-816d-354415400de8 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] 10.222.0.45 "GET /compute/v2.1/servers/ebac3c82-8804-4181-82ec-ca1f3bf55076" status: 200 len: 1266 microversion: 2.1 time: 0.162978 Dec 16 14:56:39.787332 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 149/297] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:39 2021] GET /compute/v2.1/servers/ebac3c82-8804-4181-82ec-ca1f3bf55076 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:39.799732 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-3762aba2-9ab9-4e9c-8efb-887fd9bf0571 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 16782 microversion: 2.1 time: 0.307595 Dec 16 14:56:39.800665 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 149/298] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:56:39 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 16782 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 14:56:39.999193 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-c2990586-e6f6-4603-bcea-0b57166fec57 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:56:40.000331 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-c2990586-e6f6-4603-bcea-0b57166fec57 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:40.008806 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c2990586-e6f6-4603-bcea-0b57166fec57 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:40.009316 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c2990586-e6f6-4603-bcea-0b57166fec57 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:40.011768 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c2990586-e6f6-4603-bcea-0b57166fec57 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:40.012226 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c2990586-e6f6-4603-bcea-0b57166fec57 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:40.021529 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-e376d4fc-4b53-4d1a-bed2-c106444b51cc tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:40.022327 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-e376d4fc-4b53-4d1a-bed2-c106444b51cc tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] [instance: 0e5ff6f9-7844-4eb8-863d-3eb7336f13e9] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:40.032352 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e376d4fc-4b53-4d1a-bed2-c106444b51cc tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:40.033104 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e376d4fc-4b53-4d1a-bed2-c106444b51cc tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:40.033965 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e376d4fc-4b53-4d1a-bed2-c106444b51cc tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:40.034490 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e376d4fc-4b53-4d1a-bed2-c106444b51cc tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:40.283743 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-e376d4fc-4b53-4d1a-bed2-c106444b51cc tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9595544d411046d18ece73d52fdeaba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb215be9a78b4d7a904be761bb48df83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:40.293839 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-e376d4fc-4b53-4d1a-bed2-c106444b51cc tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] 10.222.0.45 "GET /compute/v2.1/servers/0e5ff6f9-7844-4eb8-863d-3eb7336f13e9" status: 200 len: 1464 microversion: 2.1 time: 0.279836 Dec 16 14:56:40.295361 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 150/299] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:40 2021] GET /compute/v2.1/servers/0e5ff6f9-7844-4eb8-863d-3eb7336f13e9 => generated 1464 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:40.296869 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-c2990586-e6f6-4603-bcea-0b57166fec57 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 200 len: 16721 microversion: 2.20 time: 0.304383 Dec 16 14:56:40.298308 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 150/300] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:56:39 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 16721 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:56:40.311356 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-4e92e89a-25b2-4819-ad03-a7312f956fd2 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:40.314560 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-4e92e89a-25b2-4819-ad03-a7312f956fd2 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] [instance: 8a5137d8-24f6-4b78-abcb-2cf8d939df3e] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:40.322280 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4e92e89a-25b2-4819-ad03-a7312f956fd2 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:40.322962 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4e92e89a-25b2-4819-ad03-a7312f956fd2 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:40.324030 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4e92e89a-25b2-4819-ad03-a7312f956fd2 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:40.324677 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4e92e89a-25b2-4819-ad03-a7312f956fd2 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:40.389057 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.wsgi [None req-4e92e89a-25b2-4819-ad03-a7312f956fd2 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] HTTP exception thrown: Instance 8a5137d8-24f6-4b78-abcb-2cf8d939df3e could not be found. Dec 16 14:56:40.389738 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-4e92e89a-25b2-4819-ad03-a7312f956fd2 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Returning 404 to user: Instance 8a5137d8-24f6-4b78-abcb-2cf8d939df3e could not be found. {{(pid=101355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:941}} Dec 16 14:56:40.390695 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-4e92e89a-25b2-4819-ad03-a7312f956fd2 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] 10.222.0.45 "GET /compute/v2.1/servers/8a5137d8-24f6-4b78-abcb-2cf8d939df3e" status: 404 len: 111 microversion: 2.1 time: 0.087827 Dec 16 14:56:40.391311 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 151/301] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:40 2021] GET /compute/v2.1/servers/8a5137d8-24f6-4b78-abcb-2cf8d939df3e => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 14:56:40.417710 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-61450dd7-5a93-4afe-9193-f786e8ac99ec tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:40.418402 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-61450dd7-5a93-4afe-9193-f786e8ac99ec tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] [instance: 0e5ff6f9-7844-4eb8-863d-3eb7336f13e9] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:40.427366 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-61450dd7-5a93-4afe-9193-f786e8ac99ec tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:40.427877 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-61450dd7-5a93-4afe-9193-f786e8ac99ec tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:40.428733 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-61450dd7-5a93-4afe-9193-f786e8ac99ec tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:40.429230 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-61450dd7-5a93-4afe-9193-f786e8ac99ec tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:40.520743 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-61450dd7-5a93-4afe-9193-f786e8ac99ec tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] [instance: 0e5ff6f9-7844-4eb8-863d-3eb7336f13e9] Going to try to terminate instance {{(pid=101356) delete /opt/stack/nova/nova/compute/api.py:2496}} Dec 16 14:56:40.642644 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-8e748696-5db9-406e-a7f0-7697a1789864 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:40.643768 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-8e748696-5db9-406e-a7f0-7697a1789864 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] [instance: 8a5137d8-24f6-4b78-abcb-2cf8d939df3e] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:40.662086 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8e748696-5db9-406e-a7f0-7697a1789864 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:40.668295 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8e748696-5db9-406e-a7f0-7697a1789864 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:40.669391 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8e748696-5db9-406e-a7f0-7697a1789864 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:40.670066 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8e748696-5db9-406e-a7f0-7697a1789864 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:40.729088 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.wsgi [None req-8e748696-5db9-406e-a7f0-7697a1789864 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] HTTP exception thrown: Instance 8a5137d8-24f6-4b78-abcb-2cf8d939df3e could not be found. Dec 16 14:56:40.730816 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-8e748696-5db9-406e-a7f0-7697a1789864 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Returning 404 to user: Instance 8a5137d8-24f6-4b78-abcb-2cf8d939df3e could not be found. {{(pid=101355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:941}} Dec 16 14:56:40.731750 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-8e748696-5db9-406e-a7f0-7697a1789864 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] 10.222.0.45 "GET /compute/v2.1/servers/8a5137d8-24f6-4b78-abcb-2cf8d939df3e/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.096176 Dec 16 14:56:40.732529 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 152/302] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 14:56:40 2021] GET /compute/v2.1/servers/8a5137d8-24f6-4b78-abcb-2cf8d939df3e/os-volume_attachments => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 14:56:40.743768 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-82babfc9-f3c1-48c6-bab9-9979d042b1f6 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:40.744460 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-82babfc9-f3c1-48c6-bab9-9979d042b1f6 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: bcaa83bc-5d07-413a-88e5-b7428a5b5d46] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:40.755141 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-82babfc9-f3c1-48c6-bab9-9979d042b1f6 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:40.756175 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-61450dd7-5a93-4afe-9193-f786e8ac99ec tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] 10.222.0.45 "DELETE /compute/v2.1/servers/0e5ff6f9-7844-4eb8-863d-3eb7336f13e9" status: 204 len: 0 microversion: 2.1 time: 0.366899 Dec 16 14:56:40.756638 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-82babfc9-f3c1-48c6-bab9-9979d042b1f6 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:40.757127 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 151/303] 10.222.0.45 () {58 vars in 1229 bytes} [Thu Dec 16 14:56:40 2021] DELETE /compute/v2.1/servers/0e5ff6f9-7844-4eb8-863d-3eb7336f13e9 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 16 14:56:40.757856 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-82babfc9-f3c1-48c6-bab9-9979d042b1f6 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:40.758559 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-82babfc9-f3c1-48c6-bab9-9979d042b1f6 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:40.776761 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-376a38d9-9b98-405b-9534-160b17d9b51a tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:40.777795 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-376a38d9-9b98-405b-9534-160b17d9b51a tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] [instance: 0e5ff6f9-7844-4eb8-863d-3eb7336f13e9] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:40.794310 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-376a38d9-9b98-405b-9534-160b17d9b51a tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:40.796319 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-376a38d9-9b98-405b-9534-160b17d9b51a tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:40.801572 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-376a38d9-9b98-405b-9534-160b17d9b51a tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:40.803864 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-376a38d9-9b98-405b-9534-160b17d9b51a tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:41.311006 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-376a38d9-9b98-405b-9534-160b17d9b51a tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9595544d411046d18ece73d52fdeaba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb215be9a78b4d7a904be761bb48df83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:41.311006 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-376a38d9-9b98-405b-9534-160b17d9b51a tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] 10.222.0.45 "GET /compute/v2.1/servers/0e5ff6f9-7844-4eb8-863d-3eb7336f13e9" status: 200 len: 1470 microversion: 2.1 time: 0.389629 Dec 16 14:56:41.311006 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 152/304] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:40 2021] GET /compute/v2.1/servers/0e5ff6f9-7844-4eb8-863d-3eb7336f13e9 => generated 1470 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:41.311006 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-951e89ac-b506-4b97-9ddf-39e4169d0409 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:41.312295 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-951e89ac-b506-4b97-9ddf-39e4169d0409 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] [instance: ebac3c82-8804-4181-82ec-ca1f3bf55076] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:41.312295 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-951e89ac-b506-4b97-9ddf-39e4169d0409 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:41.312295 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-951e89ac-b506-4b97-9ddf-39e4169d0409 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:41.312295 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-951e89ac-b506-4b97-9ddf-39e4169d0409 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:41.312732 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-951e89ac-b506-4b97-9ddf-39e4169d0409 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:41.317941 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-82babfc9-f3c1-48c6-bab9-9979d042b1f6 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:41.325897 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-951e89ac-b506-4b97-9ddf-39e4169d0409 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e94f83a79ca42c691dc29a189a64a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4732b1ccb145414ba7d9f3d93df9f8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:41.328331 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-82babfc9-f3c1-48c6-bab9-9979d042b1f6 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46" status: 200 len: 1521 microversion: 2.1 time: 0.594344 Dec 16 14:56:41.329112 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 153/305] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:40 2021] GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46 => generated 1521 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:41.341516 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-951e89ac-b506-4b97-9ddf-39e4169d0409 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] 10.222.0.45 "GET /compute/v2.1/servers/ebac3c82-8804-4181-82ec-ca1f3bf55076" status: 200 len: 1272 microversion: 2.1 time: 0.183169 Dec 16 14:56:41.342251 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 153/306] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:41 2021] GET /compute/v2.1/servers/ebac3c82-8804-4181-82ec-ca1f3bf55076 => generated 1272 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:41.364036 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-80c9f790-c150-44a5-885c-d70bfde7abcc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:56:41.365106 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-80c9f790-c150-44a5-885c-d70bfde7abcc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:41.365427 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-168fe7e8-124e-4904-84b7-4c1e54cc86ef tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:56:41.366754 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-168fe7e8-124e-4904-84b7-4c1e54cc86ef tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:41.373314 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-80c9f790-c150-44a5-885c-d70bfde7abcc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:41.374122 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-80c9f790-c150-44a5-885c-d70bfde7abcc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:41.375287 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-80c9f790-c150-44a5-885c-d70bfde7abcc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:41.375468 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-80c9f790-c150-44a5-885c-d70bfde7abcc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:41.396740 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-168fe7e8-124e-4904-84b7-4c1e54cc86ef tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:41.400124 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-168fe7e8-124e-4904-84b7-4c1e54cc86ef tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:41.401014 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-168fe7e8-124e-4904-84b7-4c1e54cc86ef tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:41.404001 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-168fe7e8-124e-4904-84b7-4c1e54cc86ef tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:41.559322 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-80c9f790-c150-44a5-885c-d70bfde7abcc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 200 len: 17744 microversion: 2.20 time: 0.214458 Dec 16 14:56:41.566666 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 154/307] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:56:41 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 17744 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:56:41.650600 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-168fe7e8-124e-4904-84b7-4c1e54cc86ef tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 18561 microversion: 2.1 time: 0.319619 Dec 16 14:56:41.651965 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 154/308] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:56:41 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 18561 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:56:42.320989 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-d6e033b8-4a2c-4141-8cd4-0fd285d9ad12 tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:42.320989 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-d6e033b8-4a2c-4141-8cd4-0fd285d9ad12 tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] [instance: 0e5ff6f9-7844-4eb8-863d-3eb7336f13e9] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:42.329401 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d6e033b8-4a2c-4141-8cd4-0fd285d9ad12 tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:42.329912 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d6e033b8-4a2c-4141-8cd4-0fd285d9ad12 tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:42.331052 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d6e033b8-4a2c-4141-8cd4-0fd285d9ad12 tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:42.331549 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d6e033b8-4a2c-4141-8cd4-0fd285d9ad12 tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:42.353514 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-6fd3f609-4723-45da-a5eb-6a147fd1c942 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:42.354366 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-6fd3f609-4723-45da-a5eb-6a147fd1c942 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: bcaa83bc-5d07-413a-88e5-b7428a5b5d46] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:42.362960 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6fd3f609-4723-45da-a5eb-6a147fd1c942 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:42.363765 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6fd3f609-4723-45da-a5eb-6a147fd1c942 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:42.364829 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6fd3f609-4723-45da-a5eb-6a147fd1c942 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:42.365511 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6fd3f609-4723-45da-a5eb-6a147fd1c942 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:42.608438 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-d6e033b8-4a2c-4141-8cd4-0fd285d9ad12 tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9595544d411046d18ece73d52fdeaba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb215be9a78b4d7a904be761bb48df83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:42.624543 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-d6e033b8-4a2c-4141-8cd4-0fd285d9ad12 tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] 10.222.0.45 "GET /compute/v2.1/servers/0e5ff6f9-7844-4eb8-863d-3eb7336f13e9" status: 200 len: 1470 microversion: 2.1 time: 0.312975 Dec 16 14:56:42.625215 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 155/309] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:42 2021] GET /compute/v2.1/servers/0e5ff6f9-7844-4eb8-863d-3eb7336f13e9 => generated 1470 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:42.635249 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-e782916b-681f-47b9-a770-170a4d7e4d30 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:42.638466 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-e782916b-681f-47b9-a770-170a4d7e4d30 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] [instance: ebac3c82-8804-4181-82ec-ca1f3bf55076] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:42.653035 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e782916b-681f-47b9-a770-170a4d7e4d30 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:42.653688 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e782916b-681f-47b9-a770-170a4d7e4d30 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:42.654579 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e782916b-681f-47b9-a770-170a4d7e4d30 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:42.655077 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e782916b-681f-47b9-a770-170a4d7e4d30 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:42.786263 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-6fd3f609-4723-45da-a5eb-6a147fd1c942 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:42.801382 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-6fd3f609-4723-45da-a5eb-6a147fd1c942 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46" status: 200 len: 1521 microversion: 2.1 time: 0.457571 Dec 16 14:56:42.802895 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 155/310] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:42 2021] GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46 => generated 1521 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:56:42.812179 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-0913fcf6-691c-42dc-9025-8aa73c2abbcb tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:56:42.813242 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-0913fcf6-691c-42dc-9025-8aa73c2abbcb tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:42.821218 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0913fcf6-691c-42dc-9025-8aa73c2abbcb tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:42.821730 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0913fcf6-691c-42dc-9025-8aa73c2abbcb tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:42.822595 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0913fcf6-691c-42dc-9025-8aa73c2abbcb tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:42.823410 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0913fcf6-691c-42dc-9025-8aa73c2abbcb tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:42.912178 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-e782916b-681f-47b9-a770-170a4d7e4d30 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e94f83a79ca42c691dc29a189a64a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4732b1ccb145414ba7d9f3d93df9f8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:42.925459 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-e782916b-681f-47b9-a770-170a4d7e4d30 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] 10.222.0.45 "GET /compute/v2.1/servers/ebac3c82-8804-4181-82ec-ca1f3bf55076" status: 200 len: 1314 microversion: 2.1 time: 0.298826 Dec 16 14:56:42.926125 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 156/311] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:42 2021] GET /compute/v2.1/servers/ebac3c82-8804-4181-82ec-ca1f3bf55076 => generated 1314 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:42.938068 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-16c392de-8606-4345-a5c4-57e89d439dea tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:56:42.939556 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-16c392de-8606-4345-a5c4-57e89d439dea tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:42.949706 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-16c392de-8606-4345-a5c4-57e89d439dea tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:42.950465 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-16c392de-8606-4345-a5c4-57e89d439dea tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:42.951863 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-16c392de-8606-4345-a5c4-57e89d439dea tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:42.952500 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-16c392de-8606-4345-a5c4-57e89d439dea tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:43.141641 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-0913fcf6-691c-42dc-9025-8aa73c2abbcb tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 200 len: 19342 microversion: 2.20 time: 0.336900 Dec 16 14:56:43.145500 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 156/312] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:56:42 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 19342 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:56:43.158552 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-aec7a046-3488-4490-9bc5-d9b8883c349d tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:43.159218 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-aec7a046-3488-4490-9bc5-d9b8883c349d tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] [instance: 8a5137d8-24f6-4b78-abcb-2cf8d939df3e] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:43.167875 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-aec7a046-3488-4490-9bc5-d9b8883c349d tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:43.168367 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-aec7a046-3488-4490-9bc5-d9b8883c349d tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:43.169227 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-aec7a046-3488-4490-9bc5-d9b8883c349d tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:43.169725 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-aec7a046-3488-4490-9bc5-d9b8883c349d tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:43.194620 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-16c392de-8606-4345-a5c4-57e89d439dea tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 20984 microversion: 2.1 time: 0.266772 Dec 16 14:56:43.196251 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 157/313] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:56:42 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 20984 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:56:43.206207 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [req-a9c7f9c1-1734-42d3-a57f-413db85fce06 req-12901f59-726e-4d5a-9a68-07e60d49737b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebac3c82-8804-4181-82ec-ca1f3bf55076", "tag": "96f464f8-7a32-4677-a9f6-58f3e9c5a773"}]} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:56:43.212087 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:56:43.212087 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: warnings.warn(msg) Dec 16 14:56:43.223541 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-a9c7f9c1-1734-42d3-a57f-413db85fce06 req-12901f59-726e-4d5a-9a68-07e60d49737b service nova] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:43.224396 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-a9c7f9c1-1734-42d3-a57f-413db85fce06 req-12901f59-726e-4d5a-9a68-07e60d49737b service nova] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:43.243382 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.compute.server_external_events [req-a9c7f9c1-1734-42d3-a57f-413db85fce06 req-12901f59-726e-4d5a-9a68-07e60d49737b service nova] Creating event network-changed:96f464f8-7a32-4677-a9f6-58f3e9c5a773 for instance ebac3c82-8804-4181-82ec-ca1f3bf55076 on hv-cinder-82189 Dec 16 14:56:43.249245 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [req-a9c7f9c1-1734-42d3-a57f-413db85fce06 req-12901f59-726e-4d5a-9a68-07e60d49737b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051178 Dec 16 14:56:43.252544 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 158/314] 10.222.0.45 () {64 vars in 1308 bytes} [Thu Dec 16 14:56:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:56:43.257395 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.wsgi [None req-aec7a046-3488-4490-9bc5-d9b8883c349d tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] HTTP exception thrown: Instance 8a5137d8-24f6-4b78-abcb-2cf8d939df3e could not be found. Dec 16 14:56:43.258930 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-aec7a046-3488-4490-9bc5-d9b8883c349d tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Returning 404 to user: Instance 8a5137d8-24f6-4b78-abcb-2cf8d939df3e could not be found. {{(pid=101355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:941}} Dec 16 14:56:43.260054 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-aec7a046-3488-4490-9bc5-d9b8883c349d tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] 10.222.0.45 "DELETE /compute/v2.1/servers/8a5137d8-24f6-4b78-abcb-2cf8d939df3e" status: 404 len: 111 microversion: 2.1 time: 0.116153 Dec 16 14:56:43.260902 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 157/315] 10.222.0.45 () {58 vars in 1229 bytes} [Thu Dec 16 14:56:43 2021] DELETE /compute/v2.1/servers/8a5137d8-24f6-4b78-abcb-2cf8d939df3e => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 14:56:43.275381 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-b08cad49-e416-4dc7-9468-f417d966c732 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:43.282174 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-b08cad49-e416-4dc7-9468-f417d966c732 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] [instance: 8a5137d8-24f6-4b78-abcb-2cf8d939df3e] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:43.285417 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b08cad49-e416-4dc7-9468-f417d966c732 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:43.286107 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b08cad49-e416-4dc7-9468-f417d966c732 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:43.287053 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b08cad49-e416-4dc7-9468-f417d966c732 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:43.287564 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b08cad49-e416-4dc7-9468-f417d966c732 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:43.366317 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.wsgi [None req-b08cad49-e416-4dc7-9468-f417d966c732 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] HTTP exception thrown: Instance 8a5137d8-24f6-4b78-abcb-2cf8d939df3e could not be found. Dec 16 14:56:43.366978 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-b08cad49-e416-4dc7-9468-f417d966c732 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] Returning 404 to user: Instance 8a5137d8-24f6-4b78-abcb-2cf8d939df3e could not be found. {{(pid=101356) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:941}} Dec 16 14:56:43.368606 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-b08cad49-e416-4dc7-9468-f417d966c732 tempest-DeleteServersTestJSON-1090531767 tempest-DeleteServersTestJSON-1090531767-project] 10.222.0.45 "GET /compute/v2.1/servers/8a5137d8-24f6-4b78-abcb-2cf8d939df3e" status: 404 len: 111 microversion: 2.1 time: 0.102624 Dec 16 14:56:43.369571 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 159/316] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:43 2021] GET /compute/v2.1/servers/8a5137d8-24f6-4b78-abcb-2cf8d939df3e => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 14:56:43.647580 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-edd096e7-89fe-47f7-9cb0-c5765b98d206 tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:43.648263 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-edd096e7-89fe-47f7-9cb0-c5765b98d206 tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] [instance: 0e5ff6f9-7844-4eb8-863d-3eb7336f13e9] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:43.656872 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-edd096e7-89fe-47f7-9cb0-c5765b98d206 tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:43.657393 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-edd096e7-89fe-47f7-9cb0-c5765b98d206 tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:43.660263 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-edd096e7-89fe-47f7-9cb0-c5765b98d206 tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:43.660263 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-edd096e7-89fe-47f7-9cb0-c5765b98d206 tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:43.825840 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-f8971643-b976-4f8f-9e37-217c0509cdd0 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:43.826836 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-f8971643-b976-4f8f-9e37-217c0509cdd0 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: bcaa83bc-5d07-413a-88e5-b7428a5b5d46] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:43.837526 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f8971643-b976-4f8f-9e37-217c0509cdd0 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:43.838023 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f8971643-b976-4f8f-9e37-217c0509cdd0 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:43.838910 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f8971643-b976-4f8f-9e37-217c0509cdd0 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:43.839396 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f8971643-b976-4f8f-9e37-217c0509cdd0 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:44.474160 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-edd096e7-89fe-47f7-9cb0-c5765b98d206 tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9595544d411046d18ece73d52fdeaba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb215be9a78b4d7a904be761bb48df83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:44.495618 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-edd096e7-89fe-47f7-9cb0-c5765b98d206 tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] 10.222.0.45 "GET /compute/v2.1/servers/0e5ff6f9-7844-4eb8-863d-3eb7336f13e9" status: 200 len: 1470 microversion: 2.1 time: 0.856285 Dec 16 14:56:44.509085 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 158/317] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:43 2021] GET /compute/v2.1/servers/0e5ff6f9-7844-4eb8-863d-3eb7336f13e9 => generated 1470 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:44.514579 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-150a1d11-7092-4c93-a135-6da91772f5dd tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:44.515763 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-150a1d11-7092-4c93-a135-6da91772f5dd tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] [instance: ebac3c82-8804-4181-82ec-ca1f3bf55076] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:44.525772 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-150a1d11-7092-4c93-a135-6da91772f5dd tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:44.526430 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-150a1d11-7092-4c93-a135-6da91772f5dd tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:44.527745 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-150a1d11-7092-4c93-a135-6da91772f5dd tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:44.528956 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-150a1d11-7092-4c93-a135-6da91772f5dd tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:44.715476 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-f8971643-b976-4f8f-9e37-217c0509cdd0 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:44.724747 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-f8971643-b976-4f8f-9e37-217c0509cdd0 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46" status: 200 len: 1521 microversion: 2.1 time: 0.907932 Dec 16 14:56:44.725651 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 160/318] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:43 2021] GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46 => generated 1521 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:56:44.734917 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-06428d4d-8fcd-44cb-8105-e6d6ac6b8886 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:56:44.736066 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-06428d4d-8fcd-44cb-8105-e6d6ac6b8886 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:44.744795 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-06428d4d-8fcd-44cb-8105-e6d6ac6b8886 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:44.745317 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-06428d4d-8fcd-44cb-8105-e6d6ac6b8886 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:44.746279 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-06428d4d-8fcd-44cb-8105-e6d6ac6b8886 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:44.746791 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-06428d4d-8fcd-44cb-8105-e6d6ac6b8886 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:44.890876 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-06428d4d-8fcd-44cb-8105-e6d6ac6b8886 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 200 len: 22494 microversion: 2.20 time: 0.163803 Dec 16 14:56:44.891736 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 161/319] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:56:44 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 22494 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:56:44.902270 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-17cd0aad-42c4-4043-b8b3-a7e9be04568d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:56:44.902757 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-17cd0aad-42c4-4043-b8b3-a7e9be04568d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:44.911577 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-17cd0aad-42c4-4043-b8b3-a7e9be04568d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:44.912089 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-17cd0aad-42c4-4043-b8b3-a7e9be04568d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:44.912962 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-17cd0aad-42c4-4043-b8b3-a7e9be04568d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:44.913504 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-17cd0aad-42c4-4043-b8b3-a7e9be04568d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:45.177967 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-17cd0aad-42c4-4043-b8b3-a7e9be04568d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 23215 microversion: 2.1 time: 0.284589 Dec 16 14:56:45.182417 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 162/320] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:56:44 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 23215 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:56:45.235143 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-150a1d11-7092-4c93-a135-6da91772f5dd tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e94f83a79ca42c691dc29a189a64a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4732b1ccb145414ba7d9f3d93df9f8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:45.246970 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-150a1d11-7092-4c93-a135-6da91772f5dd tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] 10.222.0.45 "GET /compute/v2.1/servers/ebac3c82-8804-4181-82ec-ca1f3bf55076" status: 200 len: 1314 microversion: 2.1 time: 0.746663 Dec 16 14:56:45.248044 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 159/321] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:44 2021] GET /compute/v2.1/servers/ebac3c82-8804-4181-82ec-ca1f3bf55076 => generated 1314 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:45.524862 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-381e9917-ae56-470e-82c7-43c5c88fb188 tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:45.525621 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-381e9917-ae56-470e-82c7-43c5c88fb188 tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] [instance: 0e5ff6f9-7844-4eb8-863d-3eb7336f13e9] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:45.535789 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-381e9917-ae56-470e-82c7-43c5c88fb188 tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:45.536582 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-381e9917-ae56-470e-82c7-43c5c88fb188 tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:45.537319 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-381e9917-ae56-470e-82c7-43c5c88fb188 tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:45.538215 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-381e9917-ae56-470e-82c7-43c5c88fb188 tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:45.549378 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [req-7f417a18-2d01-4bfa-a31d-33efbf8f41c3 req-5ab232ef-cf44-4101-8a2d-78d6cb63427a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e5ff6f9-7844-4eb8-863d-3eb7336f13e9", "name": "network-vif-deleted", "tag": "7acef39a-9c04-451d-a9cb-0b2592134f8b"}]} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:56:45.557004 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:56:45.557004 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: warnings.warn(msg) Dec 16 14:56:45.569612 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-7f417a18-2d01-4bfa-a31d-33efbf8f41c3 req-5ab232ef-cf44-4101-8a2d-78d6cb63427a service nova] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:45.571421 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-7f417a18-2d01-4bfa-a31d-33efbf8f41c3 req-5ab232ef-cf44-4101-8a2d-78d6cb63427a service nova] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:45.608206 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.compute.server_external_events [req-7f417a18-2d01-4bfa-a31d-33efbf8f41c3 req-5ab232ef-cf44-4101-8a2d-78d6cb63427a service nova] Creating event network-vif-deleted:7acef39a-9c04-451d-a9cb-0b2592134f8b for instance 0e5ff6f9-7844-4eb8-863d-3eb7336f13e9 on hv-cinder-82189 Dec 16 14:56:45.614152 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [req-7f417a18-2d01-4bfa-a31d-33efbf8f41c3 req-5ab232ef-cf44-4101-8a2d-78d6cb63427a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074383 Dec 16 14:56:45.615286 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 160/322] 10.222.0.45 () {64 vars in 1308 bytes} [Thu Dec 16 14:56:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:56:45.705608 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-381e9917-ae56-470e-82c7-43c5c88fb188 tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9595544d411046d18ece73d52fdeaba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb215be9a78b4d7a904be761bb48df83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:45.714766 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-381e9917-ae56-470e-82c7-43c5c88fb188 tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] 10.222.0.45 "GET /compute/v2.1/servers/0e5ff6f9-7844-4eb8-863d-3eb7336f13e9" status: 200 len: 1428 microversion: 2.1 time: 0.200708 Dec 16 14:56:45.715660 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 163/323] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:45 2021] GET /compute/v2.1/servers/0e5ff6f9-7844-4eb8-863d-3eb7336f13e9 => generated 1428 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:45.753538 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-9b80892f-020c-445e-bc18-7d0e12a657c7 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:45.754309 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-9b80892f-020c-445e-bc18-7d0e12a657c7 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: bcaa83bc-5d07-413a-88e5-b7428a5b5d46] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:45.764724 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9b80892f-020c-445e-bc18-7d0e12a657c7 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:45.765215 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9b80892f-020c-445e-bc18-7d0e12a657c7 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:45.766298 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9b80892f-020c-445e-bc18-7d0e12a657c7 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:45.767175 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9b80892f-020c-445e-bc18-7d0e12a657c7 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:45.908717 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-39bc8881-ed14-493d-bb6b-a948dba54ceb tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:56:45.910885 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-39bc8881-ed14-493d-bb6b-a948dba54ceb tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:45.920671 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-39bc8881-ed14-493d-bb6b-a948dba54ceb tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:45.923554 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-39bc8881-ed14-493d-bb6b-a948dba54ceb tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:45.924475 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-39bc8881-ed14-493d-bb6b-a948dba54ceb tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:45.925032 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-39bc8881-ed14-493d-bb6b-a948dba54ceb tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:46.126018 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-39bc8881-ed14-493d-bb6b-a948dba54ceb tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 200 len: 23602 microversion: 2.20 time: 0.226059 Dec 16 14:56:46.127115 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 164/324] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:56:45 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 23602 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:56:46.195543 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-e64137b5-f44a-4b62-9579-67a4d30676c3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:56:46.196718 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-e64137b5-f44a-4b62-9579-67a4d30676c3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:46.206147 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e64137b5-f44a-4b62-9579-67a4d30676c3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:46.206888 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e64137b5-f44a-4b62-9579-67a4d30676c3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:46.207907 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e64137b5-f44a-4b62-9579-67a4d30676c3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:46.208558 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e64137b5-f44a-4b62-9579-67a4d30676c3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:46.397076 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-e64137b5-f44a-4b62-9579-67a4d30676c3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 24058 microversion: 2.1 time: 0.209989 Dec 16 14:56:46.397982 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 165/325] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:56:46 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 24058 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 14:56:46.413131 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-0cb198d5-dd20-4376-9ff2-abdb0b870ceb tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:46.414744 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-0cb198d5-dd20-4376-9ff2-abdb0b870ceb tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] [instance: ebac3c82-8804-4181-82ec-ca1f3bf55076] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:46.415968 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-9b80892f-020c-445e-bc18-7d0e12a657c7 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:46.426729 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0cb198d5-dd20-4376-9ff2-abdb0b870ceb tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:46.427294 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-9b80892f-020c-445e-bc18-7d0e12a657c7 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46" status: 200 len: 1521 microversion: 2.1 time: 0.687236 Dec 16 14:56:46.427762 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0cb198d5-dd20-4376-9ff2-abdb0b870ceb tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:46.427877 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 161/326] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:45 2021] GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46 => generated 1521 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:46.428958 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0cb198d5-dd20-4376-9ff2-abdb0b870ceb tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:46.429630 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0cb198d5-dd20-4376-9ff2-abdb0b870ceb tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:46.678374 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-0cb198d5-dd20-4376-9ff2-abdb0b870ceb tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e94f83a79ca42c691dc29a189a64a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4732b1ccb145414ba7d9f3d93df9f8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:46.687603 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-0cb198d5-dd20-4376-9ff2-abdb0b870ceb tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] 10.222.0.45 "GET /compute/v2.1/servers/ebac3c82-8804-4181-82ec-ca1f3bf55076" status: 200 len: 1314 microversion: 2.1 time: 0.284453 Dec 16 14:56:46.687943 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 166/327] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:46 2021] GET /compute/v2.1/servers/ebac3c82-8804-4181-82ec-ca1f3bf55076 => generated 1314 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:46.737097 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-f5033c84-3ad4-4f5e-aa59-0a9e578794e4 tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:46.737772 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-f5033c84-3ad4-4f5e-aa59-0a9e578794e4 tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] [instance: 0e5ff6f9-7844-4eb8-863d-3eb7336f13e9] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:46.747809 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f5033c84-3ad4-4f5e-aa59-0a9e578794e4 tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:46.748317 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f5033c84-3ad4-4f5e-aa59-0a9e578794e4 tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:46.749183 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f5033c84-3ad4-4f5e-aa59-0a9e578794e4 tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:46.749826 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f5033c84-3ad4-4f5e-aa59-0a9e578794e4 tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:46.901285 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f5033c84-3ad4-4f5e-aa59-0a9e578794e4 tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:46.902013 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f5033c84-3ad4-4f5e-aa59-0a9e578794e4 tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:46.902551 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.objects.instance [None req-f5033c84-3ad4-4f5e-aa59-0a9e578794e4 tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Lazy-loading 'fault' on Instance uuid 0e5ff6f9-7844-4eb8-863d-3eb7336f13e9 {{(pid=101355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 16 14:56:47.067058 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-f5033c84-3ad4-4f5e-aa59-0a9e578794e4 tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9595544d411046d18ece73d52fdeaba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb215be9a78b4d7a904be761bb48df83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:47.076524 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-f5033c84-3ad4-4f5e-aa59-0a9e578794e4 tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] 10.222.0.45 "GET /compute/v2.1/servers/0e5ff6f9-7844-4eb8-863d-3eb7336f13e9" status: 200 len: 1305 microversion: 2.1 time: 0.347481 Dec 16 14:56:47.077443 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 162/328] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:46 2021] GET /compute/v2.1/servers/0e5ff6f9-7844-4eb8-863d-3eb7336f13e9 => generated 1305 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:47.143764 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-a09f2a02-8bc6-473d-b9b7-4a2cd2d6e84a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:56:47.144800 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-a09f2a02-8bc6-473d-b9b7-4a2cd2d6e84a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:47.152811 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a09f2a02-8bc6-473d-b9b7-4a2cd2d6e84a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:47.153317 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a09f2a02-8bc6-473d-b9b7-4a2cd2d6e84a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:47.154176 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a09f2a02-8bc6-473d-b9b7-4a2cd2d6e84a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:47.154768 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a09f2a02-8bc6-473d-b9b7-4a2cd2d6e84a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:47.412788 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-f369ec76-c864-4aec-a52c-3ae6bb44b526 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:56:47.414730 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-f369ec76-c864-4aec-a52c-3ae6bb44b526 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:47.416248 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-a09f2a02-8bc6-473d-b9b7-4a2cd2d6e84a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 200 len: 24348 microversion: 2.20 time: 0.280699 Dec 16 14:56:47.417584 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 167/329] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:56:47 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 24348 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:56:47.422851 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f369ec76-c864-4aec-a52c-3ae6bb44b526 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:47.423661 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f369ec76-c864-4aec-a52c-3ae6bb44b526 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:47.424618 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f369ec76-c864-4aec-a52c-3ae6bb44b526 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:47.425109 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f369ec76-c864-4aec-a52c-3ae6bb44b526 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:47.451670 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-2620b98e-b93b-4a9c-a156-002114a579b1 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:47.452627 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-2620b98e-b93b-4a9c-a156-002114a579b1 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: bcaa83bc-5d07-413a-88e5-b7428a5b5d46] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:47.464026 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2620b98e-b93b-4a9c-a156-002114a579b1 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:47.464539 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2620b98e-b93b-4a9c-a156-002114a579b1 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:47.465399 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2620b98e-b93b-4a9c-a156-002114a579b1 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:47.466266 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2620b98e-b93b-4a9c-a156-002114a579b1 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:47.637032 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-f369ec76-c864-4aec-a52c-3ae6bb44b526 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 24871 microversion: 2.1 time: 0.231521 Dec 16 14:56:47.637727 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 163/330] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:56:47 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 24871 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:56:47.710500 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-5e1e6e89-8229-447a-a231-96739901f71f tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:47.712020 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-5e1e6e89-8229-447a-a231-96739901f71f tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] [instance: ebac3c82-8804-4181-82ec-ca1f3bf55076] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:47.720375 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5e1e6e89-8229-447a-a231-96739901f71f tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:47.723589 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5e1e6e89-8229-447a-a231-96739901f71f tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:47.723589 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5e1e6e89-8229-447a-a231-96739901f71f tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:47.723589 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5e1e6e89-8229-447a-a231-96739901f71f tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:47.734274 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-2620b98e-b93b-4a9c-a156-002114a579b1 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:47.743415 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-2620b98e-b93b-4a9c-a156-002114a579b1 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46" status: 200 len: 1521 microversion: 2.1 time: 0.302426 Dec 16 14:56:47.744615 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 168/331] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:47 2021] GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46 => generated 1521 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:48.028190 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-5e1e6e89-8229-447a-a231-96739901f71f tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e94f83a79ca42c691dc29a189a64a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4732b1ccb145414ba7d9f3d93df9f8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:48.036949 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-5e1e6e89-8229-447a-a231-96739901f71f tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] 10.222.0.45 "GET /compute/v2.1/servers/ebac3c82-8804-4181-82ec-ca1f3bf55076" status: 200 len: 1314 microversion: 2.1 time: 0.334985 Dec 16 14:56:48.037554 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 164/332] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:47 2021] GET /compute/v2.1/servers/ebac3c82-8804-4181-82ec-ca1f3bf55076 => generated 1314 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:56:48.099270 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-6ba8f550-7f5e-48e0-80a6-c05e9364429c tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:48.099949 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-6ba8f550-7f5e-48e0-80a6-c05e9364429c tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] [instance: 0e5ff6f9-7844-4eb8-863d-3eb7336f13e9] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:48.108069 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6ba8f550-7f5e-48e0-80a6-c05e9364429c tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:48.108509 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6ba8f550-7f5e-48e0-80a6-c05e9364429c tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:48.109351 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6ba8f550-7f5e-48e0-80a6-c05e9364429c tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:48.109838 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6ba8f550-7f5e-48e0-80a6-c05e9364429c tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:48.162516 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.wsgi [None req-6ba8f550-7f5e-48e0-80a6-c05e9364429c tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] HTTP exception thrown: Instance 0e5ff6f9-7844-4eb8-863d-3eb7336f13e9 could not be found. Dec 16 14:56:48.163176 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-6ba8f550-7f5e-48e0-80a6-c05e9364429c tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] Returning 404 to user: Instance 0e5ff6f9-7844-4eb8-863d-3eb7336f13e9 could not be found. {{(pid=101356) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:941}} Dec 16 14:56:48.164580 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-6ba8f550-7f5e-48e0-80a6-c05e9364429c tempest-VolumesNegativeTest-966427241 tempest-VolumesNegativeTest-966427241-project] 10.222.0.45 "GET /compute/v2.1/servers/0e5ff6f9-7844-4eb8-863d-3eb7336f13e9" status: 404 len: 111 microversion: 2.1 time: 0.072834 Dec 16 14:56:48.165192 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 169/333] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:48 2021] GET /compute/v2.1/servers/0e5ff6f9-7844-4eb8-863d-3eb7336f13e9 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 14:56:48.434229 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-6b5ed164-86cc-463d-b6c6-21483cf62e5f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:56:48.435367 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-6b5ed164-86cc-463d-b6c6-21483cf62e5f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:48.443683 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6b5ed164-86cc-463d-b6c6-21483cf62e5f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:48.444899 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6b5ed164-86cc-463d-b6c6-21483cf62e5f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:48.445188 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6b5ed164-86cc-463d-b6c6-21483cf62e5f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:48.445829 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6b5ed164-86cc-463d-b6c6-21483cf62e5f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:48.622683 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-6b5ed164-86cc-463d-b6c6-21483cf62e5f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 200 len: 25048 microversion: 2.20 time: 0.197389 Dec 16 14:56:48.627598 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 165/334] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:56:48 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 25048 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:56:48.656519 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-b05ebb4c-04ef-4e88-a13f-31f002689b2a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:56:48.658533 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-b05ebb4c-04ef-4e88-a13f-31f002689b2a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:48.673152 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b05ebb4c-04ef-4e88-a13f-31f002689b2a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:48.674149 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b05ebb4c-04ef-4e88-a13f-31f002689b2a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:48.675252 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b05ebb4c-04ef-4e88-a13f-31f002689b2a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:48.675946 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b05ebb4c-04ef-4e88-a13f-31f002689b2a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:48.768294 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-a7d28300-faf7-4c4d-a1d3-7a8744cdeaee tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:48.769234 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-a7d28300-faf7-4c4d-a1d3-7a8744cdeaee tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: bcaa83bc-5d07-413a-88e5-b7428a5b5d46] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:48.778850 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a7d28300-faf7-4c4d-a1d3-7a8744cdeaee tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:48.779423 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a7d28300-faf7-4c4d-a1d3-7a8744cdeaee tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:48.780543 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a7d28300-faf7-4c4d-a1d3-7a8744cdeaee tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:48.781112 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a7d28300-faf7-4c4d-a1d3-7a8744cdeaee tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:48.859115 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-b05ebb4c-04ef-4e88-a13f-31f002689b2a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 25735 microversion: 2.1 time: 0.213923 Dec 16 14:56:48.859870 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 170/335] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:56:48 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 25735 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:56:49.054131 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-a7d28300-faf7-4c4d-a1d3-7a8744cdeaee tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:49.059687 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-6ae54da7-6d84-4c97-ba6c-202cdd72d208 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:49.060436 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-6ae54da7-6d84-4c97-ba6c-202cdd72d208 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] [instance: ebac3c82-8804-4181-82ec-ca1f3bf55076] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:49.063308 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-a7d28300-faf7-4c4d-a1d3-7a8744cdeaee tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46" status: 200 len: 1521 microversion: 2.1 time: 0.305875 Dec 16 14:56:49.065161 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 166/336] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:48 2021] GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46 => generated 1521 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:49.079840 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6ae54da7-6d84-4c97-ba6c-202cdd72d208 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:49.080733 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6ae54da7-6d84-4c97-ba6c-202cdd72d208 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:49.081685 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6ae54da7-6d84-4c97-ba6c-202cdd72d208 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:49.082222 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6ae54da7-6d84-4c97-ba6c-202cdd72d208 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:49.412607 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-6ae54da7-6d84-4c97-ba6c-202cdd72d208 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e94f83a79ca42c691dc29a189a64a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4732b1ccb145414ba7d9f3d93df9f8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:49.431840 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-6ae54da7-6d84-4c97-ba6c-202cdd72d208 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] 10.222.0.45 "GET /compute/v2.1/servers/ebac3c82-8804-4181-82ec-ca1f3bf55076" status: 200 len: 1314 microversion: 2.1 time: 0.380754 Dec 16 14:56:49.432455 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 171/337] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:49 2021] GET /compute/v2.1/servers/ebac3c82-8804-4181-82ec-ca1f3bf55076 => generated 1314 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:49.645668 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-6142daf9-40ec-4b04-80ef-6c20108059eb tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:56:49.646908 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-6142daf9-40ec-4b04-80ef-6c20108059eb tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:49.672490 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6142daf9-40ec-4b04-80ef-6c20108059eb tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:49.673091 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6142daf9-40ec-4b04-80ef-6c20108059eb tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:49.674304 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6142daf9-40ec-4b04-80ef-6c20108059eb tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:49.674811 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6142daf9-40ec-4b04-80ef-6c20108059eb tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:49.875523 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-c2da5694-bfc1-4c46-b310-e7a5984870e2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:56:49.877245 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-c2da5694-bfc1-4c46-b310-e7a5984870e2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:49.885900 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c2da5694-bfc1-4c46-b310-e7a5984870e2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:49.886475 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c2da5694-bfc1-4c46-b310-e7a5984870e2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:49.887377 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c2da5694-bfc1-4c46-b310-e7a5984870e2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:49.888310 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c2da5694-bfc1-4c46-b310-e7a5984870e2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:50.007566 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-6142daf9-40ec-4b04-80ef-6c20108059eb tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 200 len: 26081 microversion: 2.20 time: 0.372206 Dec 16 14:56:50.009185 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 167/338] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:56:49 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 26081 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:56:50.091187 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-4a7a34ab-e4f2-4241-8cbd-b809d6529dbb tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:50.091936 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-4a7a34ab-e4f2-4241-8cbd-b809d6529dbb tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: bcaa83bc-5d07-413a-88e5-b7428a5b5d46] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:50.100012 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-c2da5694-bfc1-4c46-b310-e7a5984870e2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 26460 microversion: 2.1 time: 0.233013 Dec 16 14:56:50.102166 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 172/339] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:56:49 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 26460 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 14:56:50.106683 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4a7a34ab-e4f2-4241-8cbd-b809d6529dbb tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:50.107408 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4a7a34ab-e4f2-4241-8cbd-b809d6529dbb tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:50.108472 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4a7a34ab-e4f2-4241-8cbd-b809d6529dbb tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:50.109171 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4a7a34ab-e4f2-4241-8cbd-b809d6529dbb tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:50.448790 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-4a7a34ab-e4f2-4241-8cbd-b809d6529dbb tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:50.456452 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-4c523de9-fb44-4630-afa7-85cf23d043a2 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:50.458578 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-4c523de9-fb44-4630-afa7-85cf23d043a2 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] [instance: ebac3c82-8804-4181-82ec-ca1f3bf55076] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:50.461963 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-4a7a34ab-e4f2-4241-8cbd-b809d6529dbb tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46" status: 200 len: 1521 microversion: 2.1 time: 0.381458 Dec 16 14:56:50.462617 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 168/340] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:50 2021] GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46 => generated 1521 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:56:50.484854 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4c523de9-fb44-4630-afa7-85cf23d043a2 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:50.486507 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4c523de9-fb44-4630-afa7-85cf23d043a2 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:50.488060 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4c523de9-fb44-4630-afa7-85cf23d043a2 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:50.488742 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4c523de9-fb44-4630-afa7-85cf23d043a2 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:50.780552 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-4c523de9-fb44-4630-afa7-85cf23d043a2 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e94f83a79ca42c691dc29a189a64a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4732b1ccb145414ba7d9f3d93df9f8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:50.793954 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-4c523de9-fb44-4630-afa7-85cf23d043a2 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] 10.222.0.45 "GET /compute/v2.1/servers/ebac3c82-8804-4181-82ec-ca1f3bf55076" status: 200 len: 1314 microversion: 2.1 time: 0.348323 Dec 16 14:56:50.794897 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 173/341] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:50 2021] GET /compute/v2.1/servers/ebac3c82-8804-4181-82ec-ca1f3bf55076 => generated 1314 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:51.026725 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-e139ee99-4d72-4878-afa6-3d3e664b7967 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:56:51.027784 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-e139ee99-4d72-4878-afa6-3d3e664b7967 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:51.046997 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e139ee99-4d72-4878-afa6-3d3e664b7967 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:51.047482 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e139ee99-4d72-4878-afa6-3d3e664b7967 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:51.048551 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e139ee99-4d72-4878-afa6-3d3e664b7967 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:51.049472 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e139ee99-4d72-4878-afa6-3d3e664b7967 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:51.123595 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-4714c4f8-00b8-435f-bfcd-11df183d358a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:56:51.125815 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-4714c4f8-00b8-435f-bfcd-11df183d358a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:51.141009 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4714c4f8-00b8-435f-bfcd-11df183d358a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:51.141592 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4714c4f8-00b8-435f-bfcd-11df183d358a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:51.142667 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4714c4f8-00b8-435f-bfcd-11df183d358a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:51.143175 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4714c4f8-00b8-435f-bfcd-11df183d358a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:51.295167 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-e139ee99-4d72-4878-afa6-3d3e664b7967 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 200 len: 26885 microversion: 2.20 time: 0.277364 Dec 16 14:56:51.295974 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 169/342] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:56:51 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 26885 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:56:51.349788 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-4714c4f8-00b8-435f-bfcd-11df183d358a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 27061 microversion: 2.1 time: 0.239275 Dec 16 14:56:51.350776 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 174/343] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:56:51 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 27061 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:56:51.486025 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-9e56dc49-15e7-4b16-8916-4873bd59ef3c tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:51.486992 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-9e56dc49-15e7-4b16-8916-4873bd59ef3c tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: bcaa83bc-5d07-413a-88e5-b7428a5b5d46] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:51.497554 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9e56dc49-15e7-4b16-8916-4873bd59ef3c tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:51.498319 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9e56dc49-15e7-4b16-8916-4873bd59ef3c tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:51.499351 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9e56dc49-15e7-4b16-8916-4873bd59ef3c tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:51.499994 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9e56dc49-15e7-4b16-8916-4873bd59ef3c tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:51.818614 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-9f393287-e078-4d66-a903-640aff7d763f tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:51.819643 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-9f393287-e078-4d66-a903-640aff7d763f tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] [instance: ebac3c82-8804-4181-82ec-ca1f3bf55076] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:51.832748 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9f393287-e078-4d66-a903-640aff7d763f tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:51.833237 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9f393287-e078-4d66-a903-640aff7d763f tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:51.834350 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9f393287-e078-4d66-a903-640aff7d763f tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:51.834854 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9f393287-e078-4d66-a903-640aff7d763f tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:51.941877 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-9e56dc49-15e7-4b16-8916-4873bd59ef3c tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:51.967657 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-9e56dc49-15e7-4b16-8916-4873bd59ef3c tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46" status: 200 len: 1521 microversion: 2.1 time: 0.490528 Dec 16 14:56:51.968862 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 170/344] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:51 2021] GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46 => generated 1521 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:52.140441 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-9f393287-e078-4d66-a903-640aff7d763f tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e94f83a79ca42c691dc29a189a64a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4732b1ccb145414ba7d9f3d93df9f8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:52.152063 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-9f393287-e078-4d66-a903-640aff7d763f tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] 10.222.0.45 "GET /compute/v2.1/servers/ebac3c82-8804-4181-82ec-ca1f3bf55076" status: 200 len: 1314 microversion: 2.1 time: 0.342496 Dec 16 14:56:52.162619 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 175/345] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:51 2021] GET /compute/v2.1/servers/ebac3c82-8804-4181-82ec-ca1f3bf55076 => generated 1314 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:52.314404 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-743b69c6-9109-481d-87c8-7ae35bda5b24 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:56:52.315601 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-743b69c6-9109-481d-87c8-7ae35bda5b24 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:52.330476 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-743b69c6-9109-481d-87c8-7ae35bda5b24 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:52.331088 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-743b69c6-9109-481d-87c8-7ae35bda5b24 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:52.332197 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-743b69c6-9109-481d-87c8-7ae35bda5b24 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:52.332809 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-743b69c6-9109-481d-87c8-7ae35bda5b24 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:52.367513 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-a2eabc4a-0490-4bb0-86ed-87d59e48ae93 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:56:52.376648 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-a2eabc4a-0490-4bb0-86ed-87d59e48ae93 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:52.405994 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a2eabc4a-0490-4bb0-86ed-87d59e48ae93 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:52.406725 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a2eabc4a-0490-4bb0-86ed-87d59e48ae93 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:52.407644 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a2eabc4a-0490-4bb0-86ed-87d59e48ae93 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:52.408144 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a2eabc4a-0490-4bb0-86ed-87d59e48ae93 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:52.519236 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-743b69c6-9109-481d-87c8-7ae35bda5b24 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 200 len: 27397 microversion: 2.20 time: 0.213982 Dec 16 14:56:52.519943 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 171/346] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:56:52 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 27397 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:56:52.602771 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-a2eabc4a-0490-4bb0-86ed-87d59e48ae93 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 27506 microversion: 2.1 time: 0.243155 Dec 16 14:56:52.603694 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 176/347] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:56:52 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 27506 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:56:52.991485 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-54368a79-e551-4c49-9d8d-79493ebfad9a tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:52.994153 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-54368a79-e551-4c49-9d8d-79493ebfad9a tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: bcaa83bc-5d07-413a-88e5-b7428a5b5d46] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:53.012347 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-54368a79-e551-4c49-9d8d-79493ebfad9a tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:53.014601 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-54368a79-e551-4c49-9d8d-79493ebfad9a tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:53.017416 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-54368a79-e551-4c49-9d8d-79493ebfad9a tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:53.017416 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-54368a79-e551-4c49-9d8d-79493ebfad9a tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:53.183390 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-f36246db-16ca-4547-b6a0-697e8fb6ae39 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:53.186950 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-f36246db-16ca-4547-b6a0-697e8fb6ae39 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] [instance: ebac3c82-8804-4181-82ec-ca1f3bf55076] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:53.206394 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f36246db-16ca-4547-b6a0-697e8fb6ae39 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:53.208588 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f36246db-16ca-4547-b6a0-697e8fb6ae39 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:53.215375 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f36246db-16ca-4547-b6a0-697e8fb6ae39 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:53.216065 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f36246db-16ca-4547-b6a0-697e8fb6ae39 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:53.669746 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-54368a79-e551-4c49-9d8d-79493ebfad9a tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:53.682909 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-54368a79-e551-4c49-9d8d-79493ebfad9a tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46" status: 200 len: 1521 microversion: 2.1 time: 0.699822 Dec 16 14:56:53.683778 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 172/348] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:52 2021] GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46 => generated 1521 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:53.686912 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-f36246db-16ca-4547-b6a0-697e8fb6ae39 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e94f83a79ca42c691dc29a189a64a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4732b1ccb145414ba7d9f3d93df9f8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:53.703968 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-f36246db-16ca-4547-b6a0-697e8fb6ae39 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] 10.222.0.45 "GET /compute/v2.1/servers/ebac3c82-8804-4181-82ec-ca1f3bf55076" status: 200 len: 1314 microversion: 2.1 time: 0.535921 Dec 16 14:56:53.706361 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 177/349] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:53 2021] GET /compute/v2.1/servers/ebac3c82-8804-4181-82ec-ca1f3bf55076 => generated 1314 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:53.708455 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [req-21a5d452-0830-40b5-83fa-6cd79de928ef req-03f43298-3078-418d-9821-4e4ab0248a95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebac3c82-8804-4181-82ec-ca1f3bf55076", "name": "network-vif-plugged", "status": "completed", "tag": "96f464f8-7a32-4677-a9f6-58f3e9c5a773"}]} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:56:53.724162 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:56:53.724162 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: warnings.warn(msg) Dec 16 14:56:53.726884 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-e432e1dd-89a1-4010-9bb5-de2d9860df3b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:56:53.728299 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-e432e1dd-89a1-4010-9bb5-de2d9860df3b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:53.734292 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-21a5d452-0830-40b5-83fa-6cd79de928ef req-03f43298-3078-418d-9821-4e4ab0248a95 service nova] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:53.734795 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-21a5d452-0830-40b5-83fa-6cd79de928ef req-03f43298-3078-418d-9821-4e4ab0248a95 service nova] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:53.740097 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e432e1dd-89a1-4010-9bb5-de2d9860df3b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:53.740097 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e432e1dd-89a1-4010-9bb5-de2d9860df3b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:53.740097 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e432e1dd-89a1-4010-9bb5-de2d9860df3b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:53.740097 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e432e1dd-89a1-4010-9bb5-de2d9860df3b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:53.767671 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.compute.server_external_events [req-21a5d452-0830-40b5-83fa-6cd79de928ef req-03f43298-3078-418d-9821-4e4ab0248a95 service nova] Creating event network-vif-plugged:96f464f8-7a32-4677-a9f6-58f3e9c5a773 for instance ebac3c82-8804-4181-82ec-ca1f3bf55076 on hv-cinder-82189 Dec 16 14:56:53.773816 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [req-21a5d452-0830-40b5-83fa-6cd79de928ef req-03f43298-3078-418d-9821-4e4ab0248a95 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087604 Dec 16 14:56:53.777162 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 173/350] 10.222.0.45 () {64 vars in 1308 bytes} [Thu Dec 16 14:56:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:56:53.789339 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-bef8745f-2192-456e-8ccb-4db8ec7d78b5 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:56:53.791010 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-bef8745f-2192-456e-8ccb-4db8ec7d78b5 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:53.801403 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-bef8745f-2192-456e-8ccb-4db8ec7d78b5 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:53.802513 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-bef8745f-2192-456e-8ccb-4db8ec7d78b5 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:53.803802 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-bef8745f-2192-456e-8ccb-4db8ec7d78b5 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:53.805054 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-bef8745f-2192-456e-8ccb-4db8ec7d78b5 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:53.994975 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-e432e1dd-89a1-4010-9bb5-de2d9860df3b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 200 len: 27718 microversion: 2.20 time: 0.275609 Dec 16 14:56:53.999902 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 178/351] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:56:53 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 27718 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:56:54.036944 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-bef8745f-2192-456e-8ccb-4db8ec7d78b5 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 27813 microversion: 2.1 time: 0.258193 Dec 16 14:56:54.037769 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 174/352] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:56:53 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 27813 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:56:54.707185 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-f0a766ca-9436-4184-83cf-d218501eda0c tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:54.709676 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-f0a766ca-9436-4184-83cf-d218501eda0c tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: bcaa83bc-5d07-413a-88e5-b7428a5b5d46] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:54.739961 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f0a766ca-9436-4184-83cf-d218501eda0c tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:54.739961 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f0a766ca-9436-4184-83cf-d218501eda0c tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:54.740120 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-82811745-411a-4ea4-b5e6-32090a3b9fdb tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:54.740192 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f0a766ca-9436-4184-83cf-d218501eda0c tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:54.740263 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-82811745-411a-4ea4-b5e6-32090a3b9fdb tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] [instance: ebac3c82-8804-4181-82ec-ca1f3bf55076] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:54.740340 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f0a766ca-9436-4184-83cf-d218501eda0c tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:54.743677 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-82811745-411a-4ea4-b5e6-32090a3b9fdb tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:54.744282 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-82811745-411a-4ea4-b5e6-32090a3b9fdb tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:54.745237 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-82811745-411a-4ea4-b5e6-32090a3b9fdb tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:54.745818 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-82811745-411a-4ea4-b5e6-32090a3b9fdb tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:54.981571 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-f0a766ca-9436-4184-83cf-d218501eda0c tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:54.989548 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-f0a766ca-9436-4184-83cf-d218501eda0c tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46" status: 200 len: 1521 microversion: 2.1 time: 0.292324 Dec 16 14:56:54.990364 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 179/353] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:54 2021] GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46 => generated 1521 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:55.010642 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-82811745-411a-4ea4-b5e6-32090a3b9fdb tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e94f83a79ca42c691dc29a189a64a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4732b1ccb145414ba7d9f3d93df9f8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:55.012968 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-f87cc3d3-6bad-41e9-9506-13fe9cbc9cc1 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:56:55.013968 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-f87cc3d3-6bad-41e9-9506-13fe9cbc9cc1 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:55.021105 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-82811745-411a-4ea4-b5e6-32090a3b9fdb tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] 10.222.0.45 "GET /compute/v2.1/servers/ebac3c82-8804-4181-82ec-ca1f3bf55076" status: 200 len: 1314 microversion: 2.1 time: 0.298938 Dec 16 14:56:55.021815 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f87cc3d3-6bad-41e9-9506-13fe9cbc9cc1 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:55.022075 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 175/354] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:54 2021] GET /compute/v2.1/servers/ebac3c82-8804-4181-82ec-ca1f3bf55076 => generated 1314 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:55.022683 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f87cc3d3-6bad-41e9-9506-13fe9cbc9cc1 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:55.024162 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f87cc3d3-6bad-41e9-9506-13fe9cbc9cc1 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:55.024612 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f87cc3d3-6bad-41e9-9506-13fe9cbc9cc1 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:55.053319 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-2b56157c-f66e-40f3-8c00-8f051b5f5417 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:56:55.054416 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-2b56157c-f66e-40f3-8c00-8f051b5f5417 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:55.063073 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2b56157c-f66e-40f3-8c00-8f051b5f5417 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:55.064231 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2b56157c-f66e-40f3-8c00-8f051b5f5417 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:55.064401 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2b56157c-f66e-40f3-8c00-8f051b5f5417 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:55.064889 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2b56157c-f66e-40f3-8c00-8f051b5f5417 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:55.349067 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-2b56157c-f66e-40f3-8c00-8f051b5f5417 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 27940 microversion: 2.1 time: 0.303693 Dec 16 14:56:55.350074 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 176/355] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:56:55 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 27940 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 14:56:55.379042 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-f87cc3d3-6bad-41e9-9506-13fe9cbc9cc1 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 200 len: 27977 microversion: 2.20 time: 0.374804 Dec 16 14:56:55.380973 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 180/356] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:56:55 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 27977 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 16 14:56:56.012509 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-6a823cbe-3a87-4678-af90-1242a6dcc16f tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:56.013812 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-6a823cbe-3a87-4678-af90-1242a6dcc16f tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: bcaa83bc-5d07-413a-88e5-b7428a5b5d46] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:56.023027 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6a823cbe-3a87-4678-af90-1242a6dcc16f tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:56.023704 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6a823cbe-3a87-4678-af90-1242a6dcc16f tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:56.024722 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6a823cbe-3a87-4678-af90-1242a6dcc16f tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:56.025362 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6a823cbe-3a87-4678-af90-1242a6dcc16f tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:56.045292 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-93083086-d56f-44c7-b3e6-7305e8a07649 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:56.051208 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-93083086-d56f-44c7-b3e6-7305e8a07649 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] [instance: ebac3c82-8804-4181-82ec-ca1f3bf55076] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:56.059827 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-93083086-d56f-44c7-b3e6-7305e8a07649 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:56.060541 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-93083086-d56f-44c7-b3e6-7305e8a07649 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:56.061549 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-93083086-d56f-44c7-b3e6-7305e8a07649 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:56.062293 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-93083086-d56f-44c7-b3e6-7305e8a07649 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:56.439062 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-93083086-d56f-44c7-b3e6-7305e8a07649 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e94f83a79ca42c691dc29a189a64a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4732b1ccb145414ba7d9f3d93df9f8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:56.455360 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-93083086-d56f-44c7-b3e6-7305e8a07649 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] 10.222.0.45 "GET /compute/v2.1/servers/ebac3c82-8804-4181-82ec-ca1f3bf55076" status: 200 len: 1314 microversion: 2.1 time: 0.418618 Dec 16 14:56:56.461351 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 181/357] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:56 2021] GET /compute/v2.1/servers/ebac3c82-8804-4181-82ec-ca1f3bf55076 => generated 1314 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:56.489799 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-dc582549-2e43-42db-8a3a-c239411edf2f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:56:56.495482 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-dc582549-2e43-42db-8a3a-c239411edf2f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:56.507342 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-dc582549-2e43-42db-8a3a-c239411edf2f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:56.508537 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-dc582549-2e43-42db-8a3a-c239411edf2f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:56.509493 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-dc582549-2e43-42db-8a3a-c239411edf2f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:56.510117 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-dc582549-2e43-42db-8a3a-c239411edf2f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:56.712363 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-6a823cbe-3a87-4678-af90-1242a6dcc16f tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:56.732493 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-6a823cbe-3a87-4678-af90-1242a6dcc16f tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46" status: 200 len: 1521 microversion: 2.1 time: 0.717824 Dec 16 14:56:56.732493 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 177/358] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:56 2021] GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46 => generated 1521 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:56.732493 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-9a1caa8f-d6fa-4d6e-98d2-ab85a40ff5dc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:56:56.733079 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-9a1caa8f-d6fa-4d6e-98d2-ab85a40ff5dc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:56.740932 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9a1caa8f-d6fa-4d6e-98d2-ab85a40ff5dc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:56.741444 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9a1caa8f-d6fa-4d6e-98d2-ab85a40ff5dc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:56.742369 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9a1caa8f-d6fa-4d6e-98d2-ab85a40ff5dc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:56.742841 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9a1caa8f-d6fa-4d6e-98d2-ab85a40ff5dc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:56.779314 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-dc582549-2e43-42db-8a3a-c239411edf2f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 28058 microversion: 2.1 time: 0.315618 Dec 16 14:56:56.780020 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 182/359] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:56:56 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 28058 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:56:56.897680 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-9a1caa8f-d6fa-4d6e-98d2-ab85a40ff5dc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 200 len: 28046 microversion: 2.20 time: 0.173339 Dec 16 14:56:56.898679 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 178/360] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:56:56 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 28046 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:56:57.488652 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-da615331-04de-45d6-84f1-93f869d8b55b tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:57.489425 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-da615331-04de-45d6-84f1-93f869d8b55b tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] [instance: ebac3c82-8804-4181-82ec-ca1f3bf55076] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:57.499455 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-da615331-04de-45d6-84f1-93f869d8b55b tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:57.499962 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-da615331-04de-45d6-84f1-93f869d8b55b tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:57.500849 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-da615331-04de-45d6-84f1-93f869d8b55b tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:57.501347 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-da615331-04de-45d6-84f1-93f869d8b55b tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:57.752789 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-af998a6c-902b-4af1-8c44-c445973358e0 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:57.756389 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-af998a6c-902b-4af1-8c44-c445973358e0 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: bcaa83bc-5d07-413a-88e5-b7428a5b5d46] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:57.776512 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-af998a6c-902b-4af1-8c44-c445973358e0 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:57.779647 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-af998a6c-902b-4af1-8c44-c445973358e0 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:57.780815 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-af998a6c-902b-4af1-8c44-c445973358e0 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:57.782965 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-af998a6c-902b-4af1-8c44-c445973358e0 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:57.837699 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-da615331-04de-45d6-84f1-93f869d8b55b tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e94f83a79ca42c691dc29a189a64a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4732b1ccb145414ba7d9f3d93df9f8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:57.849169 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-da615331-04de-45d6-84f1-93f869d8b55b tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] 10.222.0.45 "GET /compute/v2.1/servers/ebac3c82-8804-4181-82ec-ca1f3bf55076" status: 200 len: 1498 microversion: 2.1 time: 0.372847 Dec 16 14:56:57.850235 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 183/361] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:57 2021] GET /compute/v2.1/servers/ebac3c82-8804-4181-82ec-ca1f3bf55076 => generated 1498 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:57.859766 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-2195d2fe-359b-4fc1-9fdd-532c944dfcbb tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:56:57.861074 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-2195d2fe-359b-4fc1-9fdd-532c944dfcbb tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:57.881079 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2195d2fe-359b-4fc1-9fdd-532c944dfcbb tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:57.881978 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2195d2fe-359b-4fc1-9fdd-532c944dfcbb tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:57.883033 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2195d2fe-359b-4fc1-9fdd-532c944dfcbb tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:57.883695 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2195d2fe-359b-4fc1-9fdd-532c944dfcbb tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:58.077792 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-2195d2fe-359b-4fc1-9fdd-532c944dfcbb tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 28175 microversion: 2.1 time: 0.225829 Dec 16 14:56:58.078592 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 184/362] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:56:57 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 28175 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:56:58.095879 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-71f8c01a-8401-4624-8c51-745ab55372ee tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:56:58.097024 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-71f8c01a-8401-4624-8c51-745ab55372ee tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:58.109529 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-af998a6c-902b-4af1-8c44-c445973358e0 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:58.121363 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-af998a6c-902b-4af1-8c44-c445973358e0 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46" status: 200 len: 1521 microversion: 2.1 time: 0.383586 Dec 16 14:56:58.121983 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 179/363] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:57 2021] GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46 => generated 1521 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:58.136433 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-71f8c01a-8401-4624-8c51-745ab55372ee tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:58.136954 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-71f8c01a-8401-4624-8c51-745ab55372ee tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:58.142687 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-71f8c01a-8401-4624-8c51-745ab55372ee tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:58.142687 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-71f8c01a-8401-4624-8c51-745ab55372ee tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:58.312273 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-71f8c01a-8401-4624-8c51-745ab55372ee tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 200 len: 28163 microversion: 2.20 time: 0.232132 Dec 16 14:56:58.313354 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 185/364] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:56:58 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 28163 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:56:59.096651 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-aad20695-4a89-4a2b-90b2-9dfcdab46de9 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:56:59.098541 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-aad20695-4a89-4a2b-90b2-9dfcdab46de9 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:59.108447 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-aad20695-4a89-4a2b-90b2-9dfcdab46de9 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:59.109478 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-aad20695-4a89-4a2b-90b2-9dfcdab46de9 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:59.111305 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-aad20695-4a89-4a2b-90b2-9dfcdab46de9 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:59.112142 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-aad20695-4a89-4a2b-90b2-9dfcdab46de9 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:59.146017 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-fd1ebe07-2d32-46b5-959c-836b48f5574e tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:59.148767 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-fd1ebe07-2d32-46b5-959c-836b48f5574e tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: bcaa83bc-5d07-413a-88e5-b7428a5b5d46] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:59.175946 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fd1ebe07-2d32-46b5-959c-836b48f5574e tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:59.176458 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fd1ebe07-2d32-46b5-959c-836b48f5574e tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:59.177295 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fd1ebe07-2d32-46b5-959c-836b48f5574e tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:59.177955 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fd1ebe07-2d32-46b5-959c-836b48f5574e tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:59.323383 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-aad20695-4a89-4a2b-90b2-9dfcdab46de9 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 28175 microversion: 2.1 time: 0.236428 Dec 16 14:56:59.326074 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 180/365] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:56:59 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 28175 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:56:59.354525 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-1d8c22a5-d7f0-4e77-b01e-c89b7dc53b66 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:59.356198 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-1d8c22a5-d7f0-4e77-b01e-c89b7dc53b66 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] [instance: ebac3c82-8804-4181-82ec-ca1f3bf55076] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:59.379790 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1d8c22a5-d7f0-4e77-b01e-c89b7dc53b66 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:59.380621 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1d8c22a5-d7f0-4e77-b01e-c89b7dc53b66 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:59.381678 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1d8c22a5-d7f0-4e77-b01e-c89b7dc53b66 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:59.383358 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1d8c22a5-d7f0-4e77-b01e-c89b7dc53b66 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:59.460912 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-1d8c22a5-d7f0-4e77-b01e-c89b7dc53b66 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] [instance: ebac3c82-8804-4181-82ec-ca1f3bf55076] Going to try to terminate instance {{(pid=101355) delete /opt/stack/nova/nova/compute/api.py:2496}} Dec 16 14:56:59.563588 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-fd1ebe07-2d32-46b5-959c-836b48f5574e tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:56:59.574701 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-fd1ebe07-2d32-46b5-959c-836b48f5574e tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46" status: 200 len: 1521 microversion: 2.1 time: 0.438235 Dec 16 14:56:59.586072 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 186/366] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:59 2021] GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46 => generated 1521 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:56:59.594355 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-6319883f-42ca-4b79-a7c4-f3da9f8828e9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:56:59.597965 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-6319883f-42ca-4b79-a7c4-f3da9f8828e9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:59.606937 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6319883f-42ca-4b79-a7c4-f3da9f8828e9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:59.607655 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6319883f-42ca-4b79-a7c4-f3da9f8828e9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:59.608722 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6319883f-42ca-4b79-a7c4-f3da9f8828e9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:59.609140 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6319883f-42ca-4b79-a7c4-f3da9f8828e9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:59.734674 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-1d8c22a5-d7f0-4e77-b01e-c89b7dc53b66 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] 10.222.0.45 "DELETE /compute/v2.1/servers/ebac3c82-8804-4181-82ec-ca1f3bf55076" status: 204 len: 0 microversion: 2.1 time: 0.406544 Dec 16 14:56:59.735538 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 181/367] 10.222.0.45 () {58 vars in 1229 bytes} [Thu Dec 16 14:56:59 2021] DELETE /compute/v2.1/servers/ebac3c82-8804-4181-82ec-ca1f3bf55076 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 16 14:56:59.749573 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-15bda35b-38ba-4e68-aa7e-38383a530d9a tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:56:59.750508 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-15bda35b-38ba-4e68-aa7e-38383a530d9a tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] [instance: ebac3c82-8804-4181-82ec-ca1f3bf55076] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:56:59.763719 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-15bda35b-38ba-4e68-aa7e-38383a530d9a tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:59.764363 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-15bda35b-38ba-4e68-aa7e-38383a530d9a tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:59.765199 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-15bda35b-38ba-4e68-aa7e-38383a530d9a tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:56:59.765697 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-15bda35b-38ba-4e68-aa7e-38383a530d9a tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:56:59.891600 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-6319883f-42ca-4b79-a7c4-f3da9f8828e9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 200 len: 28163 microversion: 2.20 time: 0.313355 Dec 16 14:56:59.893229 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 187/368] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:56:59 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 28163 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:57:00.007904 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-15bda35b-38ba-4e68-aa7e-38383a530d9a tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e94f83a79ca42c691dc29a189a64a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4732b1ccb145414ba7d9f3d93df9f8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:57:00.017210 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-15bda35b-38ba-4e68-aa7e-38383a530d9a tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] 10.222.0.45 "GET /compute/v2.1/servers/ebac3c82-8804-4181-82ec-ca1f3bf55076" status: 200 len: 1504 microversion: 2.1 time: 0.276844 Dec 16 14:57:00.018126 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 182/369] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:56:59 2021] GET /compute/v2.1/servers/ebac3c82-8804-4181-82ec-ca1f3bf55076 => generated 1504 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:57:00.342021 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-b26c56ac-3891-4975-9f1f-6dff20967dc0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:57:00.343755 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-b26c56ac-3891-4975-9f1f-6dff20967dc0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:57:00.353094 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b26c56ac-3891-4975-9f1f-6dff20967dc0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:00.353950 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b26c56ac-3891-4975-9f1f-6dff20967dc0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:00.354999 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b26c56ac-3891-4975-9f1f-6dff20967dc0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:00.356094 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b26c56ac-3891-4975-9f1f-6dff20967dc0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:00.506784 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-b26c56ac-3891-4975-9f1f-6dff20967dc0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 28175 microversion: 2.1 time: 0.173896 Dec 16 14:57:00.512020 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 188/370] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:57:00 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 28175 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:57:00.598033 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-090abd71-56a4-476d-bb5c-b4283c7c70ee tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:57:00.598732 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-090abd71-56a4-476d-bb5c-b4283c7c70ee tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: bcaa83bc-5d07-413a-88e5-b7428a5b5d46] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:57:00.607188 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-090abd71-56a4-476d-bb5c-b4283c7c70ee tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:00.607689 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-090abd71-56a4-476d-bb5c-b4283c7c70ee tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:00.608534 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-090abd71-56a4-476d-bb5c-b4283c7c70ee tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:00.609032 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-090abd71-56a4-476d-bb5c-b4283c7c70ee tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:00.911303 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-932a849a-4a51-4566-8366-9715dc631b9a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:57:00.933660 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-090abd71-56a4-476d-bb5c-b4283c7c70ee tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:57:00.934536 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-932a849a-4a51-4566-8366-9715dc631b9a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:57:00.946789 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-932a849a-4a51-4566-8366-9715dc631b9a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:00.947270 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-932a849a-4a51-4566-8366-9715dc631b9a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:00.949640 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-932a849a-4a51-4566-8366-9715dc631b9a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:00.950261 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-932a849a-4a51-4566-8366-9715dc631b9a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:00.956737 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-090abd71-56a4-476d-bb5c-b4283c7c70ee tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46" status: 200 len: 1521 microversion: 2.1 time: 0.366512 Dec 16 14:57:00.957673 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 183/371] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:57:00 2021] GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46 => generated 1521 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:57:01.041481 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-90cf9a99-05bd-4e7c-a333-1016d820ca1b tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:57:01.043331 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-90cf9a99-05bd-4e7c-a333-1016d820ca1b tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] [instance: ebac3c82-8804-4181-82ec-ca1f3bf55076] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:57:01.058430 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-90cf9a99-05bd-4e7c-a333-1016d820ca1b tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:01.061968 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-90cf9a99-05bd-4e7c-a333-1016d820ca1b tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:01.062395 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-90cf9a99-05bd-4e7c-a333-1016d820ca1b tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:01.062906 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-90cf9a99-05bd-4e7c-a333-1016d820ca1b tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:01.162915 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-932a849a-4a51-4566-8366-9715dc631b9a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 200 len: 28163 microversion: 2.20 time: 0.262032 Dec 16 14:57:01.167678 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 189/372] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:57:00 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 28163 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 16 14:57:01.365908 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-90cf9a99-05bd-4e7c-a333-1016d820ca1b tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e94f83a79ca42c691dc29a189a64a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4732b1ccb145414ba7d9f3d93df9f8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:57:01.376367 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-90cf9a99-05bd-4e7c-a333-1016d820ca1b tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] 10.222.0.45 "GET /compute/v2.1/servers/ebac3c82-8804-4181-82ec-ca1f3bf55076" status: 200 len: 1504 microversion: 2.1 time: 0.344169 Dec 16 14:57:01.377331 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 184/373] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:57:01 2021] GET /compute/v2.1/servers/ebac3c82-8804-4181-82ec-ca1f3bf55076 => generated 1504 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:57:01.524603 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-6c8e83d6-971b-4c11-bd0d-928193e1ab9a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:57:01.525802 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-6c8e83d6-971b-4c11-bd0d-928193e1ab9a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:57:01.541941 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6c8e83d6-971b-4c11-bd0d-928193e1ab9a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:01.542476 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6c8e83d6-971b-4c11-bd0d-928193e1ab9a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:01.543332 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6c8e83d6-971b-4c11-bd0d-928193e1ab9a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:01.549021 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6c8e83d6-971b-4c11-bd0d-928193e1ab9a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:01.756185 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-6c8e83d6-971b-4c11-bd0d-928193e1ab9a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 28175 microversion: 2.1 time: 0.239476 Dec 16 14:57:01.756957 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 190/374] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:57:01 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 28175 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 14:57:01.984345 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-a98406a5-fd2b-4fae-8d25-94c24b452943 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:57:01.985801 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-a98406a5-fd2b-4fae-8d25-94c24b452943 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: bcaa83bc-5d07-413a-88e5-b7428a5b5d46] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:57:01.998257 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a98406a5-fd2b-4fae-8d25-94c24b452943 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:01.999485 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a98406a5-fd2b-4fae-8d25-94c24b452943 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:02.000562 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a98406a5-fd2b-4fae-8d25-94c24b452943 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:02.001250 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a98406a5-fd2b-4fae-8d25-94c24b452943 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:02.186033 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-01b5f213-1610-429c-8f0f-9dd5827a5ab6 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:57:02.188501 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-01b5f213-1610-429c-8f0f-9dd5827a5ab6 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:57:02.202307 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-01b5f213-1610-429c-8f0f-9dd5827a5ab6 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:02.203650 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-01b5f213-1610-429c-8f0f-9dd5827a5ab6 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:02.205917 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-01b5f213-1610-429c-8f0f-9dd5827a5ab6 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:02.206950 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-01b5f213-1610-429c-8f0f-9dd5827a5ab6 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:02.403162 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-01b5f213-1610-429c-8f0f-9dd5827a5ab6 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 200 len: 28163 microversion: 2.20 time: 0.230478 Dec 16 14:57:02.404585 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 191/375] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:57:02 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 28163 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 16 14:57:02.417888 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-0b14b9fa-3373-40a3-b4ff-69fad092173d tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:57:02.421924 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-0b14b9fa-3373-40a3-b4ff-69fad092173d tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] [instance: ebac3c82-8804-4181-82ec-ca1f3bf55076] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:57:02.438863 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0b14b9fa-3373-40a3-b4ff-69fad092173d tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:02.440098 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0b14b9fa-3373-40a3-b4ff-69fad092173d tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:02.440968 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0b14b9fa-3373-40a3-b4ff-69fad092173d tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:02.441465 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0b14b9fa-3373-40a3-b4ff-69fad092173d tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:02.462084 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-a98406a5-fd2b-4fae-8d25-94c24b452943 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:57:02.471513 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-a98406a5-fd2b-4fae-8d25-94c24b452943 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46" status: 200 len: 1521 microversion: 2.1 time: 0.496517 Dec 16 14:57:02.483092 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 185/376] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:57:01 2021] GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46 => generated 1521 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:57:02.752526 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-0b14b9fa-3373-40a3-b4ff-69fad092173d tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e94f83a79ca42c691dc29a189a64a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4732b1ccb145414ba7d9f3d93df9f8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:57:02.781368 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-2ceac6a3-7a03-4509-91d1-1a94cbcd942d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:57:02.783358 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-2ceac6a3-7a03-4509-91d1-1a94cbcd942d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:57:02.786296 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-0b14b9fa-3373-40a3-b4ff-69fad092173d tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] 10.222.0.45 "GET /compute/v2.1/servers/ebac3c82-8804-4181-82ec-ca1f3bf55076" status: 200 len: 1504 microversion: 2.1 time: 0.376367 Dec 16 14:57:02.788648 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 192/377] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:57:02 2021] GET /compute/v2.1/servers/ebac3c82-8804-4181-82ec-ca1f3bf55076 => generated 1504 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:57:02.801858 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2ceac6a3-7a03-4509-91d1-1a94cbcd942d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:02.811039 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2ceac6a3-7a03-4509-91d1-1a94cbcd942d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:02.811039 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2ceac6a3-7a03-4509-91d1-1a94cbcd942d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:02.811039 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2ceac6a3-7a03-4509-91d1-1a94cbcd942d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:03.068596 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-2ceac6a3-7a03-4509-91d1-1a94cbcd942d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 28175 microversion: 2.1 time: 0.294623 Dec 16 14:57:03.074417 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 186/378] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:57:02 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 28175 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:57:03.428541 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-d054f42e-add0-41cc-bf1f-78ebfa31b787 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:57:03.430572 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-d054f42e-add0-41cc-bf1f-78ebfa31b787 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:57:03.450176 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d054f42e-add0-41cc-bf1f-78ebfa31b787 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:03.451076 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d054f42e-add0-41cc-bf1f-78ebfa31b787 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:03.452042 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d054f42e-add0-41cc-bf1f-78ebfa31b787 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:03.452644 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d054f42e-add0-41cc-bf1f-78ebfa31b787 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:03.499214 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-904d41c6-4536-4eab-815f-37413397c60f tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:57:03.500375 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-904d41c6-4536-4eab-815f-37413397c60f tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: bcaa83bc-5d07-413a-88e5-b7428a5b5d46] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:57:03.519753 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-904d41c6-4536-4eab-815f-37413397c60f tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:03.530248 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-904d41c6-4536-4eab-815f-37413397c60f tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:03.531922 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-904d41c6-4536-4eab-815f-37413397c60f tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:03.532651 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-904d41c6-4536-4eab-815f-37413397c60f tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:03.850677 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-d054f42e-add0-41cc-bf1f-78ebfa31b787 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 200 len: 28163 microversion: 2.20 time: 0.438970 Dec 16 14:57:03.851986 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 193/379] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:57:03 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 28163 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:57:03.874445 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-710739cd-796e-4e0b-bd58-85d928eddb71 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:57:03.875217 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-710739cd-796e-4e0b-bd58-85d928eddb71 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] [instance: ebac3c82-8804-4181-82ec-ca1f3bf55076] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:57:03.885269 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-710739cd-796e-4e0b-bd58-85d928eddb71 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:03.885778 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-710739cd-796e-4e0b-bd58-85d928eddb71 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:03.886686 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-710739cd-796e-4e0b-bd58-85d928eddb71 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:03.887373 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-710739cd-796e-4e0b-bd58-85d928eddb71 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:04.330171 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-904d41c6-4536-4eab-815f-37413397c60f tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:57:04.339892 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-904d41c6-4536-4eab-815f-37413397c60f tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46" status: 200 len: 1521 microversion: 2.1 time: 0.854668 Dec 16 14:57:04.350701 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 187/380] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:57:03 2021] GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46 => generated 1521 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:57:04.360457 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-0cd54967-d1ef-4064-8de5-8b33c58e6760 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:57:04.361749 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-0cd54967-d1ef-4064-8de5-8b33c58e6760 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:57:04.367106 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-710739cd-796e-4e0b-bd58-85d928eddb71 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e94f83a79ca42c691dc29a189a64a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4732b1ccb145414ba7d9f3d93df9f8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:57:04.370806 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0cd54967-d1ef-4064-8de5-8b33c58e6760 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:04.371977 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0cd54967-d1ef-4064-8de5-8b33c58e6760 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:04.373273 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0cd54967-d1ef-4064-8de5-8b33c58e6760 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:04.374061 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0cd54967-d1ef-4064-8de5-8b33c58e6760 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:04.385255 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-710739cd-796e-4e0b-bd58-85d928eddb71 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] 10.222.0.45 "GET /compute/v2.1/servers/ebac3c82-8804-4181-82ec-ca1f3bf55076" status: 200 len: 1504 microversion: 2.1 time: 0.531553 Dec 16 14:57:04.386556 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 194/381] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:57:03 2021] GET /compute/v2.1/servers/ebac3c82-8804-4181-82ec-ca1f3bf55076 => generated 1504 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:57:04.512886 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-0cd54967-d1ef-4064-8de5-8b33c58e6760 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 28175 microversion: 2.1 time: 0.160268 Dec 16 14:57:04.517584 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 188/382] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:57:04 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 28175 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:57:04.778272 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [req-227812fa-e160-4743-bf4a-df4b7bf5d6bc req-71fb31c9-c33f-4b09-b3ae-356952a11836 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebac3c82-8804-4181-82ec-ca1f3bf55076", "name": "network-vif-deleted", "tag": "96f464f8-7a32-4677-a9f6-58f3e9c5a773"}]} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:57:04.783112 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:57:04.783112 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: warnings.warn(msg) Dec 16 14:57:04.792642 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-227812fa-e160-4743-bf4a-df4b7bf5d6bc req-71fb31c9-c33f-4b09-b3ae-356952a11836 service nova] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:04.793136 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-227812fa-e160-4743-bf4a-df4b7bf5d6bc req-71fb31c9-c33f-4b09-b3ae-356952a11836 service nova] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:04.811986 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.compute.server_external_events [req-227812fa-e160-4743-bf4a-df4b7bf5d6bc req-71fb31c9-c33f-4b09-b3ae-356952a11836 service nova] Creating event network-vif-deleted:96f464f8-7a32-4677-a9f6-58f3e9c5a773 for instance ebac3c82-8804-4181-82ec-ca1f3bf55076 on hv-cinder-82189 Dec 16 14:57:04.817580 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [req-227812fa-e160-4743-bf4a-df4b7bf5d6bc req-71fb31c9-c33f-4b09-b3ae-356952a11836 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047963 Dec 16 14:57:04.818560 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 195/383] 10.222.0.45 () {64 vars in 1308 bytes} [Thu Dec 16 14:57:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:57:04.869274 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-f2ec1219-16f4-498e-b660-4ee8064fd688 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:57:04.870449 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-f2ec1219-16f4-498e-b660-4ee8064fd688 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:57:04.879418 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f2ec1219-16f4-498e-b660-4ee8064fd688 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:04.879928 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f2ec1219-16f4-498e-b660-4ee8064fd688 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:04.880797 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f2ec1219-16f4-498e-b660-4ee8064fd688 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:04.881342 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f2ec1219-16f4-498e-b660-4ee8064fd688 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:05.037502 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-f2ec1219-16f4-498e-b660-4ee8064fd688 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 200 len: 28163 microversion: 2.20 time: 0.176602 Dec 16 14:57:05.038302 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 189/384] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:57:04 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 28163 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:57:05.364891 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-de92242e-4f05-454d-a3a0-cac9ba0ee107 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:57:05.365716 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-de92242e-4f05-454d-a3a0-cac9ba0ee107 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: bcaa83bc-5d07-413a-88e5-b7428a5b5d46] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:57:05.392720 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-de92242e-4f05-454d-a3a0-cac9ba0ee107 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:05.393365 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-de92242e-4f05-454d-a3a0-cac9ba0ee107 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:05.395001 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-de92242e-4f05-454d-a3a0-cac9ba0ee107 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:05.395703 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-de92242e-4f05-454d-a3a0-cac9ba0ee107 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:05.408010 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-870ad6ed-db10-486c-a269-475478e74079 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:57:05.408752 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-870ad6ed-db10-486c-a269-475478e74079 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] [instance: ebac3c82-8804-4181-82ec-ca1f3bf55076] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:57:05.451563 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-870ad6ed-db10-486c-a269-475478e74079 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:05.452318 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-870ad6ed-db10-486c-a269-475478e74079 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:05.453338 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-870ad6ed-db10-486c-a269-475478e74079 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:05.453962 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-870ad6ed-db10-486c-a269-475478e74079 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:05.649445 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-870ad6ed-db10-486c-a269-475478e74079 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:05.649955 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-870ad6ed-db10-486c-a269-475478e74079 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:05.653087 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.objects.instance [None req-870ad6ed-db10-486c-a269-475478e74079 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lazy-loading 'fault' on Instance uuid ebac3c82-8804-4181-82ec-ca1f3bf55076 {{(pid=101355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 16 14:57:05.878311 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-870ad6ed-db10-486c-a269-475478e74079 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e94f83a79ca42c691dc29a189a64a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4732b1ccb145414ba7d9f3d93df9f8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:57:05.893441 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-870ad6ed-db10-486c-a269-475478e74079 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] 10.222.0.45 "GET /compute/v2.1/servers/ebac3c82-8804-4181-82ec-ca1f3bf55076" status: 200 len: 1304 microversion: 2.1 time: 0.493680 Dec 16 14:57:05.900172 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 190/385] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:57:05 2021] GET /compute/v2.1/servers/ebac3c82-8804-4181-82ec-ca1f3bf55076 => generated 1304 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:57:05.920554 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-332b6976-4545-48f1-b529-76dafb2fcd43 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:57:05.922082 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-332b6976-4545-48f1-b529-76dafb2fcd43 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:57:05.939955 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-332b6976-4545-48f1-b529-76dafb2fcd43 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:05.940669 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-332b6976-4545-48f1-b529-76dafb2fcd43 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:05.941693 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-332b6976-4545-48f1-b529-76dafb2fcd43 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:05.942571 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-332b6976-4545-48f1-b529-76dafb2fcd43 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:05.989630 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-de92242e-4f05-454d-a3a0-cac9ba0ee107 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:57:06.013326 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-de92242e-4f05-454d-a3a0-cac9ba0ee107 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46" status: 200 len: 1501 microversion: 2.1 time: 0.659482 Dec 16 14:57:06.016030 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 196/386] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:57:05 2021] GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46 => generated 1501 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:57:06.045817 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-c45165e2-656b-4922-8e68-eb74b007319e tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:57:06.046757 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-c45165e2-656b-4922-8e68-eb74b007319e tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: 407dd6f1-6f0a-41ba-80e2-9ebe4630fa75] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:57:06.056212 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c45165e2-656b-4922-8e68-eb74b007319e tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:06.057236 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c45165e2-656b-4922-8e68-eb74b007319e tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:06.059101 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c45165e2-656b-4922-8e68-eb74b007319e tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:06.059996 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c45165e2-656b-4922-8e68-eb74b007319e tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:06.164107 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-332b6976-4545-48f1-b529-76dafb2fcd43 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 28175 microversion: 2.1 time: 0.261730 Dec 16 14:57:06.165298 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 191/387] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:57:05 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 28175 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:57:06.175629 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-74b04094-baee-46ee-aa9d-7a4904abfe66 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:57:06.177092 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-74b04094-baee-46ee-aa9d-7a4904abfe66 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:57:06.191131 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-74b04094-baee-46ee-aa9d-7a4904abfe66 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:06.191981 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-74b04094-baee-46ee-aa9d-7a4904abfe66 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:06.193058 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-74b04094-baee-46ee-aa9d-7a4904abfe66 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:06.193902 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-74b04094-baee-46ee-aa9d-7a4904abfe66 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:06.359094 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-74b04094-baee-46ee-aa9d-7a4904abfe66 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 200 len: 28163 microversion: 2.20 time: 0.191967 Dec 16 14:57:06.359818 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 192/388] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:57:06 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 28163 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:57:06.574068 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-c45165e2-656b-4922-8e68-eb74b007319e tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:57:06.589285 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-c45165e2-656b-4922-8e68-eb74b007319e tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75" status: 200 len: 1515 microversion: 2.1 time: 0.555454 Dec 16 14:57:06.590223 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 197/389] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:57:06 2021] GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75 => generated 1515 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:57:06.928992 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-24571afd-9c1b-46ee-bb95-1ac44ba7af47 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:57:06.929862 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-24571afd-9c1b-46ee-bb95-1ac44ba7af47 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] [instance: ebac3c82-8804-4181-82ec-ca1f3bf55076] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:57:06.953036 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-24571afd-9c1b-46ee-bb95-1ac44ba7af47 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:06.955160 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-24571afd-9c1b-46ee-bb95-1ac44ba7af47 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:06.955160 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-24571afd-9c1b-46ee-bb95-1ac44ba7af47 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:06.955610 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-24571afd-9c1b-46ee-bb95-1ac44ba7af47 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:07.093217 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.wsgi [None req-24571afd-9c1b-46ee-bb95-1ac44ba7af47 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] HTTP exception thrown: Instance ebac3c82-8804-4181-82ec-ca1f3bf55076 could not be found. Dec 16 14:57:07.094848 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-24571afd-9c1b-46ee-bb95-1ac44ba7af47 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] Returning 404 to user: Instance ebac3c82-8804-4181-82ec-ca1f3bf55076 could not be found. {{(pid=101355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:941}} Dec 16 14:57:07.095967 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-24571afd-9c1b-46ee-bb95-1ac44ba7af47 tempest-VolumesActionsTest-1881776579 tempest-VolumesActionsTest-1881776579-project] 10.222.0.45 "GET /compute/v2.1/servers/ebac3c82-8804-4181-82ec-ca1f3bf55076" status: 404 len: 111 microversion: 2.1 time: 0.180678 Dec 16 14:57:07.096857 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 193/390] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:57:06 2021] GET /compute/v2.1/servers/ebac3c82-8804-4181-82ec-ca1f3bf55076 => generated 111 bytes in 183 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 14:57:07.180940 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-67a6554c-a900-47e5-a1c4-749d7b2ef68e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:57:07.182091 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-67a6554c-a900-47e5-a1c4-749d7b2ef68e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:57:07.206298 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-67a6554c-a900-47e5-a1c4-749d7b2ef68e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:07.208399 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-67a6554c-a900-47e5-a1c4-749d7b2ef68e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:07.210818 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-67a6554c-a900-47e5-a1c4-749d7b2ef68e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:07.214845 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-67a6554c-a900-47e5-a1c4-749d7b2ef68e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:07.385970 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-56439d47-2706-47a9-9e8e-90d6036a375a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:57:07.387069 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-56439d47-2706-47a9-9e8e-90d6036a375a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:57:07.404338 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-56439d47-2706-47a9-9e8e-90d6036a375a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:07.405521 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-56439d47-2706-47a9-9e8e-90d6036a375a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:07.407186 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-56439d47-2706-47a9-9e8e-90d6036a375a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:07.407747 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-56439d47-2706-47a9-9e8e-90d6036a375a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:11.067316 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-67a6554c-a900-47e5-a1c4-749d7b2ef68e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 28175 microversion: 2.1 time: 3.893976 Dec 16 14:57:11.068003 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 198/391] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:57:07 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 28175 bytes in 3896 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:57:11.101566 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-56439d47-2706-47a9-9e8e-90d6036a375a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 200 len: 28163 microversion: 2.20 time: 3.725539 Dec 16 14:57:11.102292 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 194/392] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:57:07 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 28163 bytes in 3735 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:57:12.085825 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-42f01905-c788-42c8-96fe-4d6afa197afd tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:57:12.087389 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-42f01905-c788-42c8-96fe-4d6afa197afd tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:57:12.098920 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-42f01905-c788-42c8-96fe-4d6afa197afd tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:12.099733 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-42f01905-c788-42c8-96fe-4d6afa197afd tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:12.100892 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-42f01905-c788-42c8-96fe-4d6afa197afd tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:12.101475 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-42f01905-c788-42c8-96fe-4d6afa197afd tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:12.118469 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-e4d8d452-94d0-45b6-99d1-0c7121ef3938 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:57:12.119854 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-e4d8d452-94d0-45b6-99d1-0c7121ef3938 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:57:12.129213 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e4d8d452-94d0-45b6-99d1-0c7121ef3938 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:12.129900 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e4d8d452-94d0-45b6-99d1-0c7121ef3938 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:12.130920 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e4d8d452-94d0-45b6-99d1-0c7121ef3938 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:12.131550 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e4d8d452-94d0-45b6-99d1-0c7121ef3938 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:12.577622 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-42f01905-c788-42c8-96fe-4d6afa197afd tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 28175 microversion: 2.1 time: 0.501309 Dec 16 14:57:12.579116 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 199/393] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:57:12 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 28175 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:57:12.593299 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-e4d8d452-94d0-45b6-99d1-0c7121ef3938 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 200 len: 28163 microversion: 2.20 time: 0.483421 Dec 16 14:57:12.594956 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 195/394] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:57:12 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 28163 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 16 14:57:13.612624 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-2eaa7bec-4b81-4f7d-a3b2-7da984da0e90 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:57:13.617055 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-88aa7f89-bfc9-46c1-8dc5-e12de4dd4c40 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:57:13.619132 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-88aa7f89-bfc9-46c1-8dc5-e12de4dd4c40 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:57:13.621961 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-2eaa7bec-4b81-4f7d-a3b2-7da984da0e90 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:57:13.641040 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2eaa7bec-4b81-4f7d-a3b2-7da984da0e90 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:13.641476 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-88aa7f89-bfc9-46c1-8dc5-e12de4dd4c40 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:13.642138 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-88aa7f89-bfc9-46c1-8dc5-e12de4dd4c40 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:13.642687 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2eaa7bec-4b81-4f7d-a3b2-7da984da0e90 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:13.644743 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-88aa7f89-bfc9-46c1-8dc5-e12de4dd4c40 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:13.645140 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-88aa7f89-bfc9-46c1-8dc5-e12de4dd4c40 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:13.648927 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2eaa7bec-4b81-4f7d-a3b2-7da984da0e90 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:13.649477 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2eaa7bec-4b81-4f7d-a3b2-7da984da0e90 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:16.993543 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-88aa7f89-bfc9-46c1-8dc5-e12de4dd4c40 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 200 len: 28163 microversion: 2.20 time: 3.391505 Dec 16 14:57:16.995293 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 196/395] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:57:13 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 28163 bytes in 3395 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:57:17.015514 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-2eaa7bec-4b81-4f7d-a3b2-7da984da0e90 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 28175 microversion: 2.1 time: 3.428191 Dec 16 14:57:17.017789 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 200/396] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:57:13 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 28175 bytes in 3431 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 14:57:18.033319 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-668f4d46-7eca-40af-a162-5da3bf6c3115 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:57:18.034464 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-668f4d46-7eca-40af-a162-5da3bf6c3115 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:57:18.035533 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-512d77c1-e582-48cb-8e83-02f175c322d7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:57:18.041289 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-512d77c1-e582-48cb-8e83-02f175c322d7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:57:18.058823 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-668f4d46-7eca-40af-a162-5da3bf6c3115 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:18.066019 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-512d77c1-e582-48cb-8e83-02f175c322d7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:18.066555 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-512d77c1-e582-48cb-8e83-02f175c322d7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:18.067394 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-512d77c1-e582-48cb-8e83-02f175c322d7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:18.068299 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-668f4d46-7eca-40af-a162-5da3bf6c3115 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:18.069244 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-668f4d46-7eca-40af-a162-5da3bf6c3115 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:18.069740 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-668f4d46-7eca-40af-a162-5da3bf6c3115 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:18.091401 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-512d77c1-e582-48cb-8e83-02f175c322d7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:18.266165 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-668f4d46-7eca-40af-a162-5da3bf6c3115 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 28175 microversion: 2.1 time: 0.241037 Dec 16 14:57:18.267261 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 201/397] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:57:18 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 28175 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:57:18.300515 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-512d77c1-e582-48cb-8e83-02f175c322d7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 200 len: 28163 microversion: 2.20 time: 0.297622 Dec 16 14:57:18.305046 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 197/398] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:57:18 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 28163 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:57:18.925246 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-663f77bf-98e3-47c0-bdec-cda667b987e7 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Action: 'create', calling method: .version_select at 0x7f14f81a6048>, body: {"keypair": {"name": "tempest-TestShelveInstance-476918611"}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:57:18.955373 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.quota [None req-663f77bf-98e3-47c0-bdec-cda667b987e7 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Getting quotas for project 482e5876a2f84b6ca5fc8e3537c2e971. Resources: {'key_pairs'} {{(pid=101356) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 16 14:57:18.960326 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.quota [None req-663f77bf-98e3-47c0-bdec-cda667b987e7 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Getting quotas for user c2d92824869e49fca069e536bc80b2f2 and project 482e5876a2f84b6ca5fc8e3537c2e971. Resources: {'key_pairs'} {{(pid=101356) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 16 14:57:19.175001 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-64f2d1bb-53a4-4fdf-9144-18e0ad0a44e2 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:57:19.176377 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-64f2d1bb-53a4-4fdf-9144-18e0ad0a44e2 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: 407dd6f1-6f0a-41ba-80e2-9ebe4630fa75] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:57:19.177752 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.quota [None req-663f77bf-98e3-47c0-bdec-cda667b987e7 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Getting quotas for project 482e5876a2f84b6ca5fc8e3537c2e971. Resources: {'key_pairs'} {{(pid=101356) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 16 14:57:19.182964 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.quota [None req-663f77bf-98e3-47c0-bdec-cda667b987e7 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Getting quotas for user c2d92824869e49fca069e536bc80b2f2 and project 482e5876a2f84b6ca5fc8e3537c2e971. Resources: {'key_pairs'} {{(pid=101356) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 16 14:57:19.186240 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-64f2d1bb-53a4-4fdf-9144-18e0ad0a44e2 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:19.187189 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-64f2d1bb-53a4-4fdf-9144-18e0ad0a44e2 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:19.188240 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-64f2d1bb-53a4-4fdf-9144-18e0ad0a44e2 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:19.188897 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-64f2d1bb-53a4-4fdf-9144-18e0ad0a44e2 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:19.203682 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-663f77bf-98e3-47c0-bdec-cda667b987e7 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 2311 microversion: 2.1 time: 0.559820 Dec 16 14:57:19.204980 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 202/399] 10.222.0.45 () {60 vars in 1148 bytes} [Thu Dec 16 14:57:18 2021] POST /compute/v2.1/os-keypairs => generated 2311 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:57:19.282109 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-00b15b1d-7b45-4e4a-a4af-909bcbaa67ed tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:57:19.283463 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-00b15b1d-7b45-4e4a-a4af-909bcbaa67ed tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:57:19.292233 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-00b15b1d-7b45-4e4a-a4af-909bcbaa67ed tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:19.292831 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-00b15b1d-7b45-4e4a-a4af-909bcbaa67ed tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:19.293895 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-00b15b1d-7b45-4e4a-a4af-909bcbaa67ed tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:19.294460 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-00b15b1d-7b45-4e4a-a4af-909bcbaa67ed tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:19.447325 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-64f2d1bb-53a4-4fdf-9144-18e0ad0a44e2 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "POST /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75/action" status: 200 len: 32 microversion: 2.1 time: 0.281086 Dec 16 14:57:19.447920 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 198/400] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:57:19 2021] POST /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75/action => generated 32 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 14:57:19.457910 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-1513425c-8a08-4b78-9133-a14191b6321d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:57:19.458892 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-00b15b1d-7b45-4e4a-a4af-909bcbaa67ed tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 28175 microversion: 2.1 time: 0.184269 Dec 16 14:57:19.459088 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-1513425c-8a08-4b78-9133-a14191b6321d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:57:19.460436 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 203/401] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:57:19 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 28175 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 14:57:19.468672 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1513425c-8a08-4b78-9133-a14191b6321d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:19.473423 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-d72cffe0-c6d1-410d-9aa8-b57bf388273c tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:57:19.474454 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-d72cffe0-c6d1-410d-9aa8-b57bf388273c tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: 407dd6f1-6f0a-41ba-80e2-9ebe4630fa75] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:57:19.478767 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1513425c-8a08-4b78-9133-a14191b6321d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:19.479891 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1513425c-8a08-4b78-9133-a14191b6321d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:19.480404 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1513425c-8a08-4b78-9133-a14191b6321d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:19.486838 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d72cffe0-c6d1-410d-9aa8-b57bf388273c tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:19.487633 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d72cffe0-c6d1-410d-9aa8-b57bf388273c tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:19.488678 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d72cffe0-c6d1-410d-9aa8-b57bf388273c tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:19.489333 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d72cffe0-c6d1-410d-9aa8-b57bf388273c tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:19.650924 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-1513425c-8a08-4b78-9133-a14191b6321d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 200 len: 28163 microversion: 2.20 time: 0.201468 Dec 16 14:57:19.651616 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 199/402] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:57:19 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 28163 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:57:19.724883 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-d72cffe0-c6d1-410d-9aa8-b57bf388273c tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:57:19.747593 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-d72cffe0-c6d1-410d-9aa8-b57bf388273c tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75" status: 200 len: 1521 microversion: 2.1 time: 0.285372 Dec 16 14:57:19.748788 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 204/403] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:57:19 2021] GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75 => generated 1521 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:57:20.477410 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-80eb288f-66f8-4605-acc5-79ac184ceb70 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:57:20.478607 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-80eb288f-66f8-4605-acc5-79ac184ceb70 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:57:20.493875 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-80eb288f-66f8-4605-acc5-79ac184ceb70 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:20.496074 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-80eb288f-66f8-4605-acc5-79ac184ceb70 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:20.496074 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-80eb288f-66f8-4605-acc5-79ac184ceb70 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:20.496074 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-80eb288f-66f8-4605-acc5-79ac184ceb70 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:20.676154 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-80eb288f-66f8-4605-acc5-79ac184ceb70 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 28175 microversion: 2.1 time: 0.207514 Dec 16 14:57:20.681157 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 200/404] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:57:20 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 28175 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:57:20.683531 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-c7cc45bf-0e7c-474a-a437-18a1d73bd9b7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:57:20.684729 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-c7cc45bf-0e7c-474a-a437-18a1d73bd9b7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:57:20.697792 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c7cc45bf-0e7c-474a-a437-18a1d73bd9b7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:20.698676 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c7cc45bf-0e7c-474a-a437-18a1d73bd9b7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:20.699719 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c7cc45bf-0e7c-474a-a437-18a1d73bd9b7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:20.700295 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c7cc45bf-0e7c-474a-a437-18a1d73bd9b7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:20.786101 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-05139b16-d99d-4286-970a-bd4f7e4d74b6 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:57:20.786662 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-05139b16-d99d-4286-970a-bd4f7e4d74b6 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: 407dd6f1-6f0a-41ba-80e2-9ebe4630fa75] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:57:20.799926 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-05139b16-d99d-4286-970a-bd4f7e4d74b6 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:20.799926 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-05139b16-d99d-4286-970a-bd4f7e4d74b6 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:20.799926 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-05139b16-d99d-4286-970a-bd4f7e4d74b6 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:20.799926 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-05139b16-d99d-4286-970a-bd4f7e4d74b6 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:20.918736 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-c7cc45bf-0e7c-474a-a437-18a1d73bd9b7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 200 len: 28163 microversion: 2.20 time: 0.252868 Dec 16 14:57:20.919715 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 205/405] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:57:20 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 28163 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:57:21.497111 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-05139b16-d99d-4286-970a-bd4f7e4d74b6 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:57:21.508630 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-05139b16-d99d-4286-970a-bd4f7e4d74b6 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75" status: 200 len: 1521 microversion: 2.1 time: 0.741410 Dec 16 14:57:21.509446 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 201/406] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:57:20 2021] GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75 => generated 1521 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:57:21.698873 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-714ba042-c95f-4cf3-8f5e-c14bcad9fcff tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:57:21.714119 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-714ba042-c95f-4cf3-8f5e-c14bcad9fcff tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:57:21.739379 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-714ba042-c95f-4cf3-8f5e-c14bcad9fcff tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:21.740224 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-714ba042-c95f-4cf3-8f5e-c14bcad9fcff tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:21.741868 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-714ba042-c95f-4cf3-8f5e-c14bcad9fcff tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:21.744362 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-714ba042-c95f-4cf3-8f5e-c14bcad9fcff tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:21.937348 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-135c8dce-2ef7-4e68-a4c8-6c7de28ac516 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:57:21.941528 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-135c8dce-2ef7-4e68-a4c8-6c7de28ac516 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:57:21.946892 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-714ba042-c95f-4cf3-8f5e-c14bcad9fcff tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 28175 microversion: 2.1 time: 0.260727 Dec 16 14:57:21.952265 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 206/407] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:57:21 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 28175 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:57:21.967539 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-135c8dce-2ef7-4e68-a4c8-6c7de28ac516 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:21.968061 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-135c8dce-2ef7-4e68-a4c8-6c7de28ac516 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:21.968937 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-135c8dce-2ef7-4e68-a4c8-6c7de28ac516 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:21.969922 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-135c8dce-2ef7-4e68-a4c8-6c7de28ac516 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:22.244067 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-135c8dce-2ef7-4e68-a4c8-6c7de28ac516 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 200 len: 28163 microversion: 2.20 time: 0.316795 Dec 16 14:57:22.248639 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 202/408] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:57:21 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 28163 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 16 14:57:22.533811 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-fca87434-ebac-45a1-bbbc-9a2fa1054200 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:57:22.535743 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-fca87434-ebac-45a1-bbbc-9a2fa1054200 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: 407dd6f1-6f0a-41ba-80e2-9ebe4630fa75] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:57:22.560950 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fca87434-ebac-45a1-bbbc-9a2fa1054200 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:22.567815 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fca87434-ebac-45a1-bbbc-9a2fa1054200 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:22.567815 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fca87434-ebac-45a1-bbbc-9a2fa1054200 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:22.567815 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fca87434-ebac-45a1-bbbc-9a2fa1054200 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:22.980457 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-767720d1-c589-4a1d-beb6-edf0eea053ce tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:57:22.982957 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-767720d1-c589-4a1d-beb6-edf0eea053ce tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:57:22.995753 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-767720d1-c589-4a1d-beb6-edf0eea053ce tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:22.997525 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-767720d1-c589-4a1d-beb6-edf0eea053ce tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:22.999833 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-767720d1-c589-4a1d-beb6-edf0eea053ce tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:23.000514 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-767720d1-c589-4a1d-beb6-edf0eea053ce tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:23.102167 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-fca87434-ebac-45a1-bbbc-9a2fa1054200 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:57:23.117730 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-fca87434-ebac-45a1-bbbc-9a2fa1054200 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75" status: 200 len: 1521 microversion: 2.1 time: 0.592457 Dec 16 14:57:23.126706 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 207/409] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:57:22 2021] GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75 => generated 1521 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:57:23.230924 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-767720d1-c589-4a1d-beb6-edf0eea053ce tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 28175 microversion: 2.1 time: 0.272526 Dec 16 14:57:23.232326 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 203/410] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:57:22 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 28175 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:57:23.261279 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-8744f6bf-cf44-421a-a76e-3939ac441abb tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:57:23.262429 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-8744f6bf-cf44-421a-a76e-3939ac441abb tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:57:23.271013 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8744f6bf-cf44-421a-a76e-3939ac441abb tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:23.271528 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8744f6bf-cf44-421a-a76e-3939ac441abb tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:23.272423 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8744f6bf-cf44-421a-a76e-3939ac441abb tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:23.272919 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8744f6bf-cf44-421a-a76e-3939ac441abb tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:23.509677 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-8744f6bf-cf44-421a-a76e-3939ac441abb tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 200 len: 28163 microversion: 2.20 time: 0.256514 Dec 16 14:57:23.510455 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 208/411] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:57:23 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 28163 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:57:24.153076 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-e02ae516-e1a1-4dce-bbbd-31ec3f821790 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:57:24.155723 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-e02ae516-e1a1-4dce-bbbd-31ec3f821790 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: 407dd6f1-6f0a-41ba-80e2-9ebe4630fa75] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:57:24.181505 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e02ae516-e1a1-4dce-bbbd-31ec3f821790 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:24.182356 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e02ae516-e1a1-4dce-bbbd-31ec3f821790 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:24.183516 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e02ae516-e1a1-4dce-bbbd-31ec3f821790 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:24.184218 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e02ae516-e1a1-4dce-bbbd-31ec3f821790 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:24.249023 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-c8d96ae5-b480-4a75-a11c-0166f49d9003 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:57:24.262652 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-c8d96ae5-b480-4a75-a11c-0166f49d9003 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:57:24.308743 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c8d96ae5-b480-4a75-a11c-0166f49d9003 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:24.311229 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c8d96ae5-b480-4a75-a11c-0166f49d9003 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:24.317839 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c8d96ae5-b480-4a75-a11c-0166f49d9003 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:24.318509 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c8d96ae5-b480-4a75-a11c-0166f49d9003 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:24.581643 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-c8d96ae5-b480-4a75-a11c-0166f49d9003 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 28175 microversion: 2.1 time: 0.340691 Dec 16 14:57:24.582382 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 209/412] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:57:24 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 28175 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:57:24.613903 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-8fa68f82-aa47-4e28-afdc-01a8a29a4321 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:57:24.619306 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-8fa68f82-aa47-4e28-afdc-01a8a29a4321 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:57:24.646762 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8fa68f82-aa47-4e28-afdc-01a8a29a4321 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:24.655127 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8fa68f82-aa47-4e28-afdc-01a8a29a4321 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:24.658796 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8fa68f82-aa47-4e28-afdc-01a8a29a4321 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:24.661028 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8fa68f82-aa47-4e28-afdc-01a8a29a4321 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:24.895314 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-8fa68f82-aa47-4e28-afdc-01a8a29a4321 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 200 len: 28163 microversion: 2.20 time: 0.311219 Dec 16 14:57:24.896330 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 210/413] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:57:24 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 28163 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:57:24.921209 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-e02ae516-e1a1-4dce-bbbd-31ec3f821790 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:57:24.945561 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-e02ae516-e1a1-4dce-bbbd-31ec3f821790 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75" status: 200 len: 1521 microversion: 2.1 time: 0.798385 Dec 16 14:57:24.946560 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 204/414] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:57:24 2021] GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75 => generated 1521 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:57:25.602514 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-3069add0-b148-40c4-8d0a-4f06a141b042 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:57:25.604795 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-3069add0-b148-40c4-8d0a-4f06a141b042 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:57:25.615379 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3069add0-b148-40c4-8d0a-4f06a141b042 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:25.617045 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3069add0-b148-40c4-8d0a-4f06a141b042 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:25.618297 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3069add0-b148-40c4-8d0a-4f06a141b042 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:25.618996 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3069add0-b148-40c4-8d0a-4f06a141b042 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:25.760416 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-3069add0-b148-40c4-8d0a-4f06a141b042 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 28175 microversion: 2.1 time: 0.170452 Dec 16 14:57:25.764553 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 211/415] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:57:25 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 28175 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:57:25.916945 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-411ea596-cb2c-4820-8c40-556b0daacdf5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:57:25.918487 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-411ea596-cb2c-4820-8c40-556b0daacdf5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:57:25.936695 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-411ea596-cb2c-4820-8c40-556b0daacdf5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:25.937786 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-411ea596-cb2c-4820-8c40-556b0daacdf5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:25.939349 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-411ea596-cb2c-4820-8c40-556b0daacdf5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:25.940028 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-411ea596-cb2c-4820-8c40-556b0daacdf5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:25.982929 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-a5c933f6-2782-4340-80f4-8bb90d5e9a32 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:57:25.985927 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-a5c933f6-2782-4340-80f4-8bb90d5e9a32 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: 407dd6f1-6f0a-41ba-80e2-9ebe4630fa75] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:57:26.023341 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a5c933f6-2782-4340-80f4-8bb90d5e9a32 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:26.024877 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a5c933f6-2782-4340-80f4-8bb90d5e9a32 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:26.029221 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a5c933f6-2782-4340-80f4-8bb90d5e9a32 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:26.029757 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a5c933f6-2782-4340-80f4-8bb90d5e9a32 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:26.230307 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-411ea596-cb2c-4820-8c40-556b0daacdf5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 200 len: 28163 microversion: 2.20 time: 0.326987 Dec 16 14:57:26.231154 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 205/416] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:57:25 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 28163 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:57:26.513413 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-a5c933f6-2782-4340-80f4-8bb90d5e9a32 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:57:26.525549 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-a5c933f6-2782-4340-80f4-8bb90d5e9a32 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75" status: 200 len: 1521 microversion: 2.1 time: 0.563245 Dec 16 14:57:26.535956 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 212/417] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:57:25 2021] GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75 => generated 1521 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:57:26.799429 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-52a8989a-f2f9-4e43-83f2-9ee7f3a8f177 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:57:26.803999 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-52a8989a-f2f9-4e43-83f2-9ee7f3a8f177 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:57:26.834640 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-52a8989a-f2f9-4e43-83f2-9ee7f3a8f177 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:26.835501 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-52a8989a-f2f9-4e43-83f2-9ee7f3a8f177 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:26.836583 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-52a8989a-f2f9-4e43-83f2-9ee7f3a8f177 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:26.837290 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-52a8989a-f2f9-4e43-83f2-9ee7f3a8f177 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:27.051941 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-52a8989a-f2f9-4e43-83f2-9ee7f3a8f177 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 28175 microversion: 2.1 time: 0.283113 Dec 16 14:57:27.052631 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 206/418] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:57:26 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 28175 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:57:27.249854 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-27db3e67-ae59-4932-a0ef-cd7df63520a5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:57:27.250963 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-27db3e67-ae59-4932-a0ef-cd7df63520a5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:57:27.263089 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-27db3e67-ae59-4932-a0ef-cd7df63520a5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:27.263594 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-27db3e67-ae59-4932-a0ef-cd7df63520a5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:27.264460 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-27db3e67-ae59-4932-a0ef-cd7df63520a5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:27.264948 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-27db3e67-ae59-4932-a0ef-cd7df63520a5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:27.417829 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-27db3e67-ae59-4932-a0ef-cd7df63520a5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 200 len: 28163 microversion: 2.20 time: 0.178448 Dec 16 14:57:27.422742 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 213/419] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:57:27 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 28163 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:57:27.560599 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-6ba42b1e-f1f0-41a1-b6fe-6ae80991f361 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:57:27.561359 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-6ba42b1e-f1f0-41a1-b6fe-6ae80991f361 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: 407dd6f1-6f0a-41ba-80e2-9ebe4630fa75] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:57:27.574711 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6ba42b1e-f1f0-41a1-b6fe-6ae80991f361 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:27.576489 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6ba42b1e-f1f0-41a1-b6fe-6ae80991f361 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:27.578253 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6ba42b1e-f1f0-41a1-b6fe-6ae80991f361 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:27.579245 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6ba42b1e-f1f0-41a1-b6fe-6ae80991f361 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:27.869876 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-6ba42b1e-f1f0-41a1-b6fe-6ae80991f361 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:57:27.880974 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-6ba42b1e-f1f0-41a1-b6fe-6ae80991f361 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75" status: 200 len: 1521 microversion: 2.1 time: 0.336492 Dec 16 14:57:27.893019 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 207/420] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:57:27 2021] GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75 => generated 1521 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:57:28.071622 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-5554be18-31dd-479c-8c38-83b0ea8eddab tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:57:28.076595 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-5554be18-31dd-479c-8c38-83b0ea8eddab tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:57:28.103810 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5554be18-31dd-479c-8c38-83b0ea8eddab tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:28.104747 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5554be18-31dd-479c-8c38-83b0ea8eddab tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:28.108533 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5554be18-31dd-479c-8c38-83b0ea8eddab tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:28.109463 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5554be18-31dd-479c-8c38-83b0ea8eddab tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:28.437838 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-ef224361-4542-480c-9b84-3520c09bc227 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:57:28.449940 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-ef224361-4542-480c-9b84-3520c09bc227 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:57:28.458971 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ef224361-4542-480c-9b84-3520c09bc227 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:28.460849 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ef224361-4542-480c-9b84-3520c09bc227 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:28.462144 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ef224361-4542-480c-9b84-3520c09bc227 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:28.462819 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ef224361-4542-480c-9b84-3520c09bc227 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:28.464188 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-5554be18-31dd-479c-8c38-83b0ea8eddab tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 28175 microversion: 2.1 time: 0.402863 Dec 16 14:57:28.465337 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 214/421] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:57:28 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 28175 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:57:28.629576 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-ef224361-4542-480c-9b84-3520c09bc227 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 200 len: 28163 microversion: 2.20 time: 0.202823 Dec 16 14:57:28.630929 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 208/422] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:57:28 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 28163 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:57:28.911752 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-1187f26e-7ca0-48cf-900e-f60157b5d201 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:57:28.915965 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-1187f26e-7ca0-48cf-900e-f60157b5d201 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: 407dd6f1-6f0a-41ba-80e2-9ebe4630fa75] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:57:28.944970 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1187f26e-7ca0-48cf-900e-f60157b5d201 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:28.947563 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1187f26e-7ca0-48cf-900e-f60157b5d201 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:28.950634 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1187f26e-7ca0-48cf-900e-f60157b5d201 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:28.952892 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1187f26e-7ca0-48cf-900e-f60157b5d201 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:29.407729 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-1187f26e-7ca0-48cf-900e-f60157b5d201 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:57:29.420164 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-1187f26e-7ca0-48cf-900e-f60157b5d201 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75" status: 200 len: 1521 microversion: 2.1 time: 0.522878 Dec 16 14:57:29.420975 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 215/423] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:57:28 2021] GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75 => generated 1521 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:57:29.481735 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-dd26afab-df09-4993-994d-ece54bb92518 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:57:29.482898 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-dd26afab-df09-4993-994d-ece54bb92518 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:57:29.492202 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-dd26afab-df09-4993-994d-ece54bb92518 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:29.492711 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-dd26afab-df09-4993-994d-ece54bb92518 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:29.493595 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-dd26afab-df09-4993-994d-ece54bb92518 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:29.494110 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-dd26afab-df09-4993-994d-ece54bb92518 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:29.647646 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-c1758431-daa7-4823-8b81-178551288024 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:57:29.648968 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-c1758431-daa7-4823-8b81-178551288024 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:57:29.658587 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c1758431-daa7-4823-8b81-178551288024 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:29.659844 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c1758431-daa7-4823-8b81-178551288024 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:29.660011 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c1758431-daa7-4823-8b81-178551288024 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:29.660508 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c1758431-daa7-4823-8b81-178551288024 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:29.673937 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-dd26afab-df09-4993-994d-ece54bb92518 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 28175 microversion: 2.1 time: 0.200988 Dec 16 14:57:29.675151 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 209/424] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:57:29 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 28175 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:57:29.815658 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-c1758431-daa7-4823-8b81-178551288024 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 200 len: 28163 microversion: 2.20 time: 0.175986 Dec 16 14:57:29.820072 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 216/425] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:57:29 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 28163 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 16 14:57:30.445519 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-5854f39f-8fed-470b-b501-5b4937105a9e tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:57:30.446321 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-5854f39f-8fed-470b-b501-5b4937105a9e tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: 407dd6f1-6f0a-41ba-80e2-9ebe4630fa75] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:57:30.457766 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5854f39f-8fed-470b-b501-5b4937105a9e tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:30.458311 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5854f39f-8fed-470b-b501-5b4937105a9e tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:30.459197 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5854f39f-8fed-470b-b501-5b4937105a9e tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:30.460491 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5854f39f-8fed-470b-b501-5b4937105a9e tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:30.695205 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-e5c5b035-328a-42d4-9484-46df7569a853 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:57:30.697420 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-e5c5b035-328a-42d4-9484-46df7569a853 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:57:30.709677 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e5c5b035-328a-42d4-9484-46df7569a853 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:30.710705 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e5c5b035-328a-42d4-9484-46df7569a853 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:30.711802 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e5c5b035-328a-42d4-9484-46df7569a853 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:30.712487 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e5c5b035-328a-42d4-9484-46df7569a853 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:30.729015 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-5854f39f-8fed-470b-b501-5b4937105a9e tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:57:30.739161 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-5854f39f-8fed-470b-b501-5b4937105a9e tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75" status: 200 len: 1521 microversion: 2.1 time: 0.303472 Dec 16 14:57:30.739988 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 210/426] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:57:30 2021] GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75 => generated 1521 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:57:30.832812 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-1b9e6def-50c5-4448-bd5f-9f1b754e05d3 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:57:30.834264 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-1b9e6def-50c5-4448-bd5f-9f1b754e05d3 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:57:30.842800 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1b9e6def-50c5-4448-bd5f-9f1b754e05d3 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:30.843402 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1b9e6def-50c5-4448-bd5f-9f1b754e05d3 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:30.844338 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1b9e6def-50c5-4448-bd5f-9f1b754e05d3 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:30.844926 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1b9e6def-50c5-4448-bd5f-9f1b754e05d3 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:30.875255 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-e5c5b035-328a-42d4-9484-46df7569a853 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 28175 microversion: 2.1 time: 0.191144 Dec 16 14:57:30.883282 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 217/427] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:57:30 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 28175 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 14:57:31.003437 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-1b9e6def-50c5-4448-bd5f-9f1b754e05d3 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 200 len: 28163 microversion: 2.20 time: 0.174468 Dec 16 14:57:31.003437 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 211/428] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:57:30 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 28163 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 16 14:57:31.766125 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-622a7806-00f6-4b01-8aed-2b42802d8c1a tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:57:31.771941 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-622a7806-00f6-4b01-8aed-2b42802d8c1a tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: 407dd6f1-6f0a-41ba-80e2-9ebe4630fa75] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:57:31.791629 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-622a7806-00f6-4b01-8aed-2b42802d8c1a tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:31.794167 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-622a7806-00f6-4b01-8aed-2b42802d8c1a tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:31.795351 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-622a7806-00f6-4b01-8aed-2b42802d8c1a tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:31.797653 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-622a7806-00f6-4b01-8aed-2b42802d8c1a tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:31.909071 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-4c6f0203-b3b1-4ed2-a9de-267cbf7b0f2a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:57:31.917178 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-4c6f0203-b3b1-4ed2-a9de-267cbf7b0f2a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:57:31.932674 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4c6f0203-b3b1-4ed2-a9de-267cbf7b0f2a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:31.933291 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4c6f0203-b3b1-4ed2-a9de-267cbf7b0f2a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:31.934432 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4c6f0203-b3b1-4ed2-a9de-267cbf7b0f2a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:31.935041 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4c6f0203-b3b1-4ed2-a9de-267cbf7b0f2a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:32.104846 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-4c6f0203-b3b1-4ed2-a9de-267cbf7b0f2a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 28175 microversion: 2.1 time: 0.212686 Dec 16 14:57:32.106752 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 212/429] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:57:31 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 28175 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:57:32.121984 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-81e8b678-8e55-4533-bd08-2ea2b1d221bd tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:57:32.124047 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-81e8b678-8e55-4533-bd08-2ea2b1d221bd tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:57:32.138548 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-81e8b678-8e55-4533-bd08-2ea2b1d221bd tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:32.139320 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-81e8b678-8e55-4533-bd08-2ea2b1d221bd tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:32.141029 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-81e8b678-8e55-4533-bd08-2ea2b1d221bd tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:32.141836 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-81e8b678-8e55-4533-bd08-2ea2b1d221bd tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:32.171947 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-622a7806-00f6-4b01-8aed-2b42802d8c1a tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:57:32.184148 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-622a7806-00f6-4b01-8aed-2b42802d8c1a tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75" status: 200 len: 1521 microversion: 2.1 time: 0.428261 Dec 16 14:57:32.186376 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 218/430] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:57:31 2021] GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75 => generated 1521 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:57:32.296025 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-81e8b678-8e55-4533-bd08-2ea2b1d221bd tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 200 len: 28163 microversion: 2.20 time: 0.187305 Dec 16 14:57:32.296976 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 213/431] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:57:32 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 28163 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:57:33.125534 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-01f6cbd5-eda0-4199-9298-3339bf92d294 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:57:33.127005 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-01f6cbd5-eda0-4199-9298-3339bf92d294 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:57:33.137320 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-01f6cbd5-eda0-4199-9298-3339bf92d294 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:33.138265 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-01f6cbd5-eda0-4199-9298-3339bf92d294 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:33.139138 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-01f6cbd5-eda0-4199-9298-3339bf92d294 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:33.140275 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-01f6cbd5-eda0-4199-9298-3339bf92d294 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:33.212986 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-3f19df3b-a08a-4500-9cd9-09d224ab01d5 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:57:33.214877 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-3f19df3b-a08a-4500-9cd9-09d224ab01d5 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: 407dd6f1-6f0a-41ba-80e2-9ebe4630fa75] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:57:33.226544 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3f19df3b-a08a-4500-9cd9-09d224ab01d5 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:33.227874 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3f19df3b-a08a-4500-9cd9-09d224ab01d5 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:33.229782 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3f19df3b-a08a-4500-9cd9-09d224ab01d5 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:33.230866 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3f19df3b-a08a-4500-9cd9-09d224ab01d5 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:33.321070 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-01f6cbd5-eda0-4199-9298-3339bf92d294 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 28175 microversion: 2.1 time: 0.206065 Dec 16 14:57:33.321771 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 219/432] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:57:33 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 28175 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:57:33.331738 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-07d2008a-756b-467d-bc87-a651a173deb7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:57:33.332889 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-07d2008a-756b-467d-bc87-a651a173deb7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:57:33.343151 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-07d2008a-756b-467d-bc87-a651a173deb7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:33.344119 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-07d2008a-756b-467d-bc87-a651a173deb7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:33.345360 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-07d2008a-756b-467d-bc87-a651a173deb7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:33.351292 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-07d2008a-756b-467d-bc87-a651a173deb7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:33.495105 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-3f19df3b-a08a-4500-9cd9-09d224ab01d5 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:57:33.510862 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-3f19df3b-a08a-4500-9cd9-09d224ab01d5 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75" status: 200 len: 1521 microversion: 2.1 time: 0.311357 Dec 16 14:57:33.511962 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 214/433] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:57:33 2021] GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75 => generated 1521 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:57:33.525969 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-07d2008a-756b-467d-bc87-a651a173deb7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 200 len: 28163 microversion: 2.20 time: 0.202663 Dec 16 14:57:33.527070 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 220/434] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:57:33 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 28163 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:57:34.353075 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-eee776af-4bd6-4200-8683-d04560db4a0a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:57:34.356023 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-eee776af-4bd6-4200-8683-d04560db4a0a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:57:34.369454 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-eee776af-4bd6-4200-8683-d04560db4a0a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:34.370029 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-eee776af-4bd6-4200-8683-d04560db4a0a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:34.371058 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-eee776af-4bd6-4200-8683-d04560db4a0a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:34.371589 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-eee776af-4bd6-4200-8683-d04560db4a0a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:34.539102 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-aa9b2da5-6c22-432f-832f-fbd0929c45fc tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:57:34.539868 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-aa9b2da5-6c22-432f-832f-fbd0929c45fc tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: 407dd6f1-6f0a-41ba-80e2-9ebe4630fa75] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:57:34.549466 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-aa9b2da5-6c22-432f-832f-fbd0929c45fc tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:34.549904 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-aa9b2da5-6c22-432f-832f-fbd0929c45fc tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:34.550791 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-aa9b2da5-6c22-432f-832f-fbd0929c45fc tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:34.551381 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-aa9b2da5-6c22-432f-832f-fbd0929c45fc tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:34.574567 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-eee776af-4bd6-4200-8683-d04560db4a0a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 28466 microversion: 2.1 time: 0.245018 Dec 16 14:57:34.580663 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 215/435] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:57:34 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 28466 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:57:34.590948 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-fbd82563-53d5-487b-9a7d-cf6c0beabf2c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:57:34.592081 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-fbd82563-53d5-487b-9a7d-cf6c0beabf2c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:57:34.601109 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fbd82563-53d5-487b-9a7d-cf6c0beabf2c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:34.601608 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fbd82563-53d5-487b-9a7d-cf6c0beabf2c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:34.602481 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fbd82563-53d5-487b-9a7d-cf6c0beabf2c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:34.602966 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fbd82563-53d5-487b-9a7d-cf6c0beabf2c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:34.750500 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-fbd82563-53d5-487b-9a7d-cf6c0beabf2c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 200 len: 28454 microversion: 2.20 time: 0.167451 Dec 16 14:57:34.751218 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 216/436] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:57:34 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 28454 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:57:34.786022 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-aa9b2da5-6c22-432f-832f-fbd0929c45fc tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:57:34.795621 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-aa9b2da5-6c22-432f-832f-fbd0929c45fc tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75" status: 200 len: 1521 microversion: 2.1 time: 0.269925 Dec 16 14:57:34.796212 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 221/437] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:57:34 2021] GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75 => generated 1521 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:57:35.592452 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-ae8bf099-f3b3-44f2-ac1c-5ec92cc660e9 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:57:35.593596 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-ae8bf099-f3b3-44f2-ac1c-5ec92cc660e9 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:57:35.603167 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ae8bf099-f3b3-44f2-ac1c-5ec92cc660e9 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:35.603878 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ae8bf099-f3b3-44f2-ac1c-5ec92cc660e9 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:35.604878 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ae8bf099-f3b3-44f2-ac1c-5ec92cc660e9 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:35.605576 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ae8bf099-f3b3-44f2-ac1c-5ec92cc660e9 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:35.744370 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-ae8bf099-f3b3-44f2-ac1c-5ec92cc660e9 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 28466 microversion: 2.1 time: 0.159425 Dec 16 14:57:35.745254 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 217/438] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:57:35 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 28466 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:57:35.767838 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-01a39d73-fc04-4b22-8f89-6c22b0e21ed4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:57:35.769226 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-01a39d73-fc04-4b22-8f89-6c22b0e21ed4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:57:35.779165 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-01a39d73-fc04-4b22-8f89-6c22b0e21ed4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:35.779681 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-01a39d73-fc04-4b22-8f89-6c22b0e21ed4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:35.780528 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-01a39d73-fc04-4b22-8f89-6c22b0e21ed4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:35.781249 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-01a39d73-fc04-4b22-8f89-6c22b0e21ed4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:35.819816 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-05201651-f95b-4b60-932f-932339dc4238 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:57:35.820713 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-05201651-f95b-4b60-932f-932339dc4238 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: 407dd6f1-6f0a-41ba-80e2-9ebe4630fa75] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:57:35.846548 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-05201651-f95b-4b60-932f-932339dc4238 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:35.852570 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-05201651-f95b-4b60-932f-932339dc4238 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:35.852570 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-05201651-f95b-4b60-932f-932339dc4238 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:35.852570 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-05201651-f95b-4b60-932f-932339dc4238 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:35.949115 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-01a39d73-fc04-4b22-8f89-6c22b0e21ed4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 200 len: 28454 microversion: 2.20 time: 0.179200 Dec 16 14:57:35.950836 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 222/439] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:57:35 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 28454 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:57:36.194597 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-05201651-f95b-4b60-932f-932339dc4238 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:57:36.203610 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-05201651-f95b-4b60-932f-932339dc4238 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75" status: 200 len: 1521 microversion: 2.1 time: 0.392260 Dec 16 14:57:36.204467 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 218/440] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:57:35 2021] GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75 => generated 1521 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:57:36.761231 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-cfa53cf3-4e57-49dd-bc26-01a6c2a85290 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:57:36.762384 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-cfa53cf3-4e57-49dd-bc26-01a6c2a85290 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:57:36.770905 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cfa53cf3-4e57-49dd-bc26-01a6c2a85290 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:36.771419 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cfa53cf3-4e57-49dd-bc26-01a6c2a85290 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:36.772259 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cfa53cf3-4e57-49dd-bc26-01a6c2a85290 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:36.773252 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cfa53cf3-4e57-49dd-bc26-01a6c2a85290 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:36.914163 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-cfa53cf3-4e57-49dd-bc26-01a6c2a85290 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 28634 microversion: 2.1 time: 0.160156 Dec 16 14:57:36.918437 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 223/441] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:57:36 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 28634 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:57:36.971694 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-24aff797-44b5-4c5d-a2d3-9caca5d1c628 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:57:36.973305 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-24aff797-44b5-4c5d-a2d3-9caca5d1c628 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:57:36.984510 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-24aff797-44b5-4c5d-a2d3-9caca5d1c628 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:36.985161 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-24aff797-44b5-4c5d-a2d3-9caca5d1c628 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:36.986474 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-24aff797-44b5-4c5d-a2d3-9caca5d1c628 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:36.986749 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-24aff797-44b5-4c5d-a2d3-9caca5d1c628 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:37.152986 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-24aff797-44b5-4c5d-a2d3-9caca5d1c628 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 200 len: 28622 microversion: 2.20 time: 0.191547 Dec 16 14:57:37.153800 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 219/442] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:57:36 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 28622 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:57:37.226953 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-5229ee28-3978-41cb-b001-880cf69194f5 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:57:37.227722 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-5229ee28-3978-41cb-b001-880cf69194f5 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: 407dd6f1-6f0a-41ba-80e2-9ebe4630fa75] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:57:37.238335 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5229ee28-3978-41cb-b001-880cf69194f5 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:37.239025 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5229ee28-3978-41cb-b001-880cf69194f5 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:37.239711 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5229ee28-3978-41cb-b001-880cf69194f5 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:37.240240 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5229ee28-3978-41cb-b001-880cf69194f5 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:37.489519 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-5229ee28-3978-41cb-b001-880cf69194f5 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:57:37.504391 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-5229ee28-3978-41cb-b001-880cf69194f5 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75" status: 200 len: 1521 microversion: 2.1 time: 0.285542 Dec 16 14:57:37.505382 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 224/443] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:57:37 2021] GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75 => generated 1521 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:57:37.933845 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-108a443b-4473-4edf-82b2-05a71a8178e8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:57:37.939360 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-108a443b-4473-4edf-82b2-05a71a8178e8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:57:37.952096 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-108a443b-4473-4edf-82b2-05a71a8178e8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:37.952096 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-108a443b-4473-4edf-82b2-05a71a8178e8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:37.953765 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-108a443b-4473-4edf-82b2-05a71a8178e8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:37.954765 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-108a443b-4473-4edf-82b2-05a71a8178e8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:38.114921 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-108a443b-4473-4edf-82b2-05a71a8178e8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 28634 microversion: 2.1 time: 0.191046 Dec 16 14:57:38.119721 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 220/444] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:57:37 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 28634 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:57:38.185882 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-0211ac4d-61e6-44e8-a640-528159ae2a7a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:57:38.188731 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-0211ac4d-61e6-44e8-a640-528159ae2a7a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:57:38.202440 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0211ac4d-61e6-44e8-a640-528159ae2a7a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:38.202950 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0211ac4d-61e6-44e8-a640-528159ae2a7a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:38.203797 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0211ac4d-61e6-44e8-a640-528159ae2a7a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:38.204548 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0211ac4d-61e6-44e8-a640-528159ae2a7a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:38.356256 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-0211ac4d-61e6-44e8-a640-528159ae2a7a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 200 len: 28622 microversion: 2.20 time: 0.193336 Dec 16 14:57:38.363442 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 225/445] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:57:38 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 28622 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:57:38.527994 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-9124a0e1-f903-405b-b343-b100615d24fa tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:57:38.529508 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-9124a0e1-f903-405b-b343-b100615d24fa tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: 407dd6f1-6f0a-41ba-80e2-9ebe4630fa75] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:57:38.540705 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9124a0e1-f903-405b-b343-b100615d24fa tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:38.541571 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9124a0e1-f903-405b-b343-b100615d24fa tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:38.542698 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9124a0e1-f903-405b-b343-b100615d24fa tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:38.543429 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9124a0e1-f903-405b-b343-b100615d24fa tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:38.785869 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-9124a0e1-f903-405b-b343-b100615d24fa tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:57:38.798160 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-9124a0e1-f903-405b-b343-b100615d24fa tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75" status: 200 len: 1521 microversion: 2.1 time: 0.278436 Dec 16 14:57:38.808813 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 221/446] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:57:38 2021] GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75 => generated 1521 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:57:39.133366 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-c2f93991-2758-4771-a594-814583303089 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:57:39.138566 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-c2f93991-2758-4771-a594-814583303089 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:57:39.150446 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c2f93991-2758-4771-a594-814583303089 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:39.151131 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c2f93991-2758-4771-a594-814583303089 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:39.151968 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c2f93991-2758-4771-a594-814583303089 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:39.152697 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c2f93991-2758-4771-a594-814583303089 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:39.337744 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-c2f93991-2758-4771-a594-814583303089 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 28634 microversion: 2.1 time: 0.213840 Dec 16 14:57:39.360416 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 226/447] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:57:39 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 28634 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 14:57:39.389759 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-3f10d9ac-8f4e-4c49-9220-4ead470ee60e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:57:39.391032 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-3f10d9ac-8f4e-4c49-9220-4ead470ee60e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:57:39.415176 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3f10d9ac-8f4e-4c49-9220-4ead470ee60e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:39.415874 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3f10d9ac-8f4e-4c49-9220-4ead470ee60e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:39.416879 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3f10d9ac-8f4e-4c49-9220-4ead470ee60e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:39.417484 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3f10d9ac-8f4e-4c49-9220-4ead470ee60e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:39.596473 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-3f10d9ac-8f4e-4c49-9220-4ead470ee60e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 200 len: 28622 microversion: 2.20 time: 0.219015 Dec 16 14:57:39.596473 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 222/448] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:57:39 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 28622 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:57:39.821288 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-4acfd2fb-5c96-4b39-8552-e2a3a9c6eade tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:57:39.822112 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-4acfd2fb-5c96-4b39-8552-e2a3a9c6eade tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: 407dd6f1-6f0a-41ba-80e2-9ebe4630fa75] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:57:39.831187 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4acfd2fb-5c96-4b39-8552-e2a3a9c6eade tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:39.831681 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4acfd2fb-5c96-4b39-8552-e2a3a9c6eade tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:39.832511 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4acfd2fb-5c96-4b39-8552-e2a3a9c6eade tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:39.832995 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4acfd2fb-5c96-4b39-8552-e2a3a9c6eade tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:40.071435 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-4acfd2fb-5c96-4b39-8552-e2a3a9c6eade tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:57:40.083163 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-4acfd2fb-5c96-4b39-8552-e2a3a9c6eade tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75" status: 200 len: 1521 microversion: 2.1 time: 0.270783 Dec 16 14:57:40.084819 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 227/449] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:57:39 2021] GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75 => generated 1521 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:57:40.386078 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-0f14725f-5c6b-4e89-b7e7-b1593d120ceb tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:57:40.392092 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-0f14725f-5c6b-4e89-b7e7-b1593d120ceb tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:57:40.406002 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0f14725f-5c6b-4e89-b7e7-b1593d120ceb tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:40.406629 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0f14725f-5c6b-4e89-b7e7-b1593d120ceb tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:40.407569 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0f14725f-5c6b-4e89-b7e7-b1593d120ceb tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:40.408137 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0f14725f-5c6b-4e89-b7e7-b1593d120ceb tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:40.609065 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-8b70e064-a32c-4848-98de-06b3af0c0276 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:57:40.610304 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-8b70e064-a32c-4848-98de-06b3af0c0276 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:57:40.619148 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8b70e064-a32c-4848-98de-06b3af0c0276 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:40.619999 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8b70e064-a32c-4848-98de-06b3af0c0276 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:40.621146 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8b70e064-a32c-4848-98de-06b3af0c0276 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:40.621751 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8b70e064-a32c-4848-98de-06b3af0c0276 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:46.370990 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-0f14725f-5c6b-4e89-b7e7-b1593d120ceb tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 28634 microversion: 2.1 time: 5.998181 Dec 16 14:57:46.370990 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 223/450] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:57:40 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 28634 bytes in 6000 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:57:46.381882 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-c48ff8ba-da2f-4d57-b126-9ec3a70934c5 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:57:46.382759 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-c48ff8ba-da2f-4d57-b126-9ec3a70934c5 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: 407dd6f1-6f0a-41ba-80e2-9ebe4630fa75] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:57:46.388816 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-8b70e064-a32c-4848-98de-06b3af0c0276 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 200 len: 28622 microversion: 2.20 time: 5.787466 Dec 16 14:57:46.389867 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 228/451] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:57:40 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 28622 bytes in 5790 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:57:46.397731 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c48ff8ba-da2f-4d57-b126-9ec3a70934c5 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:46.398272 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c48ff8ba-da2f-4d57-b126-9ec3a70934c5 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:46.399393 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c48ff8ba-da2f-4d57-b126-9ec3a70934c5 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:46.399786 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c48ff8ba-da2f-4d57-b126-9ec3a70934c5 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:46.653709 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-c48ff8ba-da2f-4d57-b126-9ec3a70934c5 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:57:46.664013 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-c48ff8ba-da2f-4d57-b126-9ec3a70934c5 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75" status: 200 len: 1521 microversion: 2.1 time: 0.291899 Dec 16 14:57:46.674798 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 224/452] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:57:46 2021] GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75 => generated 1521 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:57:47.388431 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-1314029d-45bd-41ee-8389-1feedef2d791 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:57:47.389620 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-1314029d-45bd-41ee-8389-1feedef2d791 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:57:47.411416 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1314029d-45bd-41ee-8389-1feedef2d791 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:47.411416 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1314029d-45bd-41ee-8389-1feedef2d791 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:47.411416 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1314029d-45bd-41ee-8389-1feedef2d791 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:47.411416 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1314029d-45bd-41ee-8389-1feedef2d791 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:47.411705 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-1fca826f-ca81-4bd4-a3c4-281360871e5e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:57:47.411705 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-1fca826f-ca81-4bd4-a3c4-281360871e5e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:57:47.420410 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1fca826f-ca81-4bd4-a3c4-281360871e5e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:47.420927 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1fca826f-ca81-4bd4-a3c4-281360871e5e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:47.421754 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1fca826f-ca81-4bd4-a3c4-281360871e5e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:47.422370 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1fca826f-ca81-4bd4-a3c4-281360871e5e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:47.581140 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-1314029d-45bd-41ee-8389-1feedef2d791 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 28634 microversion: 2.1 time: 0.200707 Dec 16 14:57:47.581822 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 229/453] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:57:47 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 28634 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:57:47.656623 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-1fca826f-ca81-4bd4-a3c4-281360871e5e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 200 len: 28622 microversion: 2.20 time: 0.255700 Dec 16 14:57:47.657306 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 225/454] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:57:47 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 28622 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 16 14:57:47.689278 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-5c8b18c6-24d6-429b-9440-a03e96382622 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:57:47.690427 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-5c8b18c6-24d6-429b-9440-a03e96382622 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: 407dd6f1-6f0a-41ba-80e2-9ebe4630fa75] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:57:47.702615 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5c8b18c6-24d6-429b-9440-a03e96382622 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:47.703612 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5c8b18c6-24d6-429b-9440-a03e96382622 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:47.705154 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5c8b18c6-24d6-429b-9440-a03e96382622 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:47.705964 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5c8b18c6-24d6-429b-9440-a03e96382622 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:47.965089 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-5c8b18c6-24d6-429b-9440-a03e96382622 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:57:47.975600 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-5c8b18c6-24d6-429b-9440-a03e96382622 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75" status: 200 len: 1521 microversion: 2.1 time: 0.296363 Dec 16 14:57:47.976455 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 230/455] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:57:47 2021] GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75 => generated 1521 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:57:48.598563 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-2b44f167-21fb-4ea8-895d-520dd56320b6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:57:48.599725 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-2b44f167-21fb-4ea8-895d-520dd56320b6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:57:48.609104 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2b44f167-21fb-4ea8-895d-520dd56320b6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:48.609606 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2b44f167-21fb-4ea8-895d-520dd56320b6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:48.610489 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2b44f167-21fb-4ea8-895d-520dd56320b6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:48.610979 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2b44f167-21fb-4ea8-895d-520dd56320b6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:48.673716 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-3649cb66-39d0-4e69-b002-3a064a1870b8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:57:48.674798 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-3649cb66-39d0-4e69-b002-3a064a1870b8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:57:48.682783 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3649cb66-39d0-4e69-b002-3a064a1870b8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:48.685111 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3649cb66-39d0-4e69-b002-3a064a1870b8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:48.685111 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3649cb66-39d0-4e69-b002-3a064a1870b8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:48.685111 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3649cb66-39d0-4e69-b002-3a064a1870b8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:53.039589 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-2b44f167-21fb-4ea8-895d-520dd56320b6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 28634 microversion: 2.1 time: 4.448310 Dec 16 14:57:53.040295 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 226/456] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:57:48 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 28634 bytes in 4451 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:57:53.049225 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-86999b26-ec65-40f8-81e7-ace6b70da12a tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:57:53.049979 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-86999b26-ec65-40f8-81e7-ace6b70da12a tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: 407dd6f1-6f0a-41ba-80e2-9ebe4630fa75] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:57:53.058609 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-86999b26-ec65-40f8-81e7-ace6b70da12a tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:53.059116 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-86999b26-ec65-40f8-81e7-ace6b70da12a tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:53.059953 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-86999b26-ec65-40f8-81e7-ace6b70da12a tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:53.060445 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-86999b26-ec65-40f8-81e7-ace6b70da12a tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:53.082288 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-3649cb66-39d0-4e69-b002-3a064a1870b8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 200 len: 28622 microversion: 2.20 time: 4.415830 Dec 16 14:57:53.083088 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 231/457] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:57:48 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 28622 bytes in 4418 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:57:53.401040 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-86999b26-ec65-40f8-81e7-ace6b70da12a tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:57:53.410306 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-86999b26-ec65-40f8-81e7-ace6b70da12a tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75" status: 200 len: 1521 microversion: 2.1 time: 0.368759 Dec 16 14:57:53.410890 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 227/458] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:57:53 2021] GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75 => generated 1521 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:57:54.057117 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-19de6eb2-b2d7-4868-8002-24163d71432f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:57:54.058870 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-19de6eb2-b2d7-4868-8002-24163d71432f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:57:54.067594 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-19de6eb2-b2d7-4868-8002-24163d71432f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:54.068100 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-19de6eb2-b2d7-4868-8002-24163d71432f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:54.068941 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-19de6eb2-b2d7-4868-8002-24163d71432f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:54.069426 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-19de6eb2-b2d7-4868-8002-24163d71432f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:54.098941 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-6634a6cf-2b19-4ac2-874b-13bdd84004a6 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:57:54.099994 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-6634a6cf-2b19-4ac2-874b-13bdd84004a6 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:57:54.109436 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6634a6cf-2b19-4ac2-874b-13bdd84004a6 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:54.109921 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6634a6cf-2b19-4ac2-874b-13bdd84004a6 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:54.111051 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6634a6cf-2b19-4ac2-874b-13bdd84004a6 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:54.111559 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6634a6cf-2b19-4ac2-874b-13bdd84004a6 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:54.214245 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-19de6eb2-b2d7-4868-8002-24163d71432f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 28634 microversion: 2.1 time: 0.165797 Dec 16 14:57:54.215018 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 232/459] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:57:54 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 28634 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:57:54.301982 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-6634a6cf-2b19-4ac2-874b-13bdd84004a6 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 200 len: 28622 microversion: 2.20 time: 0.210438 Dec 16 14:57:54.302708 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 228/460] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:57:54 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 28622 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 16 14:57:54.433476 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-5b180ac5-3b32-4f63-8333-559bb1fda66d tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:57:54.434379 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-5b180ac5-3b32-4f63-8333-559bb1fda66d tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: 407dd6f1-6f0a-41ba-80e2-9ebe4630fa75] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:57:54.442930 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5b180ac5-3b32-4f63-8333-559bb1fda66d tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:54.443430 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5b180ac5-3b32-4f63-8333-559bb1fda66d tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:54.444283 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5b180ac5-3b32-4f63-8333-559bb1fda66d tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:54.444775 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5b180ac5-3b32-4f63-8333-559bb1fda66d tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:54.657079 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-5b180ac5-3b32-4f63-8333-559bb1fda66d tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:57:54.666686 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-5b180ac5-3b32-4f63-8333-559bb1fda66d tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75" status: 200 len: 1521 microversion: 2.1 time: 0.242130 Dec 16 14:57:54.667277 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 233/461] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:57:54 2021] GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75 => generated 1521 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:57:55.231202 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-f5a4e571-8115-485e-8b7e-1736dc66b1ec tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:57:55.232338 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-f5a4e571-8115-485e-8b7e-1736dc66b1ec tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:57:55.240900 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f5a4e571-8115-485e-8b7e-1736dc66b1ec tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:55.241930 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f5a4e571-8115-485e-8b7e-1736dc66b1ec tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:55.242817 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f5a4e571-8115-485e-8b7e-1736dc66b1ec tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:55.243314 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f5a4e571-8115-485e-8b7e-1736dc66b1ec tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:55.328020 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-ed269545-eae6-4d9f-b758-9c1ee99ed263 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:57:55.329335 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-ed269545-eae6-4d9f-b758-9c1ee99ed263 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:57:55.337350 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ed269545-eae6-4d9f-b758-9c1ee99ed263 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:55.337874 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ed269545-eae6-4d9f-b758-9c1ee99ed263 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:55.338762 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ed269545-eae6-4d9f-b758-9c1ee99ed263 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:55.339258 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ed269545-eae6-4d9f-b758-9c1ee99ed263 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:59.170511 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-f5a4e571-8115-485e-8b7e-1736dc66b1ec tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 28634 microversion: 2.1 time: 3.947275 Dec 16 14:57:59.172159 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 229/462] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:57:55 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 28634 bytes in 3949 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:57:59.181433 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-fc77aedd-b40f-4cca-86a0-83db11857665 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:57:59.186229 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-fc77aedd-b40f-4cca-86a0-83db11857665 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: 407dd6f1-6f0a-41ba-80e2-9ebe4630fa75] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:57:59.188974 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-ed269545-eae6-4d9f-b758-9c1ee99ed263 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 200 len: 28622 microversion: 2.20 time: 3.869107 Dec 16 14:57:59.189881 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 234/463] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:57:55 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 28622 bytes in 3871 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 16 14:57:59.190911 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fc77aedd-b40f-4cca-86a0-83db11857665 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:59.191428 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fc77aedd-b40f-4cca-86a0-83db11857665 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:59.192285 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fc77aedd-b40f-4cca-86a0-83db11857665 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:57:59.192776 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fc77aedd-b40f-4cca-86a0-83db11857665 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:57:59.421801 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-fc77aedd-b40f-4cca-86a0-83db11857665 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:57:59.431565 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-fc77aedd-b40f-4cca-86a0-83db11857665 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75" status: 200 len: 1521 microversion: 2.1 time: 0.258251 Dec 16 14:57:59.431565 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 230/464] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:57:59 2021] GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75 => generated 1521 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:58:00.187863 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-b468e190-8e97-4273-8d4c-eb475d36d397 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:58:00.189000 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-b468e190-8e97-4273-8d4c-eb475d36d397 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:00.198400 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b468e190-8e97-4273-8d4c-eb475d36d397 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:00.198999 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b468e190-8e97-4273-8d4c-eb475d36d397 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:00.200052 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b468e190-8e97-4273-8d4c-eb475d36d397 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:00.200550 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b468e190-8e97-4273-8d4c-eb475d36d397 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:00.205376 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-8b9c299f-c6a6-4682-8d95-1b8953613685 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:58:00.206446 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-8b9c299f-c6a6-4682-8d95-1b8953613685 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:00.216350 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8b9c299f-c6a6-4682-8d95-1b8953613685 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:00.216865 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8b9c299f-c6a6-4682-8d95-1b8953613685 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:00.217726 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8b9c299f-c6a6-4682-8d95-1b8953613685 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:00.219763 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8b9c299f-c6a6-4682-8d95-1b8953613685 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:00.361502 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-b468e190-8e97-4273-8d4c-eb475d36d397 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 28634 microversion: 2.1 time: 0.181973 Dec 16 14:58:00.362385 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 235/465] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:58:00 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 28634 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:58:00.443018 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-8b9c299f-c6a6-4682-8d95-1b8953613685 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 200 len: 28622 microversion: 2.20 time: 0.245190 Dec 16 14:58:00.443740 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 231/466] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:58:00 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 28622 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 16 14:58:00.453905 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-4ddd8adf-2ed3-4d5d-9966-7f48b0421592 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:58:00.454688 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-4ddd8adf-2ed3-4d5d-9966-7f48b0421592 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: 407dd6f1-6f0a-41ba-80e2-9ebe4630fa75] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:00.463811 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4ddd8adf-2ed3-4d5d-9966-7f48b0421592 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:00.464313 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4ddd8adf-2ed3-4d5d-9966-7f48b0421592 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:00.465155 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4ddd8adf-2ed3-4d5d-9966-7f48b0421592 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:00.465642 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4ddd8adf-2ed3-4d5d-9966-7f48b0421592 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:00.685598 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-4ddd8adf-2ed3-4d5d-9966-7f48b0421592 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:58:00.694517 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-4ddd8adf-2ed3-4d5d-9966-7f48b0421592 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75" status: 200 len: 1521 microversion: 2.1 time: 0.249408 Dec 16 14:58:00.695124 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 236/467] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:58:00 2021] GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75 => generated 1521 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:58:01.379837 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-94571273-22b0-4a68-8416-829fad99c4bc tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:58:01.380972 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-94571273-22b0-4a68-8416-829fad99c4bc tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:01.390288 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-94571273-22b0-4a68-8416-829fad99c4bc tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:01.390797 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-94571273-22b0-4a68-8416-829fad99c4bc tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:01.391631 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-94571273-22b0-4a68-8416-829fad99c4bc tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:01.392118 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-94571273-22b0-4a68-8416-829fad99c4bc tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:01.459996 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-0f3f3681-26e0-4220-a45a-735caf2abca0 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:58:01.460955 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-0f3f3681-26e0-4220-a45a-735caf2abca0 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:01.469181 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0f3f3681-26e0-4220-a45a-735caf2abca0 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:01.469685 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0f3f3681-26e0-4220-a45a-735caf2abca0 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:01.470536 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0f3f3681-26e0-4220-a45a-735caf2abca0 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:01.471027 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0f3f3681-26e0-4220-a45a-735caf2abca0 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:01.596923 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-94571273-22b0-4a68-8416-829fad99c4bc tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 28634 microversion: 2.1 time: 0.226428 Dec 16 14:58:01.597639 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 232/468] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:58:01 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 28634 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:58:01.627421 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-0f3f3681-26e0-4220-a45a-735caf2abca0 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 200 len: 28622 microversion: 2.20 time: 0.175286 Dec 16 14:58:01.628094 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 237/469] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:58:01 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 28622 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 16 14:58:01.717775 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-5db4badb-b226-4ef9-bc27-7d9c8fd6871e tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:58:01.718597 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-5db4badb-b226-4ef9-bc27-7d9c8fd6871e tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: 407dd6f1-6f0a-41ba-80e2-9ebe4630fa75] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:01.727436 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5db4badb-b226-4ef9-bc27-7d9c8fd6871e tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:01.727945 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5db4badb-b226-4ef9-bc27-7d9c8fd6871e tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:01.728787 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5db4badb-b226-4ef9-bc27-7d9c8fd6871e tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:01.729276 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5db4badb-b226-4ef9-bc27-7d9c8fd6871e tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:01.947794 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-5db4badb-b226-4ef9-bc27-7d9c8fd6871e tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:58:01.957233 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-5db4badb-b226-4ef9-bc27-7d9c8fd6871e tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75" status: 200 len: 1521 microversion: 2.1 time: 0.248028 Dec 16 14:58:01.958099 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 233/470] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:58:01 2021] GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75 => generated 1521 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:58:02.613549 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-518fbec5-e090-4049-949e-e008c8528fce tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:58:02.614763 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-518fbec5-e090-4049-949e-e008c8528fce tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:02.623336 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-518fbec5-e090-4049-949e-e008c8528fce tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:02.623845 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-518fbec5-e090-4049-949e-e008c8528fce tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:02.624688 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-518fbec5-e090-4049-949e-e008c8528fce tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:02.625184 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-518fbec5-e090-4049-949e-e008c8528fce tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:02.643813 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-970caa9c-2ec0-4fb2-8fc8-56901affc42a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:58:02.644859 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-970caa9c-2ec0-4fb2-8fc8-56901affc42a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:02.653415 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-970caa9c-2ec0-4fb2-8fc8-56901affc42a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:02.653925 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-970caa9c-2ec0-4fb2-8fc8-56901affc42a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:02.654803 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-970caa9c-2ec0-4fb2-8fc8-56901affc42a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:02.655295 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-970caa9c-2ec0-4fb2-8fc8-56901affc42a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:02.779657 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-518fbec5-e090-4049-949e-e008c8528fce tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 28634 microversion: 2.1 time: 0.173907 Dec 16 14:58:02.780363 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 238/471] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:58:02 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 28634 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:58:02.796712 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-970caa9c-2ec0-4fb2-8fc8-56901affc42a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 200 len: 28622 microversion: 2.20 time: 0.160287 Dec 16 14:58:02.797446 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 234/472] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:58:02 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 28622 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 16 14:58:02.984478 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-8a27b594-a853-47c7-995f-e9493493b3f7 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:58:02.985167 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-8a27b594-a853-47c7-995f-e9493493b3f7 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: 407dd6f1-6f0a-41ba-80e2-9ebe4630fa75] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:02.994203 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8a27b594-a853-47c7-995f-e9493493b3f7 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:02.994714 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8a27b594-a853-47c7-995f-e9493493b3f7 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:02.995556 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8a27b594-a853-47c7-995f-e9493493b3f7 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:02.996047 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8a27b594-a853-47c7-995f-e9493493b3f7 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:03.220232 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-8a27b594-a853-47c7-995f-e9493493b3f7 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:58:03.229622 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-8a27b594-a853-47c7-995f-e9493493b3f7 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75" status: 200 len: 1501 microversion: 2.1 time: 0.253833 Dec 16 14:58:03.230252 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 239/473] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:58:02 2021] GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75 => generated 1501 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:58:03.253004 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-832cfd12-70da-442d-a022-2850f030ddc0 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "30f08b3a-6110-4623-956d-8de070e4908b"}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:58:03.255143 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-832cfd12-70da-442d-a022-2850f030ddc0 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: 407dd6f1-6f0a-41ba-80e2-9ebe4630fa75] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:03.271213 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-832cfd12-70da-442d-a022-2850f030ddc0 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:03.271957 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-832cfd12-70da-442d-a022-2850f030ddc0 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:03.272817 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-832cfd12-70da-442d-a022-2850f030ddc0 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:03.273309 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-832cfd12-70da-442d-a022-2850f030ddc0 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:03.373308 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.wsgi [None req-832cfd12-70da-442d-a022-2850f030ddc0 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] HTTP exception thrown: Cannot 'attach_volume' instance 407dd6f1-6f0a-41ba-80e2-9ebe4630fa75 while it is in vm_state rescued Dec 16 14:58:03.374318 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-832cfd12-70da-442d-a022-2850f030ddc0 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Returning 409 to user: Cannot 'attach_volume' instance 407dd6f1-6f0a-41ba-80e2-9ebe4630fa75 while it is in vm_state rescued {{(pid=101355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:941}} Dec 16 14:58:03.375611 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-832cfd12-70da-442d-a022-2850f030ddc0 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "POST /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.131325 Dec 16 14:58:03.376352 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 235/474] 10.222.0.45 () {60 vars in 1313 bytes} [Thu Dec 16 14:58:03 2021] POST /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75/os-volume_attachments => generated 152 bytes in 133 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Dec 16 14:58:03.389939 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-fcf2cefd-7109-45fc-a966-b81a6c64a963 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:58:03.390564 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-fcf2cefd-7109-45fc-a966-b81a6c64a963 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: 407dd6f1-6f0a-41ba-80e2-9ebe4630fa75] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:03.406786 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fcf2cefd-7109-45fc-a966-b81a6c64a963 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:03.407711 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fcf2cefd-7109-45fc-a966-b81a6c64a963 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:03.409190 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fcf2cefd-7109-45fc-a966-b81a6c64a963 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:03.409798 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fcf2cefd-7109-45fc-a966-b81a6c64a963 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:03.672148 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-fcf2cefd-7109-45fc-a966-b81a6c64a963 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "POST /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75/action" status: 202 len: 0 microversion: 2.1 time: 0.290061 Dec 16 14:58:03.677200 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 240/475] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:58:03 2021] POST /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75/action => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:58:03.687041 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-cb263010-319c-44af-9f88-6d5617fccdab tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:58:03.687729 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-cb263010-319c-44af-9f88-6d5617fccdab tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: 407dd6f1-6f0a-41ba-80e2-9ebe4630fa75] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:03.697883 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cb263010-319c-44af-9f88-6d5617fccdab tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:03.698446 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cb263010-319c-44af-9f88-6d5617fccdab tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:03.699311 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cb263010-319c-44af-9f88-6d5617fccdab tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:03.699891 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cb263010-319c-44af-9f88-6d5617fccdab tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:03.796707 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-90c997b3-7478-45f8-b2af-332a3bdb9ea4 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:58:03.797999 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-90c997b3-7478-45f8-b2af-332a3bdb9ea4 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:03.806823 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-90c997b3-7478-45f8-b2af-332a3bdb9ea4 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:03.807327 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-90c997b3-7478-45f8-b2af-332a3bdb9ea4 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:03.808177 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-90c997b3-7478-45f8-b2af-332a3bdb9ea4 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:03.808666 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-90c997b3-7478-45f8-b2af-332a3bdb9ea4 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:03.986840 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-90c997b3-7478-45f8-b2af-332a3bdb9ea4 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 28634 microversion: 2.1 time: 0.199106 Dec 16 14:58:03.988125 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 241/476] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:58:03 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 28634 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 14:58:03.999699 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-0f7627be-89e9-430f-9742-0957a0e89980 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:58:04.001994 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-0f7627be-89e9-430f-9742-0957a0e89980 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:04.010813 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0f7627be-89e9-430f-9742-0957a0e89980 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:04.011472 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0f7627be-89e9-430f-9742-0957a0e89980 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:04.012575 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0f7627be-89e9-430f-9742-0957a0e89980 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:04.013069 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0f7627be-89e9-430f-9742-0957a0e89980 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:04.155559 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-0f7627be-89e9-430f-9742-0957a0e89980 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 200 len: 28622 microversion: 2.20 time: 0.164640 Dec 16 14:58:04.156936 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 242/477] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:58:03 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 28622 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:58:04.179911 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-cb263010-319c-44af-9f88-6d5617fccdab tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:58:04.191320 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-cb263010-319c-44af-9f88-6d5617fccdab tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75" status: 200 len: 1509 microversion: 2.1 time: 0.513139 Dec 16 14:58:04.192506 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 236/478] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:58:03 2021] GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75 => generated 1509 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:58:05.004421 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-f4ba3003-1aa2-4706-94e3-16190bbf41ce tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:58:05.006373 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-f4ba3003-1aa2-4706-94e3-16190bbf41ce tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:05.016245 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f4ba3003-1aa2-4706-94e3-16190bbf41ce tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:05.017130 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f4ba3003-1aa2-4706-94e3-16190bbf41ce tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:05.018094 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f4ba3003-1aa2-4706-94e3-16190bbf41ce tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:05.020210 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f4ba3003-1aa2-4706-94e3-16190bbf41ce tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:05.172107 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-a2b92780-c9f5-44bf-aa45-16c2bdb7a086 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:58:05.173075 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-a2b92780-c9f5-44bf-aa45-16c2bdb7a086 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:05.182086 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a2b92780-c9f5-44bf-aa45-16c2bdb7a086 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:05.182835 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a2b92780-c9f5-44bf-aa45-16c2bdb7a086 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:05.183695 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a2b92780-c9f5-44bf-aa45-16c2bdb7a086 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:05.184190 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a2b92780-c9f5-44bf-aa45-16c2bdb7a086 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:05.198710 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-f4ba3003-1aa2-4706-94e3-16190bbf41ce tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 28634 microversion: 2.1 time: 0.201713 Dec 16 14:58:05.200085 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 243/479] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:58:04 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 28634 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:58:05.216890 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-a3ff9b1a-5172-4f84-861f-5e5a8d7d839f tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:58:05.217964 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-a3ff9b1a-5172-4f84-861f-5e5a8d7d839f tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: 407dd6f1-6f0a-41ba-80e2-9ebe4630fa75] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:05.227275 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a3ff9b1a-5172-4f84-861f-5e5a8d7d839f tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:05.227790 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a3ff9b1a-5172-4f84-861f-5e5a8d7d839f tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:05.228646 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a3ff9b1a-5172-4f84-861f-5e5a8d7d839f tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:05.229140 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a3ff9b1a-5172-4f84-861f-5e5a8d7d839f tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:05.332174 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-a2b92780-c9f5-44bf-aa45-16c2bdb7a086 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 200 len: 28622 microversion: 2.20 time: 0.167902 Dec 16 14:58:05.337579 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 237/480] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:58:05 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 28622 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 16 14:58:05.468331 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-a3ff9b1a-5172-4f84-861f-5e5a8d7d839f tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:58:05.477833 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-a3ff9b1a-5172-4f84-861f-5e5a8d7d839f tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75" status: 200 len: 1509 microversion: 2.1 time: 0.271025 Dec 16 14:58:05.478457 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 244/481] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:58:05 2021] GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75 => generated 1509 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:58:06.216593 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-6cfe19fc-067a-4b39-9c0b-2ff9b8d2233f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:58:06.217640 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-6cfe19fc-067a-4b39-9c0b-2ff9b8d2233f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:06.226513 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6cfe19fc-067a-4b39-9c0b-2ff9b8d2233f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:06.227536 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6cfe19fc-067a-4b39-9c0b-2ff9b8d2233f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:06.228393 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6cfe19fc-067a-4b39-9c0b-2ff9b8d2233f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:06.228890 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6cfe19fc-067a-4b39-9c0b-2ff9b8d2233f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:06.353613 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-43ab2fdc-099f-4b78-b365-029dd29a9508 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:58:06.354735 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-43ab2fdc-099f-4b78-b365-029dd29a9508 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:06.364533 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-6cfe19fc-067a-4b39-9c0b-2ff9b8d2233f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 28634 microversion: 2.1 time: 0.156095 Dec 16 14:58:06.365324 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 238/482] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:58:06 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 28634 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:58:06.380343 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-43ab2fdc-099f-4b78-b365-029dd29a9508 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:06.381097 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-43ab2fdc-099f-4b78-b365-029dd29a9508 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:06.381885 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-43ab2fdc-099f-4b78-b365-029dd29a9508 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:06.382442 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-43ab2fdc-099f-4b78-b365-029dd29a9508 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:06.500715 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-71bfbea2-5ff8-44af-b7a3-04dd044edffe tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:58:06.501590 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-71bfbea2-5ff8-44af-b7a3-04dd044edffe tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: 407dd6f1-6f0a-41ba-80e2-9ebe4630fa75] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:06.510472 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-71bfbea2-5ff8-44af-b7a3-04dd044edffe tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:06.511068 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-71bfbea2-5ff8-44af-b7a3-04dd044edffe tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:06.512010 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-71bfbea2-5ff8-44af-b7a3-04dd044edffe tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:06.512616 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-71bfbea2-5ff8-44af-b7a3-04dd044edffe tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:06.608041 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-43ab2fdc-099f-4b78-b365-029dd29a9508 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 200 len: 28622 microversion: 2.20 time: 0.266028 Dec 16 14:58:06.610306 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 245/483] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:58:06 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 28622 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:58:06.737554 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-71bfbea2-5ff8-44af-b7a3-04dd044edffe tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:58:06.746787 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-71bfbea2-5ff8-44af-b7a3-04dd044edffe tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75" status: 200 len: 1509 microversion: 2.1 time: 0.254340 Dec 16 14:58:06.747384 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 239/484] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:58:06 2021] GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75 => generated 1509 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:58:07.381908 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-d713a972-924e-4495-80b0-44a0f24666c9 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:58:07.383855 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-d713a972-924e-4495-80b0-44a0f24666c9 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:07.392574 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d713a972-924e-4495-80b0-44a0f24666c9 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:07.402806 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d713a972-924e-4495-80b0-44a0f24666c9 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:07.402806 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d713a972-924e-4495-80b0-44a0f24666c9 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:07.402806 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d713a972-924e-4495-80b0-44a0f24666c9 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:07.601024 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-d713a972-924e-4495-80b0-44a0f24666c9 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 28634 microversion: 2.1 time: 0.227081 Dec 16 14:58:07.602254 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 246/485] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:58:07 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 28634 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:58:07.630209 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-0ebf91bb-39b7-4765-882d-8e32b1750360 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:58:07.631253 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-0ebf91bb-39b7-4765-882d-8e32b1750360 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:07.640345 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0ebf91bb-39b7-4765-882d-8e32b1750360 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:07.641540 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0ebf91bb-39b7-4765-882d-8e32b1750360 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:07.641791 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0ebf91bb-39b7-4765-882d-8e32b1750360 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:07.642386 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0ebf91bb-39b7-4765-882d-8e32b1750360 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:07.770774 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-90861b9d-98bc-42e0-9f61-8089ebeb7717 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:58:07.771457 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-90861b9d-98bc-42e0-9f61-8089ebeb7717 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: 407dd6f1-6f0a-41ba-80e2-9ebe4630fa75] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:07.780814 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-90861b9d-98bc-42e0-9f61-8089ebeb7717 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:07.781324 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-90861b9d-98bc-42e0-9f61-8089ebeb7717 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:07.786228 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-90861b9d-98bc-42e0-9f61-8089ebeb7717 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:07.786344 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-0ebf91bb-39b7-4765-882d-8e32b1750360 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 200 len: 28622 microversion: 2.20 time: 0.159689 Dec 16 14:58:07.786344 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 240/486] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:58:07 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 28622 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:58:07.786508 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-90861b9d-98bc-42e0-9f61-8089ebeb7717 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:08.029234 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-90861b9d-98bc-42e0-9f61-8089ebeb7717 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:58:08.038479 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-90861b9d-98bc-42e0-9f61-8089ebeb7717 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75" status: 200 len: 1509 microversion: 2.1 time: 0.277115 Dec 16 14:58:08.046261 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 247/487] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:58:07 2021] GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75 => generated 1509 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:58:08.620025 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-08579241-2bca-46b2-a11b-c085fb806c0e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:58:08.621799 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-08579241-2bca-46b2-a11b-c085fb806c0e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:08.633738 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-08579241-2bca-46b2-a11b-c085fb806c0e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:08.634508 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-08579241-2bca-46b2-a11b-c085fb806c0e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:08.635621 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-08579241-2bca-46b2-a11b-c085fb806c0e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:08.636193 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-08579241-2bca-46b2-a11b-c085fb806c0e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:08.795396 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-08579241-2bca-46b2-a11b-c085fb806c0e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 28634 microversion: 2.1 time: 0.183933 Dec 16 14:58:08.800321 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-9611ed4a-57ff-421a-88a7-c04da3217b55 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:58:08.800873 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-9611ed4a-57ff-421a-88a7-c04da3217b55 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:08.801093 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 241/488] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:58:08 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 28634 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:58:08.809145 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9611ed4a-57ff-421a-88a7-c04da3217b55 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:08.809658 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9611ed4a-57ff-421a-88a7-c04da3217b55 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:08.810530 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9611ed4a-57ff-421a-88a7-c04da3217b55 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:08.811025 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9611ed4a-57ff-421a-88a7-c04da3217b55 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:09.031282 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-9611ed4a-57ff-421a-88a7-c04da3217b55 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 200 len: 28622 microversion: 2.20 time: 0.239200 Dec 16 14:58:09.031984 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 248/489] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:58:08 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 28622 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 16 14:58:09.061981 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-d52b3ded-b24d-4142-af23-f2d35ccc59fa tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:58:09.062800 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-d52b3ded-b24d-4142-af23-f2d35ccc59fa tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: 407dd6f1-6f0a-41ba-80e2-9ebe4630fa75] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:09.072010 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d52b3ded-b24d-4142-af23-f2d35ccc59fa tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:09.072523 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d52b3ded-b24d-4142-af23-f2d35ccc59fa tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:09.073368 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d52b3ded-b24d-4142-af23-f2d35ccc59fa tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:09.073929 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d52b3ded-b24d-4142-af23-f2d35ccc59fa tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:09.484875 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-d52b3ded-b24d-4142-af23-f2d35ccc59fa tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:58:09.494342 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-d52b3ded-b24d-4142-af23-f2d35ccc59fa tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75" status: 200 len: 1509 microversion: 2.1 time: 0.441038 Dec 16 14:58:09.495018 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 242/490] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:58:09 2021] GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75 => generated 1509 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:58:09.814313 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-7127b174-d3aa-4240-b148-0675e7d0f7ab tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:58:09.815462 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-7127b174-d3aa-4240-b148-0675e7d0f7ab tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:09.824482 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7127b174-d3aa-4240-b148-0675e7d0f7ab tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:09.824990 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7127b174-d3aa-4240-b148-0675e7d0f7ab tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:09.825835 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7127b174-d3aa-4240-b148-0675e7d0f7ab tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:09.826363 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7127b174-d3aa-4240-b148-0675e7d0f7ab tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:09.965664 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-7127b174-d3aa-4240-b148-0675e7d0f7ab tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 28634 microversion: 2.1 time: 0.160885 Dec 16 14:58:09.966395 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 249/491] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:58:09 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 28634 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:58:10.047489 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-ccf48139-bc78-4264-805e-b3701b55d219 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:58:10.048520 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-ccf48139-bc78-4264-805e-b3701b55d219 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:10.056579 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ccf48139-bc78-4264-805e-b3701b55d219 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:10.059613 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ccf48139-bc78-4264-805e-b3701b55d219 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:10.061606 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ccf48139-bc78-4264-805e-b3701b55d219 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:10.062146 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ccf48139-bc78-4264-805e-b3701b55d219 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:10.223782 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-ccf48139-bc78-4264-805e-b3701b55d219 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 200 len: 28622 microversion: 2.20 time: 0.183839 Dec 16 14:58:10.224393 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 243/492] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:58:10 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 28622 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:58:10.516139 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-7e1b5d57-5827-47be-8e17-182010d7f22c tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:58:10.516802 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-7e1b5d57-5827-47be-8e17-182010d7f22c tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: 407dd6f1-6f0a-41ba-80e2-9ebe4630fa75] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:10.525858 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7e1b5d57-5827-47be-8e17-182010d7f22c tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:10.526402 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7e1b5d57-5827-47be-8e17-182010d7f22c tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:10.527238 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7e1b5d57-5827-47be-8e17-182010d7f22c tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:10.527773 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7e1b5d57-5827-47be-8e17-182010d7f22c tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:10.742816 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-7e1b5d57-5827-47be-8e17-182010d7f22c tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:58:10.751624 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-7e1b5d57-5827-47be-8e17-182010d7f22c tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75" status: 200 len: 1515 microversion: 2.1 time: 0.243642 Dec 16 14:58:10.752217 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 250/493] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:58:10 2021] GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75 => generated 1515 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:58:10.982322 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-1160c74f-7a96-4333-be02-29ab0730d0d2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:58:10.983456 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-1160c74f-7a96-4333-be02-29ab0730d0d2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:10.992227 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1160c74f-7a96-4333-be02-29ab0730d0d2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:10.992738 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1160c74f-7a96-4333-be02-29ab0730d0d2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:10.993575 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1160c74f-7a96-4333-be02-29ab0730d0d2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:10.994087 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1160c74f-7a96-4333-be02-29ab0730d0d2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:11.027456 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-4e17e2ca-f16c-49ed-9ad3-62bc2e2d7a7f tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1111652110", "imageRef": "9b00ff4e-db72-4324-820b-87a6bd73b055", "flavorRef": "452", "networks": [{"uuid": "51fa2478-044e-4ace-8255-2af8579457d9"}]}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:58:11.098307 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.network.neutron [None req-4e17e2ca-f16c-49ed-9ad3-62bc2e2d7a7f tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] validate_networks() for [('51fa2478-044e-4ace-8255-2af8579457d9', None, None, None)] {{(pid=101356) validate_networks /opt/stack/nova/nova/network/neutron.py:2383}} Dec 16 14:58:11.136674 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-1160c74f-7a96-4333-be02-29ab0730d0d2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 28634 microversion: 2.1 time: 0.163133 Dec 16 14:58:11.137487 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 244/494] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:58:10 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 28634 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:58:11.241633 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-c312f1c1-1518-4438-8914-08fc0f02ac9a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:58:11.243671 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-c312f1c1-1518-4438-8914-08fc0f02ac9a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:11.253938 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c312f1c1-1518-4438-8914-08fc0f02ac9a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:11.254582 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c312f1c1-1518-4438-8914-08fc0f02ac9a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:11.255704 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c312f1c1-1518-4438-8914-08fc0f02ac9a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:11.256477 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c312f1c1-1518-4438-8914-08fc0f02ac9a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:11.392625 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-c312f1c1-1518-4438-8914-08fc0f02ac9a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 200 len: 28622 microversion: 2.20 time: 0.159817 Dec 16 14:58:11.393445 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 245/495] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:58:11 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 28622 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 16 14:58:11.695509 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.virt.hardware [None req-4e17e2ca-f16c-49ed-9ad3-62bc2e2d7a7f tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Flavor limits 0:0:0 {{(pid=101356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:338}} Dec 16 14:58:11.695983 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.virt.hardware [None req-4e17e2ca-f16c-49ed-9ad3-62bc2e2d7a7f tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Image limits 0:0:0 {{(pid=101356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:342}} Dec 16 14:58:11.696530 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.virt.hardware [None req-4e17e2ca-f16c-49ed-9ad3-62bc2e2d7a7f tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Flavor pref 0:0:0 {{(pid=101356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:378}} Dec 16 14:58:11.696991 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.virt.hardware [None req-4e17e2ca-f16c-49ed-9ad3-62bc2e2d7a7f tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Image pref 0:0:0 {{(pid=101356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:382}} Dec 16 14:58:11.697452 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.virt.hardware [None req-4e17e2ca-f16c-49ed-9ad3-62bc2e2d7a7f tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=101356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:422}} Dec 16 14:58:11.706841 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4e17e2ca-f16c-49ed-9ad3-62bc2e2d7a7f tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:11.707349 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4e17e2ca-f16c-49ed-9ad3-62bc2e2d7a7f tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:11.708219 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4e17e2ca-f16c-49ed-9ad3-62bc2e2d7a7f tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:11.708708 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4e17e2ca-f16c-49ed-9ad3-62bc2e2d7a7f tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:11.728149 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.quota [None req-4e17e2ca-f16c-49ed-9ad3-62bc2e2d7a7f tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Getting quotas for project bb300a155af646228f7c0b155a5d63ac. Resources: {'ram', 'instances', 'cores'} {{(pid=101356) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 16 14:58:11.732409 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.quota [None req-4e17e2ca-f16c-49ed-9ad3-62bc2e2d7a7f tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Getting quotas for user b1ee0c9e767b4895b9e063b28ae947d8 and project bb300a155af646228f7c0b155a5d63ac. Resources: {'ram', 'instances', 'cores'} {{(pid=101356) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 16 14:58:11.743661 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-4e17e2ca-f16c-49ed-9ad3-62bc2e2d7a7f tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Going to run 1 instances... {{(pid=101356) _provision_instances /opt/stack/nova/nova/compute/api.py:1224}} Dec 16 14:58:11.746288 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-4e17e2ca-f16c-49ed-9ad3-62bc2e2d7a7f tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] [instance: 64774bdb-b85b-4d86-9110-0b37d9c15bed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9b00ff4e-db72-4324-820b-87a6bd73b055',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101356) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1616}} Dec 16 14:58:11.828692 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-4e17e2ca-f16c-49ed-9ad3-62bc2e2d7a7f tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.810551 Dec 16 14:58:11.829406 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 251/496] 10.222.0.45 () {60 vars in 1137 bytes} [Thu Dec 16 14:58:11 2021] POST /compute/v2.1/servers => generated 380 bytes in 812 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 16 14:58:11.844886 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-a4b86974-3593-4f1a-b1bb-4244154152b8 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:58:11.845750 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-a4b86974-3593-4f1a-b1bb-4244154152b8 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] [instance: 64774bdb-b85b-4d86-9110-0b37d9c15bed] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:11.936527 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-a4b86974-3593-4f1a-b1bb-4244154152b8 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ee0c9e767b4895b9e063b28ae947d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb300a155af646228f7c0b155a5d63ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:58:11.946203 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-a4b86974-3593-4f1a-b1bb-4244154152b8 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] 10.222.0.45 "GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed" status: 200 len: 1219 microversion: 2.1 time: 0.109860 Dec 16 14:58:11.946812 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 246/497] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:58:11 2021] GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed => generated 1219 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:58:12.152622 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-0ea24cde-56fb-43de-abf6-82af371caa3b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:58:12.154346 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-0ea24cde-56fb-43de-abf6-82af371caa3b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:12.162796 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0ea24cde-56fb-43de-abf6-82af371caa3b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:12.163386 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0ea24cde-56fb-43de-abf6-82af371caa3b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:12.164738 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0ea24cde-56fb-43de-abf6-82af371caa3b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:12.165239 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0ea24cde-56fb-43de-abf6-82af371caa3b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:12.303799 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-0ea24cde-56fb-43de-abf6-82af371caa3b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 28634 microversion: 2.1 time: 0.158543 Dec 16 14:58:12.304504 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 252/498] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:58:12 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 28634 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:58:12.408828 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-6825918d-7bd3-4704-ae35-21656beeb3c0 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:58:12.410008 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-6825918d-7bd3-4704-ae35-21656beeb3c0 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:12.420610 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6825918d-7bd3-4704-ae35-21656beeb3c0 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:12.421135 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6825918d-7bd3-4704-ae35-21656beeb3c0 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:12.421995 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6825918d-7bd3-4704-ae35-21656beeb3c0 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:12.422547 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6825918d-7bd3-4704-ae35-21656beeb3c0 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:12.554656 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-6825918d-7bd3-4704-ae35-21656beeb3c0 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 200 len: 28622 microversion: 2.20 time: 0.153190 Dec 16 14:58:12.555379 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 247/499] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:58:12 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 28622 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:58:12.969459 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-2b5db6b0-bccf-4981-af37-e7c4f802aa25 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:58:12.970254 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-2b5db6b0-bccf-4981-af37-e7c4f802aa25 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] [instance: 64774bdb-b85b-4d86-9110-0b37d9c15bed] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:12.978806 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2b5db6b0-bccf-4981-af37-e7c4f802aa25 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:12.979320 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2b5db6b0-bccf-4981-af37-e7c4f802aa25 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:12.980163 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2b5db6b0-bccf-4981-af37-e7c4f802aa25 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:12.980657 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2b5db6b0-bccf-4981-af37-e7c4f802aa25 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:13.110328 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-2b5db6b0-bccf-4981-af37-e7c4f802aa25 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ee0c9e767b4895b9e063b28ae947d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb300a155af646228f7c0b155a5d63ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:58:13.119235 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-2b5db6b0-bccf-4981-af37-e7c4f802aa25 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] 10.222.0.45 "GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed" status: 200 len: 1215 microversion: 2.1 time: 0.158557 Dec 16 14:58:13.119840 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 253/500] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:58:12 2021] GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed => generated 1215 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:58:13.321242 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-12f03d42-f31b-417f-aa3a-ba5f4e9d87a7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:58:13.322321 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-12f03d42-f31b-417f-aa3a-ba5f4e9d87a7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:13.331118 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-12f03d42-f31b-417f-aa3a-ba5f4e9d87a7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:13.331620 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-12f03d42-f31b-417f-aa3a-ba5f4e9d87a7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:13.332450 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-12f03d42-f31b-417f-aa3a-ba5f4e9d87a7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:13.332936 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-12f03d42-f31b-417f-aa3a-ba5f4e9d87a7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:13.568301 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-dd99621c-1255-417d-88f0-78a8d1346160 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:58:13.568969 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-dd99621c-1255-417d-88f0-78a8d1346160 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: 407dd6f1-6f0a-41ba-80e2-9ebe4630fa75] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:13.577445 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-dd99621c-1255-417d-88f0-78a8d1346160 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:13.577951 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-dd99621c-1255-417d-88f0-78a8d1346160 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:13.579071 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-dd99621c-1255-417d-88f0-78a8d1346160 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:13.579563 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-dd99621c-1255-417d-88f0-78a8d1346160 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:13.792607 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-dd99621c-1255-417d-88f0-78a8d1346160 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:58:13.801441 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-dd99621c-1255-417d-88f0-78a8d1346160 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75" status: 200 len: 1515 microversion: 2.1 time: 0.241057 Dec 16 14:58:13.802032 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 254/501] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:58:13 2021] GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75 => generated 1515 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:58:13.810850 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-38e05fcf-dd3e-465c-bb65-cb7c1f9ef5b8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:58:13.815338 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-38e05fcf-dd3e-465c-bb65-cb7c1f9ef5b8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:13.819702 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-38e05fcf-dd3e-465c-bb65-cb7c1f9ef5b8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:13.820202 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-38e05fcf-dd3e-465c-bb65-cb7c1f9ef5b8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:13.821030 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-38e05fcf-dd3e-465c-bb65-cb7c1f9ef5b8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:13.821512 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-38e05fcf-dd3e-465c-bb65-cb7c1f9ef5b8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:17.015640 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-38e05fcf-dd3e-465c-bb65-cb7c1f9ef5b8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 200 len: 28622 microversion: 2.20 time: 3.212189 Dec 16 14:58:17.016402 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 255/502] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:58:13 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 28622 bytes in 3214 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:58:17.025632 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-295c6e9d-6c74-4181-9fe6-51f02a708eee tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "40b9a675-f042-44be-8b73-5ae2d78124b6"}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:58:17.026918 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-295c6e9d-6c74-4181-9fe6-51f02a708eee tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: 407dd6f1-6f0a-41ba-80e2-9ebe4630fa75] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:17.031906 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-12f03d42-f31b-417f-aa3a-ba5f4e9d87a7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 28634 microversion: 2.1 time: 3.719394 Dec 16 14:58:17.032609 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 248/503] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:58:13 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 28634 bytes in 3721 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:58:17.035626 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-295c6e9d-6c74-4181-9fe6-51f02a708eee tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:17.036142 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-295c6e9d-6c74-4181-9fe6-51f02a708eee tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:17.036992 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-295c6e9d-6c74-4181-9fe6-51f02a708eee tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:17.037486 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-295c6e9d-6c74-4181-9fe6-51f02a708eee tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:17.041874 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-87e87aab-2f76-453d-8102-15206d904c61 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:58:17.042660 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-87e87aab-2f76-453d-8102-15206d904c61 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] [instance: 64774bdb-b85b-4d86-9110-0b37d9c15bed] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:17.051120 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-87e87aab-2f76-453d-8102-15206d904c61 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:17.051629 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-87e87aab-2f76-453d-8102-15206d904c61 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:17.052470 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-87e87aab-2f76-453d-8102-15206d904c61 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:17.052960 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-87e87aab-2f76-453d-8102-15206d904c61 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:17.180447 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-87e87aab-2f76-453d-8102-15206d904c61 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ee0c9e767b4895b9e063b28ae947d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb300a155af646228f7c0b155a5d63ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:58:17.189203 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-87e87aab-2f76-453d-8102-15206d904c61 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] 10.222.0.45 "GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed" status: 200 len: 1271 microversion: 2.1 time: 0.155070 Dec 16 14:58:17.189789 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 249/504] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:58:17 2021] GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed => generated 1271 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:58:17.723791 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-295c6e9d-6c74-4181-9fe6-51f02a708eee tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "POST /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.705826 Dec 16 14:58:17.724746 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 256/505] 10.222.0.45 () {60 vars in 1313 bytes} [Thu Dec 16 14:58:17 2021] POST /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75/os-volume_attachments => generated 194 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:58:18.031283 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-ec0d02d4-59d2-49fb-9438-0fe78a89faf6 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:58:18.032619 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-ec0d02d4-59d2-49fb-9438-0fe78a89faf6 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:18.049364 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-7c748baf-5a67-4b6c-9fb3-cabc0eeb1d07 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:58:18.050642 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-7c748baf-5a67-4b6c-9fb3-cabc0eeb1d07 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:18.057798 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ec0d02d4-59d2-49fb-9438-0fe78a89faf6 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:18.058336 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ec0d02d4-59d2-49fb-9438-0fe78a89faf6 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:18.059196 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ec0d02d4-59d2-49fb-9438-0fe78a89faf6 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:18.059683 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ec0d02d4-59d2-49fb-9438-0fe78a89faf6 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:18.073616 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7c748baf-5a67-4b6c-9fb3-cabc0eeb1d07 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:18.074747 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7c748baf-5a67-4b6c-9fb3-cabc0eeb1d07 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:18.076751 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7c748baf-5a67-4b6c-9fb3-cabc0eeb1d07 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:18.077469 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7c748baf-5a67-4b6c-9fb3-cabc0eeb1d07 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:18.544481 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-7c748baf-5a67-4b6c-9fb3-cabc0eeb1d07 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 28634 microversion: 2.1 time: 0.503778 Dec 16 14:58:18.545606 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 257/506] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:58:18 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 28634 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:58:18.557864 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-6d70941f-5355-4a9c-a9a0-4897071edad6 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:58:18.560876 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-6d70941f-5355-4a9c-a9a0-4897071edad6 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] [instance: 64774bdb-b85b-4d86-9110-0b37d9c15bed] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:18.566893 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6d70941f-5355-4a9c-a9a0-4897071edad6 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:18.567393 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6d70941f-5355-4a9c-a9a0-4897071edad6 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:18.568228 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6d70941f-5355-4a9c-a9a0-4897071edad6 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:18.568717 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6d70941f-5355-4a9c-a9a0-4897071edad6 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:18.583795 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-ec0d02d4-59d2-49fb-9438-0fe78a89faf6 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 200 len: 28622 microversion: 2.20 time: 0.560040 Dec 16 14:58:18.586628 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 250/507] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:58:18 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 28622 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:58:18.759279 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-4ff0bd2e-4372-47a5-8d20-c25afb93c7f9 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1151013441", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-476918611", "security_groups": [{"name": "tempest-secgroup-smoke-1408019117"}], "networks": [{"uuid": "8b4d9c94-6212-4d8c-9d94-8cb624826270"}], "block_device_mapping_v2": [{"uuid": "ab8fc914-1be2-4555-bef0-a72e187d67b2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:58:18.895848 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-6d70941f-5355-4a9c-a9a0-4897071edad6 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ee0c9e767b4895b9e063b28ae947d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb300a155af646228f7c0b155a5d63ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:58:18.896635 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-6d70941f-5355-4a9c-a9a0-4897071edad6 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] 10.222.0.45 "GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed" status: 200 len: 1319 microversion: 2.1 time: 0.346513 Dec 16 14:58:18.897121 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 258/508] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:58:18 2021] GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed => generated 1319 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:58:19.099920 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.network.neutron [None req-4ff0bd2e-4372-47a5-8d20-c25afb93c7f9 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] validate_networks() for [('8b4d9c94-6212-4d8c-9d94-8cb624826270', None, None, None)] {{(pid=101355) validate_networks /opt/stack/nova/nova/network/neutron.py:2383}} Dec 16 14:58:19.560829 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-b8a05ea4-5326-4313-ac70-e6bf8c1853c6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:58:19.561799 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-b8a05ea4-5326-4313-ac70-e6bf8c1853c6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:19.570230 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b8a05ea4-5326-4313-ac70-e6bf8c1853c6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:19.570741 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b8a05ea4-5326-4313-ac70-e6bf8c1853c6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:19.571586 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b8a05ea4-5326-4313-ac70-e6bf8c1853c6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:19.572079 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b8a05ea4-5326-4313-ac70-e6bf8c1853c6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:19.737316 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-b8a05ea4-5326-4313-ac70-e6bf8c1853c6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 28634 microversion: 2.1 time: 0.184114 Dec 16 14:58:19.738018 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 259/509] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:58:19 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 28634 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 14:58:19.747325 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-76ac6711-2ca8-483f-a8a1-7bd1ffa77967 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:58:19.748441 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-76ac6711-2ca8-483f-a8a1-7bd1ffa77967 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:19.756959 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-76ac6711-2ca8-483f-a8a1-7bd1ffa77967 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:19.757966 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-76ac6711-2ca8-483f-a8a1-7bd1ffa77967 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:19.758814 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-76ac6711-2ca8-483f-a8a1-7bd1ffa77967 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:19.759299 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-76ac6711-2ca8-483f-a8a1-7bd1ffa77967 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:19.897848 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-76ac6711-2ca8-483f-a8a1-7bd1ffa77967 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 200 len: 28622 microversion: 2.20 time: 0.157958 Dec 16 14:58:19.899476 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 260/510] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:58:19 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 28622 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:58:19.918719 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-0ae795ca-3377-4582-a5b0-fef42b95cba0 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:58:19.919688 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-0ae795ca-3377-4582-a5b0-fef42b95cba0 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] [instance: 64774bdb-b85b-4d86-9110-0b37d9c15bed] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:19.929377 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0ae795ca-3377-4582-a5b0-fef42b95cba0 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:19.930467 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0ae795ca-3377-4582-a5b0-fef42b95cba0 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:19.931319 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0ae795ca-3377-4582-a5b0-fef42b95cba0 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:19.931805 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0ae795ca-3377-4582-a5b0-fef42b95cba0 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:20.170842 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-0ae795ca-3377-4582-a5b0-fef42b95cba0 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ee0c9e767b4895b9e063b28ae947d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb300a155af646228f7c0b155a5d63ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:58:20.181488 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-0ae795ca-3377-4582-a5b0-fef42b95cba0 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] 10.222.0.45 "GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed" status: 200 len: 1319 microversion: 2.1 time: 0.270784 Dec 16 14:58:20.182653 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 261/511] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:58:19 2021] GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed => generated 1319 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:58:20.399641 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.virt.hardware [None req-4ff0bd2e-4372-47a5-8d20-c25afb93c7f9 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Flavor limits 0:0:0 {{(pid=101355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:338}} Dec 16 14:58:20.400321 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.virt.hardware [None req-4ff0bd2e-4372-47a5-8d20-c25afb93c7f9 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Image limits 0:0:0 {{(pid=101355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:342}} Dec 16 14:58:20.400869 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.virt.hardware [None req-4ff0bd2e-4372-47a5-8d20-c25afb93c7f9 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Flavor pref 0:0:0 {{(pid=101355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:378}} Dec 16 14:58:20.401473 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.virt.hardware [None req-4ff0bd2e-4372-47a5-8d20-c25afb93c7f9 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Image pref 0:0:0 {{(pid=101355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:382}} Dec 16 14:58:20.401939 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.virt.hardware [None req-4ff0bd2e-4372-47a5-8d20-c25afb93c7f9 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=101355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:422}} Dec 16 14:58:20.411526 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4ff0bd2e-4372-47a5-8d20-c25afb93c7f9 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:20.412187 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4ff0bd2e-4372-47a5-8d20-c25afb93c7f9 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:20.413123 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4ff0bd2e-4372-47a5-8d20-c25afb93c7f9 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:20.414274 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4ff0bd2e-4372-47a5-8d20-c25afb93c7f9 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:20.437772 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.quota [None req-4ff0bd2e-4372-47a5-8d20-c25afb93c7f9 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Getting quotas for project 482e5876a2f84b6ca5fc8e3537c2e971. Resources: {'ram', 'instances', 'cores'} {{(pid=101355) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 16 14:58:20.442259 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.quota [None req-4ff0bd2e-4372-47a5-8d20-c25afb93c7f9 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Getting quotas for user c2d92824869e49fca069e536bc80b2f2 and project 482e5876a2f84b6ca5fc8e3537c2e971. Resources: {'ram', 'instances', 'cores'} {{(pid=101355) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 16 14:58:20.556218 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-4ff0bd2e-4372-47a5-8d20-c25afb93c7f9 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Going to run 1 instances... {{(pid=101355) _provision_instances /opt/stack/nova/nova/compute/api.py:1224}} Dec 16 14:58:20.558802 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-4ff0bd2e-4372-47a5-8d20-c25afb93c7f9 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ab8fc914-1be2-4555-bef0-a72e187d67b2',volume_size=None,volume_type=None)] {{(pid=101355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1616}} Dec 16 14:58:20.761565 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [req-896abaa0-b0ea-470c-b3de-2e2eea947421 req-a16779c7-5a77-403e-aa3b-0f672ec41e17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64774bdb-b85b-4d86-9110-0b37d9c15bed", "tag": "75cb5458-4bda-45f2-b4d8-351b0e290d01"}]} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:58:20.766269 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:58:20.766269 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: warnings.warn(msg) Dec 16 14:58:20.776025 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-896abaa0-b0ea-470c-b3de-2e2eea947421 req-a16779c7-5a77-403e-aa3b-0f672ec41e17 service nova] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:20.776515 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-896abaa0-b0ea-470c-b3de-2e2eea947421 req-a16779c7-5a77-403e-aa3b-0f672ec41e17 service nova] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:20.794505 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.compute.server_external_events [req-896abaa0-b0ea-470c-b3de-2e2eea947421 req-a16779c7-5a77-403e-aa3b-0f672ec41e17 service nova] Creating event network-changed:75cb5458-4bda-45f2-b4d8-351b0e290d01 for instance 64774bdb-b85b-4d86-9110-0b37d9c15bed on hv-cinder-82189 Dec 16 14:58:20.799312 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [req-896abaa0-b0ea-470c-b3de-2e2eea947421 req-a16779c7-5a77-403e-aa3b-0f672ec41e17 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061680 Dec 16 14:58:20.799960 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 262/512] 10.222.0.45 () {64 vars in 1308 bytes} [Thu Dec 16 14:58:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:58:20.809297 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-30039897-a698-4dab-a056-4d342fc3a520 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:58:20.810430 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-30039897-a698-4dab-a056-4d342fc3a520 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:20.818321 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-30039897-a698-4dab-a056-4d342fc3a520 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:20.818824 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-30039897-a698-4dab-a056-4d342fc3a520 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:20.819656 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-30039897-a698-4dab-a056-4d342fc3a520 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:20.820174 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-30039897-a698-4dab-a056-4d342fc3a520 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:20.991933 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-30039897-a698-4dab-a056-4d342fc3a520 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 28634 microversion: 2.1 time: 0.190258 Dec 16 14:58:20.992554 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 263/513] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:58:20 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 28634 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:58:20.999832 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-4ff0bd2e-4372-47a5-8d20-c25afb93c7f9 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.251839 Dec 16 14:58:21.000893 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 251/514] 10.222.0.45 () {60 vars in 1137 bytes} [Thu Dec 16 14:58:18 2021] POST /compute/v2.1/servers => generated 406 bytes in 2254 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 16 14:58:21.002722 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-5b81ccbb-46ed-4358-ac9f-4799e577b74e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:58:21.003862 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-5b81ccbb-46ed-4358-ac9f-4799e577b74e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:21.012677 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5b81ccbb-46ed-4358-ac9f-4799e577b74e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:21.013417 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5b81ccbb-46ed-4358-ac9f-4799e577b74e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:21.014478 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5b81ccbb-46ed-4358-ac9f-4799e577b74e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:21.014952 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5b81ccbb-46ed-4358-ac9f-4799e577b74e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:21.015511 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-16b55a3a-eb60-47ea-bc39-8b9fb6bef9ce tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:58:21.016371 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-16b55a3a-eb60-47ea-bc39-8b9fb6bef9ce tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:21.149499 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-16b55a3a-eb60-47ea-bc39-8b9fb6bef9ce tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:58:21.159947 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-16b55a3a-eb60-47ea-bc39-8b9fb6bef9ce tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1088 microversion: 2.1 time: 0.152565 Dec 16 14:58:21.160734 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 252/515] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:58:21 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1088 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:58:21.176082 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-5b81ccbb-46ed-4358-ac9f-4799e577b74e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 200 len: 28622 microversion: 2.20 time: 0.181669 Dec 16 14:58:21.178078 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 264/516] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:58:20 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 28622 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:58:21.203579 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-90737979-2203-40d6-8d33-e8ca1f1e38df tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:58:21.205622 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-90737979-2203-40d6-8d33-e8ca1f1e38df tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] [instance: 64774bdb-b85b-4d86-9110-0b37d9c15bed] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:21.213471 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-90737979-2203-40d6-8d33-e8ca1f1e38df tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:21.213983 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-90737979-2203-40d6-8d33-e8ca1f1e38df tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:21.214866 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-90737979-2203-40d6-8d33-e8ca1f1e38df tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:21.215363 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-90737979-2203-40d6-8d33-e8ca1f1e38df tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:21.591074 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-90737979-2203-40d6-8d33-e8ca1f1e38df tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ee0c9e767b4895b9e063b28ae947d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb300a155af646228f7c0b155a5d63ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:58:21.600195 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-90737979-2203-40d6-8d33-e8ca1f1e38df tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] 10.222.0.45 "GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed" status: 200 len: 1319 microversion: 2.1 time: 0.405242 Dec 16 14:58:21.600806 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 253/517] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:58:21 2021] GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed => generated 1319 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:58:22.016436 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-fc534f44-a8ee-41ef-aa0b-7417051a1679 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:58:22.018109 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-fc534f44-a8ee-41ef-aa0b-7417051a1679 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:22.030757 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fc534f44-a8ee-41ef-aa0b-7417051a1679 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:22.036619 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fc534f44-a8ee-41ef-aa0b-7417051a1679 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:22.037893 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fc534f44-a8ee-41ef-aa0b-7417051a1679 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:22.038515 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fc534f44-a8ee-41ef-aa0b-7417051a1679 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:22.182007 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-797f8059-afe3-4637-b418-01b2f1d695b6 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:58:22.183005 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-797f8059-afe3-4637-b418-01b2f1d695b6 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:22.191686 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-797f8059-afe3-4637-b418-01b2f1d695b6 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:22.192209 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-797f8059-afe3-4637-b418-01b2f1d695b6 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:22.193148 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-797f8059-afe3-4637-b418-01b2f1d695b6 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:22.196007 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-797f8059-afe3-4637-b418-01b2f1d695b6 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:22.228879 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-fc534f44-a8ee-41ef-aa0b-7417051a1679 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 28634 microversion: 2.1 time: 0.227796 Dec 16 14:58:22.229492 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 265/518] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:58:21 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 28634 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:58:22.239991 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-03bbd03e-ee67-495e-bf0e-db5d7f6665cb tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:58:22.241109 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-03bbd03e-ee67-495e-bf0e-db5d7f6665cb tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:22.249929 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-03bbd03e-ee67-495e-bf0e-db5d7f6665cb tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:22.250740 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-03bbd03e-ee67-495e-bf0e-db5d7f6665cb tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:22.252367 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-03bbd03e-ee67-495e-bf0e-db5d7f6665cb tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:22.253329 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-03bbd03e-ee67-495e-bf0e-db5d7f6665cb tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:22.334510 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-797f8059-afe3-4637-b418-01b2f1d695b6 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:58:22.344568 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-797f8059-afe3-4637-b418-01b2f1d695b6 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1130 microversion: 2.1 time: 0.170241 Dec 16 14:58:22.345456 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 254/519] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:58:22 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1130 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:58:22.623074 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-04a5a768-9e96-43da-8250-b4e19d81b2b2 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:58:22.623748 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-04a5a768-9e96-43da-8250-b4e19d81b2b2 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] [instance: 64774bdb-b85b-4d86-9110-0b37d9c15bed] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:22.631632 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-04a5a768-9e96-43da-8250-b4e19d81b2b2 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:22.633227 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-04a5a768-9e96-43da-8250-b4e19d81b2b2 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:22.633227 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-04a5a768-9e96-43da-8250-b4e19d81b2b2 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:22.633538 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-04a5a768-9e96-43da-8250-b4e19d81b2b2 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:22.746958 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-03bbd03e-ee67-495e-bf0e-db5d7f6665cb tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 200 len: 28622 microversion: 2.20 time: 0.515415 Dec 16 14:58:22.748172 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 266/520] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:58:22 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 28622 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:58:22.853083 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-04a5a768-9e96-43da-8250-b4e19d81b2b2 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ee0c9e767b4895b9e063b28ae947d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb300a155af646228f7c0b155a5d63ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:58:22.861910 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-04a5a768-9e96-43da-8250-b4e19d81b2b2 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] 10.222.0.45 "GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed" status: 200 len: 1319 microversion: 2.1 time: 0.248073 Dec 16 14:58:22.862642 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 255/521] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:58:22 2021] GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed => generated 1319 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:58:23.246089 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-7fd552d0-a9ca-4793-a487-f2661dbf5209 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:58:23.247241 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-7fd552d0-a9ca-4793-a487-f2661dbf5209 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:23.255953 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7fd552d0-a9ca-4793-a487-f2661dbf5209 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:23.256524 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7fd552d0-a9ca-4793-a487-f2661dbf5209 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:23.257379 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7fd552d0-a9ca-4793-a487-f2661dbf5209 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:23.257876 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7fd552d0-a9ca-4793-a487-f2661dbf5209 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:23.366234 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-49b93d3a-ca3b-4ddd-bcc3-242352e91e7b tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:58:23.366982 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-49b93d3a-ca3b-4ddd-bcc3-242352e91e7b tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:23.374985 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-49b93d3a-ca3b-4ddd-bcc3-242352e91e7b tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:23.380185 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-49b93d3a-ca3b-4ddd-bcc3-242352e91e7b tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:23.380185 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-49b93d3a-ca3b-4ddd-bcc3-242352e91e7b tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:23.380185 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-49b93d3a-ca3b-4ddd-bcc3-242352e91e7b tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:23.525476 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-49b93d3a-ca3b-4ddd-bcc3-242352e91e7b tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:58:23.537180 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-7fd552d0-a9ca-4793-a487-f2661dbf5209 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 28634 microversion: 2.1 time: 0.299430 Dec 16 14:58:23.541685 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 267/522] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:58:23 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 28634 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:58:23.550736 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-49b93d3a-ca3b-4ddd-bcc3-242352e91e7b tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1204 microversion: 2.1 time: 0.190120 Dec 16 14:58:23.554959 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 256/523] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:58:23 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1204 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:58:23.764999 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-e56f171b-87c6-41fe-8bb4-0d2621c581b1 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:58:23.766455 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-e56f171b-87c6-41fe-8bb4-0d2621c581b1 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:23.775636 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e56f171b-87c6-41fe-8bb4-0d2621c581b1 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:23.776139 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e56f171b-87c6-41fe-8bb4-0d2621c581b1 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:23.776984 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e56f171b-87c6-41fe-8bb4-0d2621c581b1 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:23.777714 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e56f171b-87c6-41fe-8bb4-0d2621c581b1 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:23.884187 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-72a4992e-031d-4d8d-8f3d-32888caa66ff tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:58:23.884863 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-72a4992e-031d-4d8d-8f3d-32888caa66ff tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] [instance: 64774bdb-b85b-4d86-9110-0b37d9c15bed] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:23.893626 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-72a4992e-031d-4d8d-8f3d-32888caa66ff tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:23.894364 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-72a4992e-031d-4d8d-8f3d-32888caa66ff tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:23.895219 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-72a4992e-031d-4d8d-8f3d-32888caa66ff tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:23.895719 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-72a4992e-031d-4d8d-8f3d-32888caa66ff tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:23.990377 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-e56f171b-87c6-41fe-8bb4-0d2621c581b1 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 200 len: 28622 microversion: 2.20 time: 0.234586 Dec 16 14:58:23.991283 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 268/524] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:58:23 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 28622 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:58:24.267341 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-72a4992e-031d-4d8d-8f3d-32888caa66ff tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ee0c9e767b4895b9e063b28ae947d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb300a155af646228f7c0b155a5d63ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:58:24.276500 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-72a4992e-031d-4d8d-8f3d-32888caa66ff tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] 10.222.0.45 "GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed" status: 200 len: 1319 microversion: 2.1 time: 0.400485 Dec 16 14:58:24.277095 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 257/525] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:58:23 2021] GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed => generated 1319 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:58:24.555047 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-252c5b2a-41d9-4c8c-a1e0-127d58b856b5 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:58:24.556208 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-252c5b2a-41d9-4c8c-a1e0-127d58b856b5 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:24.574212 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-ea001b64-4091-4eb6-a9e0-32a4d6baa7ae tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:58:24.575086 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-ea001b64-4091-4eb6-a9e0-32a4d6baa7ae tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:24.594842 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-252c5b2a-41d9-4c8c-a1e0-127d58b856b5 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:24.595272 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-252c5b2a-41d9-4c8c-a1e0-127d58b856b5 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:24.596178 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-252c5b2a-41d9-4c8c-a1e0-127d58b856b5 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:24.596672 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-252c5b2a-41d9-4c8c-a1e0-127d58b856b5 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:24.600094 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ea001b64-4091-4eb6-a9e0-32a4d6baa7ae tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:24.600821 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ea001b64-4091-4eb6-a9e0-32a4d6baa7ae tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:24.602895 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ea001b64-4091-4eb6-a9e0-32a4d6baa7ae tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:24.603594 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ea001b64-4091-4eb6-a9e0-32a4d6baa7ae tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:24.952440 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-252c5b2a-41d9-4c8c-a1e0-127d58b856b5 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 28634 microversion: 2.1 time: 0.401952 Dec 16 14:58:24.952575 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 269/526] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:58:24 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 28634 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:58:25.017404 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-2f4a219f-a8e9-4530-a441-7b8c60e56140 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:58:25.019662 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-2f4a219f-a8e9-4530-a441-7b8c60e56140 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:25.032684 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2f4a219f-a8e9-4530-a441-7b8c60e56140 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:25.033957 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2f4a219f-a8e9-4530-a441-7b8c60e56140 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:25.035328 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2f4a219f-a8e9-4530-a441-7b8c60e56140 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:25.036115 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2f4a219f-a8e9-4530-a441-7b8c60e56140 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:25.099191 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-ea001b64-4091-4eb6-a9e0-32a4d6baa7ae tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:58:25.110807 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-ea001b64-4091-4eb6-a9e0-32a4d6baa7ae tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1272 microversion: 2.1 time: 0.544905 Dec 16 14:58:25.111698 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 258/527] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:58:24 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1272 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:58:25.215745 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-2f4a219f-a8e9-4530-a441-7b8c60e56140 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 200 len: 28622 microversion: 2.20 time: 0.213612 Dec 16 14:58:25.216508 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 270/528] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:58:25 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 28622 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:58:25.298782 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-10071ebb-9faa-4780-820b-498e95be3993 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:58:25.299429 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-10071ebb-9faa-4780-820b-498e95be3993 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] [instance: 64774bdb-b85b-4d86-9110-0b37d9c15bed] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:25.311866 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-10071ebb-9faa-4780-820b-498e95be3993 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:25.312370 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-10071ebb-9faa-4780-820b-498e95be3993 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:25.313208 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-10071ebb-9faa-4780-820b-498e95be3993 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:25.313896 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-10071ebb-9faa-4780-820b-498e95be3993 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:25.636185 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-10071ebb-9faa-4780-820b-498e95be3993 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ee0c9e767b4895b9e063b28ae947d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb300a155af646228f7c0b155a5d63ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:58:25.644952 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-10071ebb-9faa-4780-820b-498e95be3993 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] 10.222.0.45 "GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed" status: 200 len: 1319 microversion: 2.1 time: 0.353795 Dec 16 14:58:25.645542 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 259/529] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:58:25 2021] GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed => generated 1319 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:58:25.972504 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-2329573f-f2df-418b-8101-a71373ed9324 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:58:25.973660 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-2329573f-f2df-418b-8101-a71373ed9324 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:25.999871 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2329573f-f2df-418b-8101-a71373ed9324 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:26.000405 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2329573f-f2df-418b-8101-a71373ed9324 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:26.002274 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2329573f-f2df-418b-8101-a71373ed9324 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:26.002782 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2329573f-f2df-418b-8101-a71373ed9324 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:26.084257 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-db20d2d1-36a0-4f12-b7fa-7680faf2b3dd tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:58:26.090887 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-db20d2d1-36a0-4f12-b7fa-7680faf2b3dd tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: 407dd6f1-6f0a-41ba-80e2-9ebe4630fa75] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:26.100829 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-db20d2d1-36a0-4f12-b7fa-7680faf2b3dd tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:26.101379 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-db20d2d1-36a0-4f12-b7fa-7680faf2b3dd tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:26.107211 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-db20d2d1-36a0-4f12-b7fa-7680faf2b3dd tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:26.107790 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-db20d2d1-36a0-4f12-b7fa-7680faf2b3dd tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:26.234516 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-2329573f-f2df-418b-8101-a71373ed9324 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 28634 microversion: 2.1 time: 0.273926 Dec 16 14:58:26.236618 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 271/530] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:58:25 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 28634 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:58:26.246929 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-4c636dad-7cd2-401a-9ce0-e8370fed55cd tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:58:26.247859 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-4c636dad-7cd2-401a-9ce0-e8370fed55cd tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:26.256478 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4c636dad-7cd2-401a-9ce0-e8370fed55cd tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:26.257783 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4c636dad-7cd2-401a-9ce0-e8370fed55cd tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:26.258912 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4c636dad-7cd2-401a-9ce0-e8370fed55cd tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:26.259585 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4c636dad-7cd2-401a-9ce0-e8370fed55cd tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:26.595321 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-4c636dad-7cd2-401a-9ce0-e8370fed55cd tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:58:26.605114 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-4c636dad-7cd2-401a-9ce0-e8370fed55cd tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1272 microversion: 2.1 time: 0.367023 Dec 16 14:58:26.607816 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 272/531] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:58:26 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1272 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:58:26.623355 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-50592749-e0f8-495f-a456-dd95055c5008 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:58:26.624375 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-db20d2d1-36a0-4f12-b7fa-7680faf2b3dd tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "POST /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75/action" status: 200 len: 32 microversion: 2.1 time: 0.547384 Dec 16 14:58:26.624518 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-50592749-e0f8-495f-a456-dd95055c5008 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:26.625701 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 260/532] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:58:26 2021] POST /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75/action => generated 32 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 14:58:26.633116 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-50592749-e0f8-495f-a456-dd95055c5008 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:26.647257 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [req-e56f0a63-3fda-4aa5-94f1-baba70ce65f5 req-ffd6a9d1-0659-4c3e-bae2-79e016a51827 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60bfc41e-721c-45aa-a6fb-93f9213cf050", "tag": "2a20087b-09a5-411d-bbb0-eb5a2ee789c2"}]} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:58:26.648010 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-50592749-e0f8-495f-a456-dd95055c5008 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:26.648958 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-50592749-e0f8-495f-a456-dd95055c5008 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:26.649469 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-50592749-e0f8-495f-a456-dd95055c5008 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:26.652991 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:58:26.652991 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: warnings.warn(msg) Dec 16 14:58:26.664110 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-e56f0a63-3fda-4aa5-94f1-baba70ce65f5 req-ffd6a9d1-0659-4c3e-bae2-79e016a51827 service nova] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:26.664958 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-e56f0a63-3fda-4aa5-94f1-baba70ce65f5 req-ffd6a9d1-0659-4c3e-bae2-79e016a51827 service nova] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:26.685889 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.compute.server_external_events [req-e56f0a63-3fda-4aa5-94f1-baba70ce65f5 req-ffd6a9d1-0659-4c3e-bae2-79e016a51827 service nova] Creating event network-changed:2a20087b-09a5-411d-bbb0-eb5a2ee789c2 for instance 60bfc41e-721c-45aa-a6fb-93f9213cf050 on hv-cinder-82189 Dec 16 14:58:26.691351 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [req-e56f0a63-3fda-4aa5-94f1-baba70ce65f5 req-ffd6a9d1-0659-4c3e-bae2-79e016a51827 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063984 Dec 16 14:58:26.692305 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 261/533] 10.222.0.45 () {64 vars in 1308 bytes} [Thu Dec 16 14:58:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:58:26.703682 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-585d3812-9222-4521-931e-1a582a56834d tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:58:26.704537 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-585d3812-9222-4521-931e-1a582a56834d tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: 407dd6f1-6f0a-41ba-80e2-9ebe4630fa75] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:26.715036 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-585d3812-9222-4521-931e-1a582a56834d tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:26.715724 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-585d3812-9222-4521-931e-1a582a56834d tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:26.717142 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-585d3812-9222-4521-931e-1a582a56834d tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:26.717715 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-585d3812-9222-4521-931e-1a582a56834d tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:26.827580 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-50592749-e0f8-495f-a456-dd95055c5008 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 200 len: 28622 microversion: 2.20 time: 0.217924 Dec 16 14:58:26.828726 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 273/534] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:58:26 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 28622 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:58:26.839183 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-a891a460-fdcb-4a33-9eb0-f06f0efa8d0e tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:58:26.840065 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-a891a460-fdcb-4a33-9eb0-f06f0efa8d0e tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] [instance: 64774bdb-b85b-4d86-9110-0b37d9c15bed] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:26.848821 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a891a460-fdcb-4a33-9eb0-f06f0efa8d0e tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:26.849433 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a891a460-fdcb-4a33-9eb0-f06f0efa8d0e tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:26.850480 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a891a460-fdcb-4a33-9eb0-f06f0efa8d0e tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:26.851689 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a891a460-fdcb-4a33-9eb0-f06f0efa8d0e tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:27.092656 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-a891a460-fdcb-4a33-9eb0-f06f0efa8d0e tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ee0c9e767b4895b9e063b28ae947d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb300a155af646228f7c0b155a5d63ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:58:27.102838 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-a891a460-fdcb-4a33-9eb0-f06f0efa8d0e tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] 10.222.0.45 "GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed" status: 200 len: 1319 microversion: 2.1 time: 0.272284 Dec 16 14:58:27.104031 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 274/535] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:58:26 2021] GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed => generated 1319 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:58:27.251472 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-8b7cbe88-6e9e-449a-b639-9ffc9722cfa2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:58:27.253113 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-8b7cbe88-6e9e-449a-b639-9ffc9722cfa2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:27.262079 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8b7cbe88-6e9e-449a-b639-9ffc9722cfa2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:27.262469 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8b7cbe88-6e9e-449a-b639-9ffc9722cfa2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:27.263382 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8b7cbe88-6e9e-449a-b639-9ffc9722cfa2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:27.264184 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8b7cbe88-6e9e-449a-b639-9ffc9722cfa2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:27.306808 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-585d3812-9222-4521-931e-1a582a56834d tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:58:27.318802 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-585d3812-9222-4521-931e-1a582a56834d tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75" status: 200 len: 1567 microversion: 2.1 time: 0.625159 Dec 16 14:58:27.322344 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 262/536] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:58:26 2021] GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75 => generated 1567 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:58:27.478553 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-8b7cbe88-6e9e-449a-b639-9ffc9722cfa2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 28634 microversion: 2.1 time: 0.234359 Dec 16 14:58:27.480250 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 275/537] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:58:27 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 28634 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 14:58:27.627078 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-e5ab585e-b022-4c89-a92d-a7b9aa9df13d tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:58:27.627989 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-e5ab585e-b022-4c89-a92d-a7b9aa9df13d tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:27.636536 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e5ab585e-b022-4c89-a92d-a7b9aa9df13d tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:27.637045 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e5ab585e-b022-4c89-a92d-a7b9aa9df13d tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:27.637895 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e5ab585e-b022-4c89-a92d-a7b9aa9df13d tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:27.638427 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e5ab585e-b022-4c89-a92d-a7b9aa9df13d tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:27.845868 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-1fbc9de0-71e9-4dad-a2bf-e841cfbff481 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:58:27.849973 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-1fbc9de0-71e9-4dad-a2bf-e841cfbff481 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:27.859961 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1fbc9de0-71e9-4dad-a2bf-e841cfbff481 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:27.860578 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1fbc9de0-71e9-4dad-a2bf-e841cfbff481 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:27.861408 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1fbc9de0-71e9-4dad-a2bf-e841cfbff481 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:27.861897 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1fbc9de0-71e9-4dad-a2bf-e841cfbff481 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:28.325810 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-1fbc9de0-71e9-4dad-a2bf-e841cfbff481 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 200 len: 28622 microversion: 2.20 time: 0.488175 Dec 16 14:58:28.331404 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 276/538] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:58:27 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 28622 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:58:28.346589 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-f9baede6-7a0c-43e0-a54e-b2cc3dd14145 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:58:28.347630 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-f9baede6-7a0c-43e0-a54e-b2cc3dd14145 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] [instance: 64774bdb-b85b-4d86-9110-0b37d9c15bed] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:28.359818 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f9baede6-7a0c-43e0-a54e-b2cc3dd14145 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:28.360548 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f9baede6-7a0c-43e0-a54e-b2cc3dd14145 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:28.361557 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f9baede6-7a0c-43e0-a54e-b2cc3dd14145 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:28.362253 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f9baede6-7a0c-43e0-a54e-b2cc3dd14145 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:28.511263 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-e5ab585e-b022-4c89-a92d-a7b9aa9df13d tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:58:28.520931 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-e5ab585e-b022-4c89-a92d-a7b9aa9df13d tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1260 microversion: 2.1 time: 0.901474 Dec 16 14:58:28.522366 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 263/539] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:58:27 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1260 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:58:28.543289 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-79f558b7-e21f-488a-b471-22c4df574a78 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:58:28.543472 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-79f558b7-e21f-488a-b471-22c4df574a78 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: 407dd6f1-6f0a-41ba-80e2-9ebe4630fa75] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:28.551627 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-79f558b7-e21f-488a-b471-22c4df574a78 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:28.552133 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-79f558b7-e21f-488a-b471-22c4df574a78 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:28.552981 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-79f558b7-e21f-488a-b471-22c4df574a78 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:28.553557 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-79f558b7-e21f-488a-b471-22c4df574a78 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:28.619127 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-f9baede6-7a0c-43e0-a54e-b2cc3dd14145 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ee0c9e767b4895b9e063b28ae947d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb300a155af646228f7c0b155a5d63ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:58:28.629020 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-f9baede6-7a0c-43e0-a54e-b2cc3dd14145 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] 10.222.0.45 "GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed" status: 200 len: 1319 microversion: 2.1 time: 0.295404 Dec 16 14:58:28.639980 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 277/540] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:58:28 2021] GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed => generated 1319 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:58:28.639980 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-7da7673e-91e3-4530-9823-1ab707a722a6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:58:28.641216 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-7da7673e-91e3-4530-9823-1ab707a722a6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:28.650598 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7da7673e-91e3-4530-9823-1ab707a722a6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:28.651347 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7da7673e-91e3-4530-9823-1ab707a722a6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:28.652745 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7da7673e-91e3-4530-9823-1ab707a722a6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:28.653382 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7da7673e-91e3-4530-9823-1ab707a722a6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:28.880477 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-7da7673e-91e3-4530-9823-1ab707a722a6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 28634 microversion: 2.1 time: 0.249023 Dec 16 14:58:28.885121 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 278/541] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:58:28 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 28634 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:58:28.926355 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-79f558b7-e21f-488a-b471-22c4df574a78 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:58:28.936356 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-79f558b7-e21f-488a-b471-22c4df574a78 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75" status: 200 len: 1567 microversion: 2.1 time: 0.402070 Dec 16 14:58:28.937052 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 264/542] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:58:28 2021] GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75 => generated 1567 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:58:29.343928 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-4fce6827-d563-43d8-b919-120984382ced tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:58:29.345372 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-4fce6827-d563-43d8-b919-120984382ced tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:29.354574 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4fce6827-d563-43d8-b919-120984382ced tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:29.355073 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4fce6827-d563-43d8-b919-120984382ced tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:29.355914 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4fce6827-d563-43d8-b919-120984382ced tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:29.356403 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4fce6827-d563-43d8-b919-120984382ced tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:29.544760 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-fad9c9e9-4bb4-4dc2-bda3-23b589fcd6c6 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:58:29.545541 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-fad9c9e9-4bb4-4dc2-bda3-23b589fcd6c6 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:29.553437 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fad9c9e9-4bb4-4dc2-bda3-23b589fcd6c6 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:29.554598 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fad9c9e9-4bb4-4dc2-bda3-23b589fcd6c6 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:29.555443 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fad9c9e9-4bb4-4dc2-bda3-23b589fcd6c6 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:29.555930 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fad9c9e9-4bb4-4dc2-bda3-23b589fcd6c6 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:29.595648 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-4fce6827-d563-43d8-b919-120984382ced tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 200 len: 28622 microversion: 2.20 time: 0.259766 Dec 16 14:58:29.600140 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 279/543] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:58:29 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 28622 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:58:29.652744 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-92145995-8a68-4358-824a-d7e8e0fff02e tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:58:29.653751 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-92145995-8a68-4358-824a-d7e8e0fff02e tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] [instance: 64774bdb-b85b-4d86-9110-0b37d9c15bed] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:29.662476 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-92145995-8a68-4358-824a-d7e8e0fff02e tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:29.662992 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-92145995-8a68-4358-824a-d7e8e0fff02e tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:29.664357 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-92145995-8a68-4358-824a-d7e8e0fff02e tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:29.664851 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-92145995-8a68-4358-824a-d7e8e0fff02e tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:29.787441 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-fad9c9e9-4bb4-4dc2-bda3-23b589fcd6c6 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:58:29.797088 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-fad9c9e9-4bb4-4dc2-bda3-23b589fcd6c6 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1260 microversion: 2.1 time: 0.260514 Dec 16 14:58:29.797696 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 265/544] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:58:29 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1260 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:58:29.900088 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-21a91b1d-e9c4-483d-a0de-fb8c5d5c3f0e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:58:29.901067 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-21a91b1d-e9c4-483d-a0de-fb8c5d5c3f0e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:29.908957 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-21a91b1d-e9c4-483d-a0de-fb8c5d5c3f0e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:29.909431 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-21a91b1d-e9c4-483d-a0de-fb8c5d5c3f0e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:29.910315 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-21a91b1d-e9c4-483d-a0de-fb8c5d5c3f0e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:29.910811 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-21a91b1d-e9c4-483d-a0de-fb8c5d5c3f0e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:29.925967 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-92145995-8a68-4358-824a-d7e8e0fff02e tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ee0c9e767b4895b9e063b28ae947d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb300a155af646228f7c0b155a5d63ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:58:29.935684 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-92145995-8a68-4358-824a-d7e8e0fff02e tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] 10.222.0.45 "GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed" status: 200 len: 1319 microversion: 2.1 time: 0.292511 Dec 16 14:58:29.945738 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 280/545] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:58:29 2021] GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed => generated 1319 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:58:29.959458 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-7fd7ca46-3e8e-4635-8a3f-0c0dd1a92799 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:58:29.960817 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-7fd7ca46-3e8e-4635-8a3f-0c0dd1a92799 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: 407dd6f1-6f0a-41ba-80e2-9ebe4630fa75] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:29.968535 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7fd7ca46-3e8e-4635-8a3f-0c0dd1a92799 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:29.969042 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7fd7ca46-3e8e-4635-8a3f-0c0dd1a92799 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:29.969887 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7fd7ca46-3e8e-4635-8a3f-0c0dd1a92799 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:29.970411 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7fd7ca46-3e8e-4635-8a3f-0c0dd1a92799 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:30.199253 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-21a91b1d-e9c4-483d-a0de-fb8c5d5c3f0e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 28634 microversion: 2.1 time: 0.307275 Dec 16 14:58:30.200273 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 266/546] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:58:29 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 28634 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:58:30.321029 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-7fd7ca46-3e8e-4635-8a3f-0c0dd1a92799 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:58:30.330650 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-7fd7ca46-3e8e-4635-8a3f-0c0dd1a92799 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75" status: 200 len: 1567 microversion: 2.1 time: 0.379040 Dec 16 14:58:30.331244 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 281/547] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:58:29 2021] GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75 => generated 1567 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:58:30.612667 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-99e9c2b8-0472-4b11-8caa-a5f79ef1b352 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:58:30.613798 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-99e9c2b8-0472-4b11-8caa-a5f79ef1b352 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:30.624345 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-99e9c2b8-0472-4b11-8caa-a5f79ef1b352 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:30.624852 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-99e9c2b8-0472-4b11-8caa-a5f79ef1b352 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:30.625691 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-99e9c2b8-0472-4b11-8caa-a5f79ef1b352 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:30.626216 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-99e9c2b8-0472-4b11-8caa-a5f79ef1b352 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:30.759715 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-99e9c2b8-0472-4b11-8caa-a5f79ef1b352 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 200 len: 28622 microversion: 2.20 time: 0.155016 Dec 16 14:58:30.764430 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 267/548] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:58:30 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 28622 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:58:30.818388 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-9edaeef2-49cf-4d53-a121-0e2964616a99 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:58:30.819067 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-9edaeef2-49cf-4d53-a121-0e2964616a99 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:30.827940 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9edaeef2-49cf-4d53-a121-0e2964616a99 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:30.828710 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9edaeef2-49cf-4d53-a121-0e2964616a99 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:30.829553 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9edaeef2-49cf-4d53-a121-0e2964616a99 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:30.830071 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9edaeef2-49cf-4d53-a121-0e2964616a99 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:30.958257 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-b9ba8e02-8108-49a8-9303-67f0786674d4 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:58:30.959399 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-b9ba8e02-8108-49a8-9303-67f0786674d4 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] [instance: 64774bdb-b85b-4d86-9110-0b37d9c15bed] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:30.969332 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b9ba8e02-8108-49a8-9303-67f0786674d4 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:30.970061 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b9ba8e02-8108-49a8-9303-67f0786674d4 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:30.971094 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b9ba8e02-8108-49a8-9303-67f0786674d4 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:30.971790 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b9ba8e02-8108-49a8-9303-67f0786674d4 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:31.050553 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-9edaeef2-49cf-4d53-a121-0e2964616a99 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:58:31.059886 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-9edaeef2-49cf-4d53-a121-0e2964616a99 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1260 microversion: 2.1 time: 0.249206 Dec 16 14:58:31.060644 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 282/549] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:58:30 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1260 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:58:31.193201 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-b9ba8e02-8108-49a8-9303-67f0786674d4 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ee0c9e767b4895b9e063b28ae947d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb300a155af646228f7c0b155a5d63ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:58:31.202561 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-b9ba8e02-8108-49a8-9303-67f0786674d4 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] 10.222.0.45 "GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed" status: 200 len: 1319 microversion: 2.1 time: 0.252653 Dec 16 14:58:31.203405 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 268/550] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:58:30 2021] GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed => generated 1319 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:58:31.216102 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-361e738f-007c-490d-b8e1-d1033a4aa3b6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:58:31.217441 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-361e738f-007c-490d-b8e1-d1033a4aa3b6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:31.226203 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-361e738f-007c-490d-b8e1-d1033a4aa3b6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:31.226909 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-361e738f-007c-490d-b8e1-d1033a4aa3b6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:31.227547 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-361e738f-007c-490d-b8e1-d1033a4aa3b6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:31.228040 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-361e738f-007c-490d-b8e1-d1033a4aa3b6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:31.353531 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-ff72aa5f-ef1e-45cd-a465-fb866e3b1fba tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:58:31.354490 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-ff72aa5f-ef1e-45cd-a465-fb866e3b1fba tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: 407dd6f1-6f0a-41ba-80e2-9ebe4630fa75] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:31.362655 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ff72aa5f-ef1e-45cd-a465-fb866e3b1fba tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:31.363241 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ff72aa5f-ef1e-45cd-a465-fb866e3b1fba tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:31.364202 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ff72aa5f-ef1e-45cd-a465-fb866e3b1fba tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:31.364773 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ff72aa5f-ef1e-45cd-a465-fb866e3b1fba tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:31.373067 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-361e738f-007c-490d-b8e1-d1033a4aa3b6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 28634 microversion: 2.1 time: 0.165261 Dec 16 14:58:31.374464 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 283/551] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:58:31 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 28634 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:58:31.588690 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-ff72aa5f-ef1e-45cd-a465-fb866e3b1fba tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:58:31.598364 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-ff72aa5f-ef1e-45cd-a465-fb866e3b1fba tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75" status: 200 len: 1567 microversion: 2.1 time: 0.253224 Dec 16 14:58:31.598960 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 269/552] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:58:31 2021] GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75 => generated 1567 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:58:31.776639 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-3d49aa0f-58e6-445a-ae67-b4048e847202 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:58:31.777754 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-3d49aa0f-58e6-445a-ae67-b4048e847202 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:31.786316 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3d49aa0f-58e6-445a-ae67-b4048e847202 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:31.786817 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3d49aa0f-58e6-445a-ae67-b4048e847202 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:31.787654 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3d49aa0f-58e6-445a-ae67-b4048e847202 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:31.788140 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3d49aa0f-58e6-445a-ae67-b4048e847202 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:31.944710 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-3d49aa0f-58e6-445a-ae67-b4048e847202 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 200 len: 28622 microversion: 2.20 time: 0.176409 Dec 16 14:58:31.945690 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 284/553] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:58:31 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 28622 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:58:32.071338 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [req-a568bae6-ed25-4836-89b5-ed16739c19c6 req-6dfeac8d-ffc3-400a-a1ad-bd644edfe5f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64774bdb-b85b-4d86-9110-0b37d9c15bed", "name": "network-vif-plugged", "status": "completed", "tag": "75cb5458-4bda-45f2-b4d8-351b0e290d01"}]} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:58:32.076627 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:58:32.076627 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: warnings.warn(msg) Dec 16 14:58:32.082811 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-d4c81215-e96f-457d-a038-3b0f57988add tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:58:32.083520 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-d4c81215-e96f-457d-a038-3b0f57988add tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:32.088718 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-a568bae6-ed25-4836-89b5-ed16739c19c6 req-6dfeac8d-ffc3-400a-a1ad-bd644edfe5f5 service nova] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:32.089450 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-a568bae6-ed25-4836-89b5-ed16739c19c6 req-6dfeac8d-ffc3-400a-a1ad-bd644edfe5f5 service nova] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:32.093042 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d4c81215-e96f-457d-a038-3b0f57988add tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:32.093553 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d4c81215-e96f-457d-a038-3b0f57988add tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:32.094418 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d4c81215-e96f-457d-a038-3b0f57988add tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:32.094904 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d4c81215-e96f-457d-a038-3b0f57988add tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:32.108360 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.compute.server_external_events [req-a568bae6-ed25-4836-89b5-ed16739c19c6 req-6dfeac8d-ffc3-400a-a1ad-bd644edfe5f5 service nova] Creating event network-vif-plugged:75cb5458-4bda-45f2-b4d8-351b0e290d01 for instance 64774bdb-b85b-4d86-9110-0b37d9c15bed on hv-cinder-82189 Dec 16 14:58:32.113769 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [req-a568bae6-ed25-4836-89b5-ed16739c19c6 req-6dfeac8d-ffc3-400a-a1ad-bd644edfe5f5 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050663 Dec 16 14:58:32.114465 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 270/554] 10.222.0.45 () {64 vars in 1308 bytes} [Thu Dec 16 14:58:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:58:32.226741 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-20ad16cb-79d2-42ef-9cbd-301c00477893 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:58:32.227516 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-20ad16cb-79d2-42ef-9cbd-301c00477893 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] [instance: 64774bdb-b85b-4d86-9110-0b37d9c15bed] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:32.238509 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-20ad16cb-79d2-42ef-9cbd-301c00477893 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:32.239024 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-20ad16cb-79d2-42ef-9cbd-301c00477893 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:32.240214 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-20ad16cb-79d2-42ef-9cbd-301c00477893 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:32.242089 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-20ad16cb-79d2-42ef-9cbd-301c00477893 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:32.336641 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-d4c81215-e96f-457d-a038-3b0f57988add tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:58:32.354171 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-d4c81215-e96f-457d-a038-3b0f57988add tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1260 microversion: 2.1 time: 0.279736 Dec 16 14:58:32.354794 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 285/555] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:58:32 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1260 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:58:32.392973 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-047c9f10-8dea-4726-8f7f-85794c0ab9de tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:58:32.396567 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-047c9f10-8dea-4726-8f7f-85794c0ab9de tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:32.405525 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-047c9f10-8dea-4726-8f7f-85794c0ab9de tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:32.406201 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-047c9f10-8dea-4726-8f7f-85794c0ab9de tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:32.407133 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-047c9f10-8dea-4726-8f7f-85794c0ab9de tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:32.407621 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-047c9f10-8dea-4726-8f7f-85794c0ab9de tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:32.568350 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-047c9f10-8dea-4726-8f7f-85794c0ab9de tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 28634 microversion: 2.1 time: 0.184721 Dec 16 14:58:32.571379 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 286/556] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:58:32 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 28634 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:58:32.582484 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-20ad16cb-79d2-42ef-9cbd-301c00477893 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ee0c9e767b4895b9e063b28ae947d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb300a155af646228f7c0b155a5d63ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:58:32.592221 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-20ad16cb-79d2-42ef-9cbd-301c00477893 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] 10.222.0.45 "GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed" status: 200 len: 1319 microversion: 2.1 time: 0.374793 Dec 16 14:58:32.592933 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 271/557] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:58:32 2021] GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed => generated 1319 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:58:32.628856 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-99cfa507-2824-4240-945e-21b36f95dd14 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:58:32.629659 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-99cfa507-2824-4240-945e-21b36f95dd14 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: 407dd6f1-6f0a-41ba-80e2-9ebe4630fa75] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:32.638937 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-99cfa507-2824-4240-945e-21b36f95dd14 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:32.639454 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-99cfa507-2824-4240-945e-21b36f95dd14 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:32.640301 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-99cfa507-2824-4240-945e-21b36f95dd14 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:32.640798 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-99cfa507-2824-4240-945e-21b36f95dd14 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:32.861240 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-99cfa507-2824-4240-945e-21b36f95dd14 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:58:32.871283 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-99cfa507-2824-4240-945e-21b36f95dd14 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75" status: 200 len: 1567 microversion: 2.1 time: 0.250910 Dec 16 14:58:32.871878 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 287/558] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:58:32 2021] GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75 => generated 1567 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:58:32.961839 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-ecea08a6-27c6-4c5b-926c-88718b29a3b7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:58:32.962982 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-ecea08a6-27c6-4c5b-926c-88718b29a3b7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:32.970912 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ecea08a6-27c6-4c5b-926c-88718b29a3b7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:32.971426 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ecea08a6-27c6-4c5b-926c-88718b29a3b7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:32.972359 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ecea08a6-27c6-4c5b-926c-88718b29a3b7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:32.972858 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ecea08a6-27c6-4c5b-926c-88718b29a3b7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:33.211501 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-ecea08a6-27c6-4c5b-926c-88718b29a3b7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 200 len: 28622 microversion: 2.20 time: 0.257786 Dec 16 14:58:33.212250 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 272/559] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:58:32 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 28622 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:58:33.376755 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-c72b8dc3-cb5e-4fb7-93b6-58f4d3d37387 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:58:33.377505 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-c72b8dc3-cb5e-4fb7-93b6-58f4d3d37387 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:33.385387 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c72b8dc3-cb5e-4fb7-93b6-58f4d3d37387 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:33.385824 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c72b8dc3-cb5e-4fb7-93b6-58f4d3d37387 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:33.386706 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c72b8dc3-cb5e-4fb7-93b6-58f4d3d37387 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:33.387196 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c72b8dc3-cb5e-4fb7-93b6-58f4d3d37387 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:33.589325 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-3bece2fa-572c-426e-8c7d-078e9679adfc tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:58:33.590674 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-3bece2fa-572c-426e-8c7d-078e9679adfc tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:33.599340 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3bece2fa-572c-426e-8c7d-078e9679adfc tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:33.599893 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3bece2fa-572c-426e-8c7d-078e9679adfc tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:33.600738 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3bece2fa-572c-426e-8c7d-078e9679adfc tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:33.601237 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3bece2fa-572c-426e-8c7d-078e9679adfc tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:33.601338 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-c72b8dc3-cb5e-4fb7-93b6-58f4d3d37387 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:58:33.610409 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-c72b8dc3-cb5e-4fb7-93b6-58f4d3d37387 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1260 microversion: 2.1 time: 0.241359 Dec 16 14:58:33.611054 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 288/560] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:58:33 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1260 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:58:33.619741 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-3bd3a0cb-377e-41f3-84b0-1f65aac92aac tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:58:33.620872 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-3bd3a0cb-377e-41f3-84b0-1f65aac92aac tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] [instance: 64774bdb-b85b-4d86-9110-0b37d9c15bed] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:33.632679 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3bd3a0cb-377e-41f3-84b0-1f65aac92aac tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:33.633183 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3bd3a0cb-377e-41f3-84b0-1f65aac92aac tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:33.634023 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3bd3a0cb-377e-41f3-84b0-1f65aac92aac tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:33.634535 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3bd3a0cb-377e-41f3-84b0-1f65aac92aac tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:33.817928 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-3bece2fa-572c-426e-8c7d-078e9679adfc tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 28634 microversion: 2.1 time: 0.236624 Dec 16 14:58:33.818809 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 273/561] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:58:33 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 28634 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 14:58:33.853331 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-3bd3a0cb-377e-41f3-84b0-1f65aac92aac tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ee0c9e767b4895b9e063b28ae947d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb300a155af646228f7c0b155a5d63ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:58:33.862364 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-3bd3a0cb-377e-41f3-84b0-1f65aac92aac tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] 10.222.0.45 "GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed" status: 200 len: 1319 microversion: 2.1 time: 0.250239 Dec 16 14:58:33.862947 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 289/562] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:58:33 2021] GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed => generated 1319 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:58:33.893718 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-65131c1e-539e-4c58-8fd9-0bf6222c6fb1 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:58:33.894515 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-65131c1e-539e-4c58-8fd9-0bf6222c6fb1 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: 407dd6f1-6f0a-41ba-80e2-9ebe4630fa75] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:33.905011 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-65131c1e-539e-4c58-8fd9-0bf6222c6fb1 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:33.905533 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-65131c1e-539e-4c58-8fd9-0bf6222c6fb1 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:33.906465 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-65131c1e-539e-4c58-8fd9-0bf6222c6fb1 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:33.906966 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-65131c1e-539e-4c58-8fd9-0bf6222c6fb1 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:34.128899 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-65131c1e-539e-4c58-8fd9-0bf6222c6fb1 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:58:34.138665 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-65131c1e-539e-4c58-8fd9-0bf6222c6fb1 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75" status: 200 len: 1567 microversion: 2.1 time: 0.253112 Dec 16 14:58:34.139257 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 274/563] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:58:33 2021] GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75 => generated 1567 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:58:34.228377 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-bbf75a64-7f95-4e2b-aad4-78aa1fd0f851 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:58:34.229493 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-bbf75a64-7f95-4e2b-aad4-78aa1fd0f851 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:34.237387 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-bbf75a64-7f95-4e2b-aad4-78aa1fd0f851 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:34.237909 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-bbf75a64-7f95-4e2b-aad4-78aa1fd0f851 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:34.238764 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-bbf75a64-7f95-4e2b-aad4-78aa1fd0f851 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:34.239344 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-bbf75a64-7f95-4e2b-aad4-78aa1fd0f851 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:34.477802 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-bbf75a64-7f95-4e2b-aad4-78aa1fd0f851 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 200 len: 28622 microversion: 2.20 time: 0.256936 Dec 16 14:58:34.478543 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 290/564] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:58:34 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 28622 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:58:34.638469 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-7cb734e3-e6c0-4c8f-8460-d49021244688 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:58:34.639144 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-7cb734e3-e6c0-4c8f-8460-d49021244688 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:34.647173 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7cb734e3-e6c0-4c8f-8460-d49021244688 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:34.647704 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7cb734e3-e6c0-4c8f-8460-d49021244688 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:34.648955 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7cb734e3-e6c0-4c8f-8460-d49021244688 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:34.650578 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7cb734e3-e6c0-4c8f-8460-d49021244688 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:34.835829 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-96a9720e-95e9-48b6-81e3-12961cda7445 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:58:34.836976 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-96a9720e-95e9-48b6-81e3-12961cda7445 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:34.845826 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-96a9720e-95e9-48b6-81e3-12961cda7445 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:34.846357 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-96a9720e-95e9-48b6-81e3-12961cda7445 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:34.847195 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-96a9720e-95e9-48b6-81e3-12961cda7445 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:34.847699 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-96a9720e-95e9-48b6-81e3-12961cda7445 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:34.885016 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-7cb734e3-e6c0-4c8f-8460-d49021244688 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:58:34.894754 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-7cb734e3-e6c0-4c8f-8460-d49021244688 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1260 microversion: 2.1 time: 0.264311 Dec 16 14:58:34.895630 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 275/565] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:58:34 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1260 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:58:34.912377 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-125d6b11-7dd7-45c9-916a-0005d9cfb565 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:58:34.913679 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-125d6b11-7dd7-45c9-916a-0005d9cfb565 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] [instance: 64774bdb-b85b-4d86-9110-0b37d9c15bed] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:34.921811 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-125d6b11-7dd7-45c9-916a-0005d9cfb565 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:34.922349 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-125d6b11-7dd7-45c9-916a-0005d9cfb565 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:34.923200 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-125d6b11-7dd7-45c9-916a-0005d9cfb565 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:34.923685 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-125d6b11-7dd7-45c9-916a-0005d9cfb565 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:35.021728 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-96a9720e-95e9-48b6-81e3-12961cda7445 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 28634 microversion: 2.1 time: 0.194135 Dec 16 14:58:35.023281 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 291/566] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:58:34 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 28634 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:58:35.142798 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-125d6b11-7dd7-45c9-916a-0005d9cfb565 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ee0c9e767b4895b9e063b28ae947d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb300a155af646228f7c0b155a5d63ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:58:35.153304 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-125d6b11-7dd7-45c9-916a-0005d9cfb565 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] 10.222.0.45 "GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed" status: 200 len: 1508 microversion: 2.1 time: 0.253903 Dec 16 14:58:35.154151 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 276/567] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:58:34 2021] GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed => generated 1508 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:58:35.161621 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-25eb5d9c-e7af-4712-9bd6-13bf043fc3fd tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:58:35.162452 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-25eb5d9c-e7af-4712-9bd6-13bf043fc3fd tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: 407dd6f1-6f0a-41ba-80e2-9ebe4630fa75] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:35.171752 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-25eb5d9c-e7af-4712-9bd6-13bf043fc3fd tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:35.172265 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-25eb5d9c-e7af-4712-9bd6-13bf043fc3fd tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:35.173118 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-25eb5d9c-e7af-4712-9bd6-13bf043fc3fd tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:35.173642 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-25eb5d9c-e7af-4712-9bd6-13bf043fc3fd tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:35.431641 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-25eb5d9c-e7af-4712-9bd6-13bf043fc3fd tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:58:35.441223 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-25eb5d9c-e7af-4712-9bd6-13bf043fc3fd tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75" status: 200 len: 1567 microversion: 2.1 time: 0.288178 Dec 16 14:58:35.441825 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 292/568] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:58:35 2021] GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75 => generated 1567 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:58:35.493077 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-b71452f1-7eef-412c-a0d8-09ce2fa8d9b1 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:58:35.494449 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-b71452f1-7eef-412c-a0d8-09ce2fa8d9b1 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:35.502393 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b71452f1-7eef-412c-a0d8-09ce2fa8d9b1 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:35.502906 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b71452f1-7eef-412c-a0d8-09ce2fa8d9b1 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:35.503971 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b71452f1-7eef-412c-a0d8-09ce2fa8d9b1 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:35.504555 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b71452f1-7eef-412c-a0d8-09ce2fa8d9b1 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:35.682349 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-b71452f1-7eef-412c-a0d8-09ce2fa8d9b1 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 200 len: 28622 microversion: 2.20 time: 0.197000 Dec 16 14:58:35.683228 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 277/569] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:58:35 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 28622 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:58:35.927633 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-a2830b66-47b1-4cdb-a502-2c86753c9012 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:58:35.929368 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-a2830b66-47b1-4cdb-a502-2c86753c9012 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:35.942258 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a2830b66-47b1-4cdb-a502-2c86753c9012 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:35.943298 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a2830b66-47b1-4cdb-a502-2c86753c9012 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:35.945855 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a2830b66-47b1-4cdb-a502-2c86753c9012 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:35.946652 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a2830b66-47b1-4cdb-a502-2c86753c9012 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:36.039866 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-4da64058-4b4c-4a4e-8236-95abf2f83b45 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:58:36.041021 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-4da64058-4b4c-4a4e-8236-95abf2f83b45 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:36.049617 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4da64058-4b4c-4a4e-8236-95abf2f83b45 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:36.050150 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4da64058-4b4c-4a4e-8236-95abf2f83b45 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:36.050996 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4da64058-4b4c-4a4e-8236-95abf2f83b45 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:36.051493 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4da64058-4b4c-4a4e-8236-95abf2f83b45 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:36.175688 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-a2830b66-47b1-4cdb-a502-2c86753c9012 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:58:36.185485 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-a2830b66-47b1-4cdb-a502-2c86753c9012 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1260 microversion: 2.1 time: 0.275401 Dec 16 14:58:36.186086 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 293/570] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:58:35 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1260 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:58:36.197280 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-4da64058-4b4c-4a4e-8236-95abf2f83b45 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 28634 microversion: 2.1 time: 0.165785 Dec 16 14:58:36.197974 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 278/571] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:58:36 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 28634 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 14:58:36.474256 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-38788228-76e1-4ae3-9c5d-59ae42d93bbf tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:58:36.475055 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-38788228-76e1-4ae3-9c5d-59ae42d93bbf tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: 407dd6f1-6f0a-41ba-80e2-9ebe4630fa75] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:36.483800 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-38788228-76e1-4ae3-9c5d-59ae42d93bbf tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:36.484306 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-38788228-76e1-4ae3-9c5d-59ae42d93bbf tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:36.486666 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-38788228-76e1-4ae3-9c5d-59ae42d93bbf tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:36.486666 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-38788228-76e1-4ae3-9c5d-59ae42d93bbf tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:36.699798 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-a47c7773-14ac-4827-858e-dce4a90a0257 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:58:36.700908 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-a47c7773-14ac-4827-858e-dce4a90a0257 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:36.708117 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-38788228-76e1-4ae3-9c5d-59ae42d93bbf tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:58:36.709755 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a47c7773-14ac-4827-858e-dce4a90a0257 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:36.710823 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a47c7773-14ac-4827-858e-dce4a90a0257 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:36.711679 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a47c7773-14ac-4827-858e-dce4a90a0257 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:36.712180 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a47c7773-14ac-4827-858e-dce4a90a0257 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:36.718322 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-38788228-76e1-4ae3-9c5d-59ae42d93bbf tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75" status: 200 len: 1567 microversion: 2.1 time: 0.253179 Dec 16 14:58:36.718913 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 294/572] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:58:36 2021] GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75 => generated 1567 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:58:36.862650 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-a47c7773-14ac-4827-858e-dce4a90a0257 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 200 len: 28622 microversion: 2.20 time: 0.170897 Dec 16 14:58:36.863451 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 279/573] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:58:36 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 28622 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:58:37.207868 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-f23e21c5-768b-4cc9-9f8e-03c102ec899a tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:58:37.208538 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-f23e21c5-768b-4cc9-9f8e-03c102ec899a tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:37.213997 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-a3c0bc46-5463-4dbb-beae-d33007e3d3cf tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:58:37.215499 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-a3c0bc46-5463-4dbb-beae-d33007e3d3cf tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:37.216522 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f23e21c5-768b-4cc9-9f8e-03c102ec899a tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:37.217025 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f23e21c5-768b-4cc9-9f8e-03c102ec899a tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:37.217866 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f23e21c5-768b-4cc9-9f8e-03c102ec899a tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:37.218387 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f23e21c5-768b-4cc9-9f8e-03c102ec899a tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:37.223746 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a3c0bc46-5463-4dbb-beae-d33007e3d3cf tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:37.228821 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a3c0bc46-5463-4dbb-beae-d33007e3d3cf tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:37.228821 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a3c0bc46-5463-4dbb-beae-d33007e3d3cf tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:37.228821 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a3c0bc46-5463-4dbb-beae-d33007e3d3cf tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:37.378056 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-a3c0bc46-5463-4dbb-beae-d33007e3d3cf tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 28634 microversion: 2.1 time: 0.172254 Dec 16 14:58:37.379738 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 280/574] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:58:37 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 28634 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 14:58:37.450309 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-f23e21c5-768b-4cc9-9f8e-03c102ec899a tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:58:37.460590 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-f23e21c5-768b-4cc9-9f8e-03c102ec899a tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1260 microversion: 2.1 time: 0.260359 Dec 16 14:58:37.461680 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 295/575] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:58:37 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1260 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:58:37.741491 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-ec4c947c-a879-45b6-8612-ab26c7da4235 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:58:37.742287 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-ec4c947c-a879-45b6-8612-ab26c7da4235 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: 407dd6f1-6f0a-41ba-80e2-9ebe4630fa75] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:37.751350 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ec4c947c-a879-45b6-8612-ab26c7da4235 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:37.751869 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ec4c947c-a879-45b6-8612-ab26c7da4235 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:37.752709 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ec4c947c-a879-45b6-8612-ab26c7da4235 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:37.753207 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ec4c947c-a879-45b6-8612-ab26c7da4235 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:37.885922 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-f8be7fbf-9a19-4394-b9aa-31e96e2fc589 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:58:37.887526 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-f8be7fbf-9a19-4394-b9aa-31e96e2fc589 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:37.897449 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f8be7fbf-9a19-4394-b9aa-31e96e2fc589 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:37.898325 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f8be7fbf-9a19-4394-b9aa-31e96e2fc589 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:37.899672 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f8be7fbf-9a19-4394-b9aa-31e96e2fc589 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:37.900492 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f8be7fbf-9a19-4394-b9aa-31e96e2fc589 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:38.015978 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-ec4c947c-a879-45b6-8612-ab26c7da4235 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:58:38.042933 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-ec4c947c-a879-45b6-8612-ab26c7da4235 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75" status: 200 len: 1567 microversion: 2.1 time: 0.309577 Dec 16 14:58:38.043983 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 281/576] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:58:37 2021] GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75 => generated 1567 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:58:38.062394 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-f8be7fbf-9a19-4394-b9aa-31e96e2fc589 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 200 len: 28622 microversion: 2.20 time: 0.191249 Dec 16 14:58:38.063106 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 296/577] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:58:37 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 28622 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 16 14:58:38.395261 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-768cde83-f96c-4976-9804-68056212f6dd tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:58:38.396352 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-768cde83-f96c-4976-9804-68056212f6dd tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:38.406441 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-768cde83-f96c-4976-9804-68056212f6dd tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:38.407322 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-768cde83-f96c-4976-9804-68056212f6dd tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:38.408528 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-768cde83-f96c-4976-9804-68056212f6dd tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:38.409316 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-768cde83-f96c-4976-9804-68056212f6dd tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:38.488732 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-47abca5b-bc40-409b-8232-5f37aef57157 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:58:38.489492 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-47abca5b-bc40-409b-8232-5f37aef57157 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:38.498061 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-47abca5b-bc40-409b-8232-5f37aef57157 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:38.498580 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-47abca5b-bc40-409b-8232-5f37aef57157 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:38.499422 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-47abca5b-bc40-409b-8232-5f37aef57157 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:38.499917 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-47abca5b-bc40-409b-8232-5f37aef57157 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:38.578537 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-768cde83-f96c-4976-9804-68056212f6dd tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 28634 microversion: 2.1 time: 0.190867 Dec 16 14:58:38.579260 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 282/578] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:58:38 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 28634 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:58:38.818900 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-47abca5b-bc40-409b-8232-5f37aef57157 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:58:38.829242 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-47abca5b-bc40-409b-8232-5f37aef57157 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1260 microversion: 2.1 time: 0.348676 Dec 16 14:58:38.829956 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 297/579] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:58:38 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1260 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:58:39.066187 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-6fb8e2d7-c22f-4b1b-a0f1-89dbd64366a7 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:58:39.067283 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-6fb8e2d7-c22f-4b1b-a0f1-89dbd64366a7 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: 407dd6f1-6f0a-41ba-80e2-9ebe4630fa75] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:39.076766 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6fb8e2d7-c22f-4b1b-a0f1-89dbd64366a7 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:39.077605 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6fb8e2d7-c22f-4b1b-a0f1-89dbd64366a7 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:39.078955 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6fb8e2d7-c22f-4b1b-a0f1-89dbd64366a7 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:39.079598 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-ce48abbb-cde0-4452-a429-09863e383456 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:58:39.079889 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6fb8e2d7-c22f-4b1b-a0f1-89dbd64366a7 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:39.080640 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-ce48abbb-cde0-4452-a429-09863e383456 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:39.088902 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ce48abbb-cde0-4452-a429-09863e383456 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:39.093627 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ce48abbb-cde0-4452-a429-09863e383456 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:39.093627 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ce48abbb-cde0-4452-a429-09863e383456 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:39.093627 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ce48abbb-cde0-4452-a429-09863e383456 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:39.294613 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-ce48abbb-cde0-4452-a429-09863e383456 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 200 len: 28622 microversion: 2.20 time: 0.223669 Dec 16 14:58:39.295463 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 298/580] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:58:39 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 28622 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 16 14:58:39.316317 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-6fb8e2d7-c22f-4b1b-a0f1-89dbd64366a7 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:58:39.327327 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-6fb8e2d7-c22f-4b1b-a0f1-89dbd64366a7 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75" status: 200 len: 1567 microversion: 2.1 time: 0.269329 Dec 16 14:58:39.328223 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 283/581] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:58:39 2021] GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75 => generated 1567 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:58:39.594612 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-24d47d72-08b2-45b7-8569-5b555c42aa20 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:58:39.595744 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-24d47d72-08b2-45b7-8569-5b555c42aa20 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:39.604339 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-24d47d72-08b2-45b7-8569-5b555c42aa20 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:39.604845 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-24d47d72-08b2-45b7-8569-5b555c42aa20 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:39.605676 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-24d47d72-08b2-45b7-8569-5b555c42aa20 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:39.606230 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-24d47d72-08b2-45b7-8569-5b555c42aa20 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:39.764905 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-24d47d72-08b2-45b7-8569-5b555c42aa20 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 28634 microversion: 2.1 time: 0.178229 Dec 16 14:58:39.766622 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 299/582] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:58:39 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 28634 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:58:39.851102 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-c0a7cfba-dcee-412c-8bde-5778aa6ed96e tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:58:39.852321 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-c0a7cfba-dcee-412c-8bde-5778aa6ed96e tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:39.860201 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c0a7cfba-dcee-412c-8bde-5778aa6ed96e tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:39.860715 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c0a7cfba-dcee-412c-8bde-5778aa6ed96e tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:39.861563 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c0a7cfba-dcee-412c-8bde-5778aa6ed96e tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:39.862076 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c0a7cfba-dcee-412c-8bde-5778aa6ed96e tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:40.083764 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-c0a7cfba-dcee-412c-8bde-5778aa6ed96e tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:58:40.094816 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-c0a7cfba-dcee-412c-8bde-5778aa6ed96e tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1260 microversion: 2.1 time: 0.249750 Dec 16 14:58:40.094909 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 284/583] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:58:39 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1260 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:58:40.311855 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-564c8f69-4b6c-41a2-88ea-ee01dbbbe300 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:58:40.313054 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-564c8f69-4b6c-41a2-88ea-ee01dbbbe300 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:40.321715 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-564c8f69-4b6c-41a2-88ea-ee01dbbbe300 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:40.322285 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-564c8f69-4b6c-41a2-88ea-ee01dbbbe300 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:40.323149 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-564c8f69-4b6c-41a2-88ea-ee01dbbbe300 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:40.323652 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-564c8f69-4b6c-41a2-88ea-ee01dbbbe300 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:40.369709 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-4d0a00aa-f870-40ca-b308-51fc47b51f03 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:58:40.370663 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-4d0a00aa-f870-40ca-b308-51fc47b51f03 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: 407dd6f1-6f0a-41ba-80e2-9ebe4630fa75] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:40.380593 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4d0a00aa-f870-40ca-b308-51fc47b51f03 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:40.381350 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4d0a00aa-f870-40ca-b308-51fc47b51f03 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:40.382593 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4d0a00aa-f870-40ca-b308-51fc47b51f03 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:40.383297 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4d0a00aa-f870-40ca-b308-51fc47b51f03 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:40.608641 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-564c8f69-4b6c-41a2-88ea-ee01dbbbe300 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 200 len: 28622 microversion: 2.20 time: 0.304742 Dec 16 14:58:40.609401 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 300/584] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:58:40 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 28622 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:58:40.619783 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-4d0a00aa-f870-40ca-b308-51fc47b51f03 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:58:40.629186 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-4d0a00aa-f870-40ca-b308-51fc47b51f03 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75" status: 200 len: 1567 microversion: 2.1 time: 0.278985 Dec 16 14:58:40.629769 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 285/585] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:58:40 2021] GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75 => generated 1567 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:58:40.783361 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-f9b5049b-a606-461b-b4f9-19cd456d474b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:58:40.784523 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-f9b5049b-a606-461b-b4f9-19cd456d474b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:40.793112 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f9b5049b-a606-461b-b4f9-19cd456d474b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:40.793621 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f9b5049b-a606-461b-b4f9-19cd456d474b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:40.794501 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f9b5049b-a606-461b-b4f9-19cd456d474b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:40.794989 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f9b5049b-a606-461b-b4f9-19cd456d474b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:40.942818 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-f9b5049b-a606-461b-b4f9-19cd456d474b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 28634 microversion: 2.1 time: 0.168935 Dec 16 14:58:40.943780 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 301/586] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:58:40 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 28634 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:58:41.114995 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-9bc8a834-5714-498b-8fa1-cbc1c62c52dd tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:58:41.115816 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-9bc8a834-5714-498b-8fa1-cbc1c62c52dd tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:41.124276 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9bc8a834-5714-498b-8fa1-cbc1c62c52dd tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:41.124863 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9bc8a834-5714-498b-8fa1-cbc1c62c52dd tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:41.125779 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9bc8a834-5714-498b-8fa1-cbc1c62c52dd tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:41.126380 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9bc8a834-5714-498b-8fa1-cbc1c62c52dd tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:41.354552 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-9bc8a834-5714-498b-8fa1-cbc1c62c52dd tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:58:41.368420 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-9bc8a834-5714-498b-8fa1-cbc1c62c52dd tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1260 microversion: 2.1 time: 0.260401 Dec 16 14:58:41.375729 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 286/587] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:58:41 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1260 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:58:41.626228 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-72294167-ba4e-45c9-a76f-a27551a41147 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:58:41.627262 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-72294167-ba4e-45c9-a76f-a27551a41147 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:41.636792 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-72294167-ba4e-45c9-a76f-a27551a41147 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:41.637294 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-72294167-ba4e-45c9-a76f-a27551a41147 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:41.638140 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-72294167-ba4e-45c9-a76f-a27551a41147 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:41.638623 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-72294167-ba4e-45c9-a76f-a27551a41147 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:41.651809 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-2eed81d7-8784-4014-b509-6db461eec34a tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:58:41.652576 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-2eed81d7-8784-4014-b509-6db461eec34a tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: 407dd6f1-6f0a-41ba-80e2-9ebe4630fa75] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:41.660421 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2eed81d7-8784-4014-b509-6db461eec34a tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:41.661022 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2eed81d7-8784-4014-b509-6db461eec34a tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:41.662101 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2eed81d7-8784-4014-b509-6db461eec34a tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:41.662680 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2eed81d7-8784-4014-b509-6db461eec34a tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:41.794068 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-72294167-ba4e-45c9-a76f-a27551a41147 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 200 len: 28622 microversion: 2.20 time: 0.176562 Dec 16 14:58:41.794974 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 302/588] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:58:41 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 28622 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:58:41.881988 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-2eed81d7-8784-4014-b509-6db461eec34a tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:58:41.891318 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-2eed81d7-8784-4014-b509-6db461eec34a tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75" status: 200 len: 1567 microversion: 2.1 time: 0.247214 Dec 16 14:58:41.891927 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 287/589] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:58:41 2021] GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75 => generated 1567 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:58:41.961981 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-c70537c5-d39a-4217-a8b7-8f99c6eead3e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:58:41.963322 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-c70537c5-d39a-4217-a8b7-8f99c6eead3e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:41.972173 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c70537c5-d39a-4217-a8b7-8f99c6eead3e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:41.972815 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c70537c5-d39a-4217-a8b7-8f99c6eead3e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:41.973669 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c70537c5-d39a-4217-a8b7-8f99c6eead3e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:41.974208 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c70537c5-d39a-4217-a8b7-8f99c6eead3e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:42.143923 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-c70537c5-d39a-4217-a8b7-8f99c6eead3e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 28634 microversion: 2.1 time: 0.190681 Dec 16 14:58:42.144606 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 303/590] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:58:41 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 28634 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:58:42.176434 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [req-5dce3f51-5390-4aae-a827-a8ad0aaa31e6 req-6f0c5919-34bb-427c-a27d-71ca2ac9bfed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60bfc41e-721c-45aa-a6fb-93f9213cf050", "name": "network-vif-plugged", "status": "completed", "tag": "2a20087b-09a5-411d-bbb0-eb5a2ee789c2"}]} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:58:42.181206 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:58:42.181206 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: warnings.warn(msg) Dec 16 14:58:42.191267 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-5dce3f51-5390-4aae-a827-a8ad0aaa31e6 req-6f0c5919-34bb-427c-a27d-71ca2ac9bfed service nova] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:42.191772 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-5dce3f51-5390-4aae-a827-a8ad0aaa31e6 req-6f0c5919-34bb-427c-a27d-71ca2ac9bfed service nova] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:42.210443 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.compute.server_external_events [req-5dce3f51-5390-4aae-a827-a8ad0aaa31e6 req-6f0c5919-34bb-427c-a27d-71ca2ac9bfed service nova] Creating event network-vif-plugged:2a20087b-09a5-411d-bbb0-eb5a2ee789c2 for instance 60bfc41e-721c-45aa-a6fb-93f9213cf050 on hv-cinder-82189 Dec 16 14:58:42.216124 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [req-5dce3f51-5390-4aae-a827-a8ad0aaa31e6 req-6f0c5919-34bb-427c-a27d-71ca2ac9bfed service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047254 Dec 16 14:58:42.216794 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 288/591] 10.222.0.45 () {64 vars in 1308 bytes} [Thu Dec 16 14:58:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:58:42.397519 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-b9173029-c428-4ebe-9c5f-1ec58f6c56df tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:58:42.398312 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-b9173029-c428-4ebe-9c5f-1ec58f6c56df tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:42.410943 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b9173029-c428-4ebe-9c5f-1ec58f6c56df tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:42.411476 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b9173029-c428-4ebe-9c5f-1ec58f6c56df tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:42.412327 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b9173029-c428-4ebe-9c5f-1ec58f6c56df tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:42.412844 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b9173029-c428-4ebe-9c5f-1ec58f6c56df tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:42.640069 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-b9173029-c428-4ebe-9c5f-1ec58f6c56df tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:58:42.648794 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-b9173029-c428-4ebe-9c5f-1ec58f6c56df tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1260 microversion: 2.1 time: 0.259506 Dec 16 14:58:42.649324 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 304/592] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:58:42 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1260 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:58:42.811843 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-fb3ba2c1-ed84-433d-b8c5-9e65da29e630 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:58:42.812982 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-fb3ba2c1-ed84-433d-b8c5-9e65da29e630 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:42.817391 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 14:58:42.817558 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: Thu Dec 16 14:58:42 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action (ip 10.222.0.45) !!! Dec 16 14:58:42.837322 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fb3ba2c1-ed84-433d-b8c5-9e65da29e630 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:42.837831 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fb3ba2c1-ed84-433d-b8c5-9e65da29e630 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:42.838713 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fb3ba2c1-ed84-433d-b8c5-9e65da29e630 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:42.839205 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fb3ba2c1-ed84-433d-b8c5-9e65da29e630 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:42.914768 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-07d11be2-e9d6-4028-bc7e-e0372b969ebe tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:58:42.915398 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-07d11be2-e9d6-4028-bc7e-e0372b969ebe tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: 407dd6f1-6f0a-41ba-80e2-9ebe4630fa75] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:42.923783 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-07d11be2-e9d6-4028-bc7e-e0372b969ebe tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:42.924281 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-07d11be2-e9d6-4028-bc7e-e0372b969ebe tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:42.925122 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-07d11be2-e9d6-4028-bc7e-e0372b969ebe tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:42.925603 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-07d11be2-e9d6-4028-bc7e-e0372b969ebe tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:43.329838 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-07d11be2-e9d6-4028-bc7e-e0372b969ebe tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:58:43.339867 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-07d11be2-e9d6-4028-bc7e-e0372b969ebe tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75" status: 200 len: 1567 microversion: 2.1 time: 0.433605 Dec 16 14:58:43.340465 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 305/593] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:58:42 2021] GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75 => generated 1567 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:58:43.350382 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-00f071dc-e4bc-4e7c-b7c4-8404f755b427 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:58:43.350382 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-00f071dc-e4bc-4e7c-b7c4-8404f755b427 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:43.358570 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-00f071dc-e4bc-4e7c-b7c4-8404f755b427 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:43.359079 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-00f071dc-e4bc-4e7c-b7c4-8404f755b427 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:43.359921 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-00f071dc-e4bc-4e7c-b7c4-8404f755b427 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:43.360416 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-00f071dc-e4bc-4e7c-b7c4-8404f755b427 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:43.370788 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-fb3ba2c1-ed84-433d-b8c5-9e65da29e630 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 200 len: 28622 microversion: 2.20 time: 0.567684 Dec 16 14:58:43.372395 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 289/594] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:58:42 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 28622 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:58:43.518509 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-00f071dc-e4bc-4e7c-b7c4-8404f755b427 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 28634 microversion: 2.1 time: 0.176525 Dec 16 14:58:43.519108 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 306/595] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:58:43 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 28634 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:58:43.671940 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-7ae95ba2-56ad-444a-92b4-6f08a18e69e2 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:58:43.672705 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-7ae95ba2-56ad-444a-92b4-6f08a18e69e2 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:43.682113 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7ae95ba2-56ad-444a-92b4-6f08a18e69e2 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:43.682627 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7ae95ba2-56ad-444a-92b4-6f08a18e69e2 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:43.683472 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7ae95ba2-56ad-444a-92b4-6f08a18e69e2 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:43.683966 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7ae95ba2-56ad-444a-92b4-6f08a18e69e2 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:43.909628 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-7ae95ba2-56ad-444a-92b4-6f08a18e69e2 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:58:43.919020 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-7ae95ba2-56ad-444a-92b4-6f08a18e69e2 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1260 microversion: 2.1 time: 0.255846 Dec 16 14:58:43.919615 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 290/596] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:58:43 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1260 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:58:44.362659 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-40cd8421-e5e2-4005-a2c8-8db606cd1cdf tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:58:44.363424 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-40cd8421-e5e2-4005-a2c8-8db606cd1cdf tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: 407dd6f1-6f0a-41ba-80e2-9ebe4630fa75] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:44.372035 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-40cd8421-e5e2-4005-a2c8-8db606cd1cdf tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:44.372538 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-40cd8421-e5e2-4005-a2c8-8db606cd1cdf tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:44.373386 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-40cd8421-e5e2-4005-a2c8-8db606cd1cdf tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:44.373879 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-40cd8421-e5e2-4005-a2c8-8db606cd1cdf tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:44.388360 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-f9d457cc-5907-433c-bb72-61873728bafc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:58:44.389531 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-f9d457cc-5907-433c-bb72-61873728bafc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:44.397686 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f9d457cc-5907-433c-bb72-61873728bafc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:44.398296 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f9d457cc-5907-433c-bb72-61873728bafc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:44.399920 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f9d457cc-5907-433c-bb72-61873728bafc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:44.400611 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f9d457cc-5907-433c-bb72-61873728bafc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:44.594709 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-40cd8421-e5e2-4005-a2c8-8db606cd1cdf tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:58:44.604978 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-40cd8421-e5e2-4005-a2c8-8db606cd1cdf tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75" status: 200 len: 1567 microversion: 2.1 time: 0.250166 Dec 16 14:58:44.605592 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 307/597] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:58:44 2021] GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75 => generated 1567 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:58:44.607093 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-f9d457cc-5907-433c-bb72-61873728bafc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 200 len: 28622 microversion: 2.20 time: 0.226922 Dec 16 14:58:44.607773 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 291/598] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:58:44 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 28622 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 16 14:58:44.613998 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-a0562452-5ac6-4cda-943a-bf7e85037c31 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:58:44.615043 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-a0562452-5ac6-4cda-943a-bf7e85037c31 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:44.622611 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a0562452-5ac6-4cda-943a-bf7e85037c31 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:44.623115 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a0562452-5ac6-4cda-943a-bf7e85037c31 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:44.623939 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a0562452-5ac6-4cda-943a-bf7e85037c31 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:44.624436 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a0562452-5ac6-4cda-943a-bf7e85037c31 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:44.781448 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-a0562452-5ac6-4cda-943a-bf7e85037c31 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 28634 microversion: 2.1 time: 0.174454 Dec 16 14:58:44.782647 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 308/599] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:58:44 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 28634 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:58:44.941464 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-dfcab31f-2e94-4bd5-bc46-997d6f20ed91 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:58:44.942260 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-dfcab31f-2e94-4bd5-bc46-997d6f20ed91 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:44.951508 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-dfcab31f-2e94-4bd5-bc46-997d6f20ed91 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:44.952009 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-dfcab31f-2e94-4bd5-bc46-997d6f20ed91 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:44.953088 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-dfcab31f-2e94-4bd5-bc46-997d6f20ed91 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:44.953574 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-dfcab31f-2e94-4bd5-bc46-997d6f20ed91 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:45.173516 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-dfcab31f-2e94-4bd5-bc46-997d6f20ed91 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:58:45.203117 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-dfcab31f-2e94-4bd5-bc46-997d6f20ed91 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1260 microversion: 2.1 time: 0.260023 Dec 16 14:58:45.203117 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 292/600] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:58:44 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1260 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:58:45.624194 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-8626d933-bb29-405e-b726-b061e26fbcd5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:58:45.625322 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-8626d933-bb29-405e-b726-b061e26fbcd5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:45.625817 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-5704ed7f-fb4a-4e52-8b94-3491bdc696e4 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:58:45.626537 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-5704ed7f-fb4a-4e52-8b94-3491bdc696e4 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: 407dd6f1-6f0a-41ba-80e2-9ebe4630fa75] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:45.633703 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8626d933-bb29-405e-b726-b061e26fbcd5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:45.634279 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8626d933-bb29-405e-b726-b061e26fbcd5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:45.634634 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5704ed7f-fb4a-4e52-8b94-3491bdc696e4 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:45.635131 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8626d933-bb29-405e-b726-b061e26fbcd5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:45.635250 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5704ed7f-fb4a-4e52-8b94-3491bdc696e4 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:45.635622 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8626d933-bb29-405e-b726-b061e26fbcd5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:45.636025 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5704ed7f-fb4a-4e52-8b94-3491bdc696e4 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:45.636519 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5704ed7f-fb4a-4e52-8b94-3491bdc696e4 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:45.813856 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-8626d933-bb29-405e-b726-b061e26fbcd5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 200 len: 28622 microversion: 2.20 time: 0.197835 Dec 16 14:58:45.814615 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 309/601] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:58:45 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 28622 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:58:45.834148 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-a30e6dd5-6722-45c8-ad43-2c8e1addfbe4 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:58:45.835569 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-a30e6dd5-6722-45c8-ad43-2c8e1addfbe4 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:45.845649 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a30e6dd5-6722-45c8-ad43-2c8e1addfbe4 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:45.846177 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a30e6dd5-6722-45c8-ad43-2c8e1addfbe4 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:45.847032 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a30e6dd5-6722-45c8-ad43-2c8e1addfbe4 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:45.847499 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a30e6dd5-6722-45c8-ad43-2c8e1addfbe4 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:45.868064 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-5704ed7f-fb4a-4e52-8b94-3491bdc696e4 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:58:45.877908 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-5704ed7f-fb4a-4e52-8b94-3491bdc696e4 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75" status: 200 len: 1567 microversion: 2.1 time: 0.259610 Dec 16 14:58:45.878729 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 293/602] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:58:45 2021] GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75 => generated 1567 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:58:46.006077 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-a30e6dd5-6722-45c8-ad43-2c8e1addfbe4 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 28634 microversion: 2.1 time: 0.187744 Dec 16 14:58:46.006794 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 310/603] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:58:45 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 28634 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:58:46.218024 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-74156003-6079-4f7d-a71f-17d0dc9bd1b2 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:58:46.218635 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-74156003-6079-4f7d-a71f-17d0dc9bd1b2 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:46.227104 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-74156003-6079-4f7d-a71f-17d0dc9bd1b2 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:46.227611 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-74156003-6079-4f7d-a71f-17d0dc9bd1b2 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:46.228447 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-74156003-6079-4f7d-a71f-17d0dc9bd1b2 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:46.228941 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-74156003-6079-4f7d-a71f-17d0dc9bd1b2 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:46.447314 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-74156003-6079-4f7d-a71f-17d0dc9bd1b2 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:58:46.456868 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-74156003-6079-4f7d-a71f-17d0dc9bd1b2 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1444 microversion: 2.1 time: 0.246497 Dec 16 14:58:46.457473 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 294/604] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:58:46 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1444 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:58:46.478453 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-6a593275-7821-4c68-b4e6-dc2600b7cf1d tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:58:46.479149 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-6a593275-7821-4c68-b4e6-dc2600b7cf1d tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:46.487635 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6a593275-7821-4c68-b4e6-dc2600b7cf1d tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:46.488138 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6a593275-7821-4c68-b4e6-dc2600b7cf1d tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:46.488975 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6a593275-7821-4c68-b4e6-dc2600b7cf1d tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:46.489468 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6a593275-7821-4c68-b4e6-dc2600b7cf1d tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:46.710912 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-6a593275-7821-4c68-b4e6-dc2600b7cf1d tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:58:46.719720 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-6a593275-7821-4c68-b4e6-dc2600b7cf1d tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1444 microversion: 2.1 time: 0.249678 Dec 16 14:58:46.720311 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 311/605] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:58:46 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1444 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:58:46.830546 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-0d18e016-f2d6-477c-affc-2891feff9092 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:58:46.831590 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-0d18e016-f2d6-477c-affc-2891feff9092 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:46.839576 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0d18e016-f2d6-477c-affc-2891feff9092 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:46.840128 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0d18e016-f2d6-477c-affc-2891feff9092 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:46.841174 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0d18e016-f2d6-477c-affc-2891feff9092 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:46.841678 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0d18e016-f2d6-477c-affc-2891feff9092 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:46.911010 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-7fb4e720-7169-41d5-b5b5-65a3d13a3e45 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:58:46.911690 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-7fb4e720-7169-41d5-b5b5-65a3d13a3e45 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: 407dd6f1-6f0a-41ba-80e2-9ebe4630fa75] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:46.925018 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7fb4e720-7169-41d5-b5b5-65a3d13a3e45 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:46.925808 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7fb4e720-7169-41d5-b5b5-65a3d13a3e45 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:46.926680 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7fb4e720-7169-41d5-b5b5-65a3d13a3e45 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:46.927863 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7fb4e720-7169-41d5-b5b5-65a3d13a3e45 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:47.022013 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-0d18e016-f2d6-477c-affc-2891feff9092 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 200 len: 28622 microversion: 2.20 time: 0.199329 Dec 16 14:58:47.023052 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 295/606] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:58:46 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 28622 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:58:47.033919 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-58205ce5-cabb-4c18-927f-35ea04bc127d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:58:47.035155 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-58205ce5-cabb-4c18-927f-35ea04bc127d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:47.044176 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-58205ce5-cabb-4c18-927f-35ea04bc127d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:47.044690 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-58205ce5-cabb-4c18-927f-35ea04bc127d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:47.045559 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-58205ce5-cabb-4c18-927f-35ea04bc127d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:47.046084 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-58205ce5-cabb-4c18-927f-35ea04bc127d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:47.206731 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-7fb4e720-7169-41d5-b5b5-65a3d13a3e45 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:58:47.211474 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-58205ce5-cabb-4c18-927f-35ea04bc127d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 28634 microversion: 2.1 time: 0.185707 Dec 16 14:58:47.212463 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 296/607] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:58:47 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 28634 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:58:47.219403 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-7fb4e720-7169-41d5-b5b5-65a3d13a3e45 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75" status: 200 len: 1567 microversion: 2.1 time: 0.325878 Dec 16 14:58:47.220435 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 312/608] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:58:46 2021] GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75 => generated 1567 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:58:48.041716 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-d01f3afe-68c5-4735-9a15-5149d65482b5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:58:48.045203 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-d01f3afe-68c5-4735-9a15-5149d65482b5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:48.053688 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d01f3afe-68c5-4735-9a15-5149d65482b5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:48.054344 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d01f3afe-68c5-4735-9a15-5149d65482b5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:48.055755 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d01f3afe-68c5-4735-9a15-5149d65482b5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:48.056271 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d01f3afe-68c5-4735-9a15-5149d65482b5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:48.218995 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-d01f3afe-68c5-4735-9a15-5149d65482b5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 200 len: 28622 microversion: 2.20 time: 0.185501 Dec 16 14:58:48.220307 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 297/609] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:58:48 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 28622 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:58:48.228371 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-97eadd38-152b-4a6d-94b8-e0d41b1a8249 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:58:48.229415 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-97eadd38-152b-4a6d-94b8-e0d41b1a8249 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:48.239833 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-97eadd38-152b-4a6d-94b8-e0d41b1a8249 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:48.240595 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-97eadd38-152b-4a6d-94b8-e0d41b1a8249 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:48.241635 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-97eadd38-152b-4a6d-94b8-e0d41b1a8249 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:48.242838 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-97eadd38-152b-4a6d-94b8-e0d41b1a8249 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:48.245450 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-ebd3f2b2-c023-4d9f-bd0b-b73f76d58b2d tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:58:48.246340 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-ebd3f2b2-c023-4d9f-bd0b-b73f76d58b2d tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: 407dd6f1-6f0a-41ba-80e2-9ebe4630fa75] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:48.255200 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ebd3f2b2-c023-4d9f-bd0b-b73f76d58b2d tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:48.256150 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ebd3f2b2-c023-4d9f-bd0b-b73f76d58b2d tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:48.257011 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ebd3f2b2-c023-4d9f-bd0b-b73f76d58b2d tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:48.257514 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ebd3f2b2-c023-4d9f-bd0b-b73f76d58b2d tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:48.401379 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-97eadd38-152b-4a6d-94b8-e0d41b1a8249 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 28634 microversion: 2.1 time: 0.181235 Dec 16 14:58:48.402151 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 313/610] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:58:48 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 28634 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 14:58:48.737629 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-ebd3f2b2-c023-4d9f-bd0b-b73f76d58b2d tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:58:48.741857 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-ebd3f2b2-c023-4d9f-bd0b-b73f76d58b2d tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75" status: 200 len: 1567 microversion: 2.1 time: 0.505895 Dec 16 14:58:48.742573 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 298/611] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:58:48 2021] GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75 => generated 1567 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:58:49.235862 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-41a7c179-2b02-4db1-b2f7-b20d47909d5f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:58:49.237339 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-41a7c179-2b02-4db1-b2f7-b20d47909d5f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:49.245749 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-41a7c179-2b02-4db1-b2f7-b20d47909d5f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:49.246336 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-41a7c179-2b02-4db1-b2f7-b20d47909d5f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:49.247190 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-41a7c179-2b02-4db1-b2f7-b20d47909d5f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:49.247681 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-41a7c179-2b02-4db1-b2f7-b20d47909d5f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:49.405786 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-41a7c179-2b02-4db1-b2f7-b20d47909d5f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 200 len: 28622 microversion: 2.20 time: 0.178578 Dec 16 14:58:49.407973 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 314/612] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:58:49 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 28622 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:58:49.417349 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-be99431f-627d-422f-9863-b7f56d886044 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:58:49.418400 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-be99431f-627d-422f-9863-b7f56d886044 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:49.427555 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-be99431f-627d-422f-9863-b7f56d886044 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:49.428067 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-be99431f-627d-422f-9863-b7f56d886044 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:49.428909 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-be99431f-627d-422f-9863-b7f56d886044 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:49.429400 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-be99431f-627d-422f-9863-b7f56d886044 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:49.604608 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-be99431f-627d-422f-9863-b7f56d886044 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 28634 microversion: 2.1 time: 0.195092 Dec 16 14:58:49.608821 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 299/613] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:58:49 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 28634 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:58:49.768346 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-dc66c0c2-6389-43b2-9dd6-add69967f1f4 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:58:49.768346 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-dc66c0c2-6389-43b2-9dd6-add69967f1f4 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: 407dd6f1-6f0a-41ba-80e2-9ebe4630fa75] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:49.776617 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-dc66c0c2-6389-43b2-9dd6-add69967f1f4 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:49.777341 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-dc66c0c2-6389-43b2-9dd6-add69967f1f4 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:49.778428 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-dc66c0c2-6389-43b2-9dd6-add69967f1f4 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:49.779000 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-dc66c0c2-6389-43b2-9dd6-add69967f1f4 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:50.012439 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-dc66c0c2-6389-43b2-9dd6-add69967f1f4 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:58:50.022571 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-dc66c0c2-6389-43b2-9dd6-add69967f1f4 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75" status: 200 len: 1567 microversion: 2.1 time: 0.266245 Dec 16 14:58:50.023343 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 315/614] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:58:49 2021] GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75 => generated 1567 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:58:50.422962 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-c952bf83-1d6c-4022-9b6c-de0203a7e6bc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:58:50.424100 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-c952bf83-1d6c-4022-9b6c-de0203a7e6bc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:50.433674 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c952bf83-1d6c-4022-9b6c-de0203a7e6bc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:50.433674 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c952bf83-1d6c-4022-9b6c-de0203a7e6bc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:50.434439 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c952bf83-1d6c-4022-9b6c-de0203a7e6bc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:50.434936 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c952bf83-1d6c-4022-9b6c-de0203a7e6bc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:50.621490 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-ed6266c8-ea3c-47a2-97cb-16916a27e872 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:58:50.622562 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-ed6266c8-ea3c-47a2-97cb-16916a27e872 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:50.630557 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ed6266c8-ea3c-47a2-97cb-16916a27e872 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:50.631216 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ed6266c8-ea3c-47a2-97cb-16916a27e872 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:50.632067 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ed6266c8-ea3c-47a2-97cb-16916a27e872 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:50.632561 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ed6266c8-ea3c-47a2-97cb-16916a27e872 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:50.635380 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-c952bf83-1d6c-4022-9b6c-de0203a7e6bc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 200 len: 28622 microversion: 2.20 time: 0.221113 Dec 16 14:58:50.636717 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 300/615] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:58:50 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 28622 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:58:50.645588 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [req-8508cfa7-cd34-4e3d-99b5-8f03d18e6724 req-6ddbe205-3d62-4458-a2d3-22acefd5de1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60bfc41e-721c-45aa-a6fb-93f9213cf050", "tag": "2a20087b-09a5-411d-bbb0-eb5a2ee789c2"}]} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:58:50.650428 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:58:50.650428 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: warnings.warn(msg) Dec 16 14:58:50.659833 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-8508cfa7-cd34-4e3d-99b5-8f03d18e6724 req-6ddbe205-3d62-4458-a2d3-22acefd5de1f service nova] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:50.660336 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-8508cfa7-cd34-4e3d-99b5-8f03d18e6724 req-6ddbe205-3d62-4458-a2d3-22acefd5de1f service nova] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:50.680796 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.compute.server_external_events [req-8508cfa7-cd34-4e3d-99b5-8f03d18e6724 req-6ddbe205-3d62-4458-a2d3-22acefd5de1f service nova] Creating event network-changed:2a20087b-09a5-411d-bbb0-eb5a2ee789c2 for instance 60bfc41e-721c-45aa-a6fb-93f9213cf050 on hv-cinder-82189 Dec 16 14:58:50.686072 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [req-8508cfa7-cd34-4e3d-99b5-8f03d18e6724 req-6ddbe205-3d62-4458-a2d3-22acefd5de1f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048444 Dec 16 14:58:50.686776 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 301/616] 10.222.0.45 () {64 vars in 1308 bytes} [Thu Dec 16 14:58:50 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:58:50.806453 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-ed6266c8-ea3c-47a2-97cb-16916a27e872 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 28634 microversion: 2.1 time: 0.192906 Dec 16 14:58:50.807918 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 316/617] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:58:50 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 28634 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 14:58:51.046137 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-952fae69-e681-4004-89d4-0d40b00090ca tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:58:51.046912 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-952fae69-e681-4004-89d4-0d40b00090ca tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: 407dd6f1-6f0a-41ba-80e2-9ebe4630fa75] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:51.055760 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-952fae69-e681-4004-89d4-0d40b00090ca tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:51.056305 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-952fae69-e681-4004-89d4-0d40b00090ca tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:51.057163 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-952fae69-e681-4004-89d4-0d40b00090ca tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:51.057635 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-952fae69-e681-4004-89d4-0d40b00090ca tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:51.468026 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-952fae69-e681-4004-89d4-0d40b00090ca tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:58:51.482022 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-952fae69-e681-4004-89d4-0d40b00090ca tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75" status: 200 len: 1567 microversion: 2.1 time: 0.444396 Dec 16 14:58:51.482691 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 302/618] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:58:51 2021] GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75 => generated 1567 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:58:51.656300 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-8ba69e74-85c8-4c56-b977-4d1173fc2cf9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:58:51.657069 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-8ba69e74-85c8-4c56-b977-4d1173fc2cf9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:51.669614 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8ba69e74-85c8-4c56-b977-4d1173fc2cf9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:51.670497 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8ba69e74-85c8-4c56-b977-4d1173fc2cf9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:51.671528 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8ba69e74-85c8-4c56-b977-4d1173fc2cf9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:51.672021 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8ba69e74-85c8-4c56-b977-4d1173fc2cf9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:51.823008 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-1fbb40db-0394-4856-b625-865ee6f3c079 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:58:51.824042 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-1fbb40db-0394-4856-b625-865ee6f3c079 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:51.833063 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-8ba69e74-85c8-4c56-b977-4d1173fc2cf9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 200 len: 28622 microversion: 2.20 time: 0.188089 Dec 16 14:58:51.837600 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 317/619] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:58:51 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 28622 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:58:51.837802 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1fbb40db-0394-4856-b625-865ee6f3c079 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:51.837802 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1fbb40db-0394-4856-b625-865ee6f3c079 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:51.837980 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1fbb40db-0394-4856-b625-865ee6f3c079 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:51.838477 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1fbb40db-0394-4856-b625-865ee6f3c079 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:52.033273 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-1fbb40db-0394-4856-b625-865ee6f3c079 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 28634 microversion: 2.1 time: 0.218230 Dec 16 14:58:52.034092 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 303/620] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:58:51 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 28634 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 14:58:52.505640 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-a646d234-8f32-4de3-b90e-686961aa4192 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:58:52.506633 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-a646d234-8f32-4de3-b90e-686961aa4192 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: 407dd6f1-6f0a-41ba-80e2-9ebe4630fa75] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:52.515114 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a646d234-8f32-4de3-b90e-686961aa4192 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:52.515607 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a646d234-8f32-4de3-b90e-686961aa4192 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:52.516483 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a646d234-8f32-4de3-b90e-686961aa4192 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:52.516971 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a646d234-8f32-4de3-b90e-686961aa4192 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:52.737048 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-a646d234-8f32-4de3-b90e-686961aa4192 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:58:52.746578 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-a646d234-8f32-4de3-b90e-686961aa4192 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75" status: 200 len: 1567 microversion: 2.1 time: 0.249295 Dec 16 14:58:52.747176 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 318/621] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:58:52 2021] GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75 => generated 1567 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:58:52.850578 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-43ed21ab-2598-420e-ae36-7164149f0cbc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:58:52.851866 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-43ed21ab-2598-420e-ae36-7164149f0cbc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:52.861583 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-43ed21ab-2598-420e-ae36-7164149f0cbc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:52.862902 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-43ed21ab-2598-420e-ae36-7164149f0cbc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:52.863752 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-43ed21ab-2598-420e-ae36-7164149f0cbc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:52.864298 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-43ed21ab-2598-420e-ae36-7164149f0cbc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:53.049668 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-c5a5162c-2d14-4a3a-81e3-7f0592b1dc8b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:58:53.050638 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-c5a5162c-2d14-4a3a-81e3-7f0592b1dc8b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:53.054073 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-43ed21ab-2598-420e-ae36-7164149f0cbc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 200 len: 28784 microversion: 2.20 time: 0.211585 Dec 16 14:58:53.055506 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 304/622] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:58:52 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 28784 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:58:53.061230 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c5a5162c-2d14-4a3a-81e3-7f0592b1dc8b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:53.061740 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c5a5162c-2d14-4a3a-81e3-7f0592b1dc8b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:53.062609 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c5a5162c-2d14-4a3a-81e3-7f0592b1dc8b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:53.065437 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c5a5162c-2d14-4a3a-81e3-7f0592b1dc8b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:53.238870 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-c5a5162c-2d14-4a3a-81e3-7f0592b1dc8b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 28965 microversion: 2.1 time: 0.196630 Dec 16 14:58:53.239915 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 319/623] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:58:53 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 28965 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:58:53.769481 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-6c3a1446-4bb4-4788-a650-9b0336029e82 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:58:53.770239 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-6c3a1446-4bb4-4788-a650-9b0336029e82 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: 407dd6f1-6f0a-41ba-80e2-9ebe4630fa75] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:53.779291 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6c3a1446-4bb4-4788-a650-9b0336029e82 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:53.779799 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6c3a1446-4bb4-4788-a650-9b0336029e82 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:53.780641 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6c3a1446-4bb4-4788-a650-9b0336029e82 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:53.781136 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6c3a1446-4bb4-4788-a650-9b0336029e82 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:53.996086 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-6c3a1446-4bb4-4788-a650-9b0336029e82 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:58:54.005752 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-6c3a1446-4bb4-4788-a650-9b0336029e82 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75" status: 200 len: 1567 microversion: 2.1 time: 0.244682 Dec 16 14:58:54.006402 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 305/624] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:58:53 2021] GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75 => generated 1567 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:58:54.071978 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-557f8756-93f0-4bb6-9df2-63ed8ad3b3ee tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:58:54.073014 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-557f8756-93f0-4bb6-9df2-63ed8ad3b3ee tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:54.081732 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-557f8756-93f0-4bb6-9df2-63ed8ad3b3ee tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:54.082269 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-557f8756-93f0-4bb6-9df2-63ed8ad3b3ee tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:54.083088 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-557f8756-93f0-4bb6-9df2-63ed8ad3b3ee tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:54.083571 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-557f8756-93f0-4bb6-9df2-63ed8ad3b3ee tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:54.256333 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-0a6bd61c-0622-4482-8b38-4a6fa6246303 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:58:54.257465 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-0a6bd61c-0622-4482-8b38-4a6fa6246303 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:54.266291 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0a6bd61c-0622-4482-8b38-4a6fa6246303 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:54.266893 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0a6bd61c-0622-4482-8b38-4a6fa6246303 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:54.267752 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0a6bd61c-0622-4482-8b38-4a6fa6246303 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:54.268249 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0a6bd61c-0622-4482-8b38-4a6fa6246303 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:54.280879 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-557f8756-93f0-4bb6-9df2-63ed8ad3b3ee tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 200 len: 29736 microversion: 2.20 time: 0.217487 Dec 16 14:58:54.281611 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 320/625] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:58:54 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 29736 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:58:54.462883 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-0a6bd61c-0622-4482-8b38-4a6fa6246303 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 29968 microversion: 2.1 time: 0.214141 Dec 16 14:58:54.463643 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 306/626] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:58:54 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 29968 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:58:55.028942 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-8a9edbeb-ee95-4a07-9c66-227d086fdcea tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:58:55.029613 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-8a9edbeb-ee95-4a07-9c66-227d086fdcea tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: 407dd6f1-6f0a-41ba-80e2-9ebe4630fa75] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:55.038132 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8a9edbeb-ee95-4a07-9c66-227d086fdcea tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:55.038638 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8a9edbeb-ee95-4a07-9c66-227d086fdcea tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:55.039505 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8a9edbeb-ee95-4a07-9c66-227d086fdcea tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:55.039993 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8a9edbeb-ee95-4a07-9c66-227d086fdcea tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:55.256873 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-8a9edbeb-ee95-4a07-9c66-227d086fdcea tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:58:55.266797 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-8a9edbeb-ee95-4a07-9c66-227d086fdcea tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75" status: 200 len: 1567 microversion: 2.1 time: 0.246806 Dec 16 14:58:55.267401 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 321/627] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:58:55 2021] GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75 => generated 1567 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:58:55.296713 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-83191f45-a390-4a53-8991-f7e7c97e4b42 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:58:55.298203 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-83191f45-a390-4a53-8991-f7e7c97e4b42 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:55.307103 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-83191f45-a390-4a53-8991-f7e7c97e4b42 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:55.307603 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-83191f45-a390-4a53-8991-f7e7c97e4b42 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:55.308444 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-83191f45-a390-4a53-8991-f7e7c97e4b42 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:55.308930 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-83191f45-a390-4a53-8991-f7e7c97e4b42 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:55.479325 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-184b66b8-4ade-4f8a-940d-fa3edc5386da tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:58:55.480365 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-184b66b8-4ade-4f8a-940d-fa3edc5386da tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:55.486650 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-83191f45-a390-4a53-8991-f7e7c97e4b42 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 200 len: 30495 microversion: 2.20 time: 0.198000 Dec 16 14:58:55.490968 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 307/628] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:58:55 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 30495 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:58:55.491111 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-184b66b8-4ade-4f8a-940d-fa3edc5386da tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:55.491111 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-184b66b8-4ade-4f8a-940d-fa3edc5386da tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:55.491111 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-184b66b8-4ade-4f8a-940d-fa3edc5386da tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:55.491111 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-184b66b8-4ade-4f8a-940d-fa3edc5386da tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:55.693605 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-184b66b8-4ade-4f8a-940d-fa3edc5386da tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 30913 microversion: 2.1 time: 0.221506 Dec 16 14:58:55.694346 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 322/629] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:58:55 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 30913 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 14:58:56.290102 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-06fb9ee3-fa53-4d93-83b9-381327a7fa1f tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:58:56.290868 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-06fb9ee3-fa53-4d93-83b9-381327a7fa1f tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: 407dd6f1-6f0a-41ba-80e2-9ebe4630fa75] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:56.299320 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-06fb9ee3-fa53-4d93-83b9-381327a7fa1f tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:56.299867 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-06fb9ee3-fa53-4d93-83b9-381327a7fa1f tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:56.300697 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-06fb9ee3-fa53-4d93-83b9-381327a7fa1f tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:56.301184 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-06fb9ee3-fa53-4d93-83b9-381327a7fa1f tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:56.504469 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-e82d41b6-9f46-4d3c-958f-0aa4c7c51617 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:58:56.505608 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-e82d41b6-9f46-4d3c-958f-0aa4c7c51617 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:56.514234 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e82d41b6-9f46-4d3c-958f-0aa4c7c51617 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:56.514846 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e82d41b6-9f46-4d3c-958f-0aa4c7c51617 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:56.515739 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e82d41b6-9f46-4d3c-958f-0aa4c7c51617 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:56.516261 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e82d41b6-9f46-4d3c-958f-0aa4c7c51617 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:56.524752 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-06fb9ee3-fa53-4d93-83b9-381327a7fa1f tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:58:56.538320 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-06fb9ee3-fa53-4d93-83b9-381327a7fa1f tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75" status: 200 len: 1567 microversion: 2.1 time: 0.256382 Dec 16 14:58:56.539654 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 308/630] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:58:56 2021] GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75 => generated 1567 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:58:56.711758 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-29d90dc3-a998-4841-8ca2-a5564ed27c1a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:58:56.712455 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-e82d41b6-9f46-4d3c-958f-0aa4c7c51617 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 200 len: 31752 microversion: 2.20 time: 0.216317 Dec 16 14:58:56.712875 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-29d90dc3-a998-4841-8ca2-a5564ed27c1a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:56.716679 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 323/631] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:58:56 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 31752 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 16 14:58:56.720732 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-29d90dc3-a998-4841-8ca2-a5564ed27c1a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:56.721235 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-29d90dc3-a998-4841-8ca2-a5564ed27c1a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:56.722079 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-29d90dc3-a998-4841-8ca2-a5564ed27c1a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:56.722563 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-29d90dc3-a998-4841-8ca2-a5564ed27c1a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:56.933268 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-29d90dc3-a998-4841-8ca2-a5564ed27c1a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 31827 microversion: 2.1 time: 0.230717 Dec 16 14:58:56.933908 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 309/632] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:58:56 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 31827 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 14:58:57.561991 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-489553ce-c9f5-4ca3-87f8-bade594ebf72 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:58:57.562777 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-489553ce-c9f5-4ca3-87f8-bade594ebf72 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: 407dd6f1-6f0a-41ba-80e2-9ebe4630fa75] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:57.572061 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-489553ce-c9f5-4ca3-87f8-bade594ebf72 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:57.572596 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-489553ce-c9f5-4ca3-87f8-bade594ebf72 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:57.573426 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-489553ce-c9f5-4ca3-87f8-bade594ebf72 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:57.573914 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-489553ce-c9f5-4ca3-87f8-bade594ebf72 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:57.729353 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-d2fde1ae-e17d-4aba-b047-aa46a562c808 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:58:57.730534 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-d2fde1ae-e17d-4aba-b047-aa46a562c808 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:57.738897 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d2fde1ae-e17d-4aba-b047-aa46a562c808 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:57.739404 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d2fde1ae-e17d-4aba-b047-aa46a562c808 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:57.740250 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d2fde1ae-e17d-4aba-b047-aa46a562c808 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:57.740746 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d2fde1ae-e17d-4aba-b047-aa46a562c808 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:57.797041 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-489553ce-c9f5-4ca3-87f8-bade594ebf72 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:58:57.807106 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-489553ce-c9f5-4ca3-87f8-bade594ebf72 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75" status: 200 len: 1567 microversion: 2.1 time: 0.253964 Dec 16 14:58:57.807713 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 324/633] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:58:57 2021] GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75 => generated 1567 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:58:57.945416 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-d2fde1ae-e17d-4aba-b047-aa46a562c808 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 200 len: 32529 microversion: 2.20 time: 0.218116 Dec 16 14:58:57.945416 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 310/634] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:58:57 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 32529 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:58:57.952825 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-40ddb6e2-4ba7-4963-9ade-fb7848480da7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:58:57.953868 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-40ddb6e2-4ba7-4963-9ade-fb7848480da7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:57.961645 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-40ddb6e2-4ba7-4963-9ade-fb7848480da7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:57.962175 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-40ddb6e2-4ba7-4963-9ade-fb7848480da7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:57.963021 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-40ddb6e2-4ba7-4963-9ade-fb7848480da7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:57.963515 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-40ddb6e2-4ba7-4963-9ade-fb7848480da7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:58.147065 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-40ddb6e2-4ba7-4963-9ade-fb7848480da7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 32617 microversion: 2.1 time: 0.202105 Dec 16 14:58:58.147761 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 325/635] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:58:57 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 32617 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 14:58:58.830383 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-0f14d13c-1b10-4731-8321-dd31b4fee2b5 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:58:58.831130 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-0f14d13c-1b10-4731-8321-dd31b4fee2b5 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: 407dd6f1-6f0a-41ba-80e2-9ebe4630fa75] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:58.840113 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0f14d13c-1b10-4731-8321-dd31b4fee2b5 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:58.840616 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0f14d13c-1b10-4731-8321-dd31b4fee2b5 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:58.841462 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0f14d13c-1b10-4731-8321-dd31b4fee2b5 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:58.841953 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0f14d13c-1b10-4731-8321-dd31b4fee2b5 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:58.956736 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-93e58df4-6659-4922-868e-b6dbf3d11d0f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:58:58.957800 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-93e58df4-6659-4922-868e-b6dbf3d11d0f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:58.966968 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-93e58df4-6659-4922-868e-b6dbf3d11d0f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:58.967547 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-93e58df4-6659-4922-868e-b6dbf3d11d0f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:58.968406 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-93e58df4-6659-4922-868e-b6dbf3d11d0f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:58.968904 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-93e58df4-6659-4922-868e-b6dbf3d11d0f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:59.069436 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-0f14d13c-1b10-4731-8321-dd31b4fee2b5 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:58:59.079694 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-0f14d13c-1b10-4731-8321-dd31b4fee2b5 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75" status: 200 len: 1567 microversion: 2.1 time: 0.258665 Dec 16 14:58:59.080284 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 311/636] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:58:58 2021] GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75 => generated 1567 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:58:59.163593 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-31b5ce89-4700-4e88-a601-4d06c5349ae3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:58:59.164640 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-31b5ce89-4700-4e88-a601-4d06c5349ae3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:58:59.171371 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-93e58df4-6659-4922-868e-b6dbf3d11d0f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 200 len: 33154 microversion: 2.20 time: 0.223050 Dec 16 14:58:59.172109 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 326/637] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:58:58 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 33154 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 16 14:58:59.174795 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-31b5ce89-4700-4e88-a601-4d06c5349ae3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:59.175725 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-31b5ce89-4700-4e88-a601-4d06c5349ae3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:59.177243 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-31b5ce89-4700-4e88-a601-4d06c5349ae3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:58:59.178225 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-31b5ce89-4700-4e88-a601-4d06c5349ae3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:58:59.362664 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-31b5ce89-4700-4e88-a601-4d06c5349ae3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 33116 microversion: 2.1 time: 0.206836 Dec 16 14:58:59.363663 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 312/638] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:58:59 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 33116 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 14:59:00.102311 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-f837fea3-47ca-4a87-8e04-18b2d32307c0 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:59:00.103682 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-f837fea3-47ca-4a87-8e04-18b2d32307c0 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: 407dd6f1-6f0a-41ba-80e2-9ebe4630fa75] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:59:00.112629 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f837fea3-47ca-4a87-8e04-18b2d32307c0 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:00.113145 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f837fea3-47ca-4a87-8e04-18b2d32307c0 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:00.113991 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f837fea3-47ca-4a87-8e04-18b2d32307c0 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:00.114516 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f837fea3-47ca-4a87-8e04-18b2d32307c0 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:00.189604 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-388b896d-f788-4ab0-9791-37cf2ce604ca tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:59:00.190761 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-388b896d-f788-4ab0-9791-37cf2ce604ca tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:59:00.206628 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-388b896d-f788-4ab0-9791-37cf2ce604ca tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:00.207197 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-388b896d-f788-4ab0-9791-37cf2ce604ca tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:00.208169 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-388b896d-f788-4ab0-9791-37cf2ce604ca tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:00.208666 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-388b896d-f788-4ab0-9791-37cf2ce604ca tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:00.341525 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-f837fea3-47ca-4a87-8e04-18b2d32307c0 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:00.351191 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-f837fea3-47ca-4a87-8e04-18b2d32307c0 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75" status: 200 len: 1567 microversion: 2.1 time: 0.257089 Dec 16 14:59:00.352190 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 327/639] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:59:00 2021] GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75 => generated 1567 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:59:00.380652 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-6ddf328a-68d2-43b8-8857-59237cf52cb5 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:59:00.381680 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-6ddf328a-68d2-43b8-8857-59237cf52cb5 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:59:00.390198 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6ddf328a-68d2-43b8-8857-59237cf52cb5 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:00.390697 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6ddf328a-68d2-43b8-8857-59237cf52cb5 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:00.391522 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6ddf328a-68d2-43b8-8857-59237cf52cb5 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:00.392021 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6ddf328a-68d2-43b8-8857-59237cf52cb5 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:00.867096 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-388b896d-f788-4ab0-9791-37cf2ce604ca tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 200 len: 33651 microversion: 2.20 time: 0.686064 Dec 16 14:59:00.868081 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 313/640] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:59:00 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 33651 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 16 14:59:00.936490 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-6ddf328a-68d2-43b8-8857-59237cf52cb5 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 33686 microversion: 2.1 time: 0.563198 Dec 16 14:59:00.937440 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 328/641] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:59:00 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 33686 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:59:01.376283 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-91c7978e-8907-4216-b3d1-78d5639944eb tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:59:01.377083 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-91c7978e-8907-4216-b3d1-78d5639944eb tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: 407dd6f1-6f0a-41ba-80e2-9ebe4630fa75] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:59:01.386284 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-91c7978e-8907-4216-b3d1-78d5639944eb tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:01.386796 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-91c7978e-8907-4216-b3d1-78d5639944eb tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:01.387653 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-91c7978e-8907-4216-b3d1-78d5639944eb tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:01.388148 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-91c7978e-8907-4216-b3d1-78d5639944eb tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:01.699316 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-91c7978e-8907-4216-b3d1-78d5639944eb tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:01.709108 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-91c7978e-8907-4216-b3d1-78d5639944eb tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75" status: 200 len: 1567 microversion: 2.1 time: 0.342480 Dec 16 14:59:01.709704 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 314/642] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:59:01 2021] GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75 => generated 1567 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:59:01.888035 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-427bee12-7233-41cf-8db5-b757343b849b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:59:01.889335 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-427bee12-7233-41cf-8db5-b757343b849b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:59:01.897751 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-427bee12-7233-41cf-8db5-b757343b849b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:01.898297 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-427bee12-7233-41cf-8db5-b757343b849b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:01.899150 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-427bee12-7233-41cf-8db5-b757343b849b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:01.900261 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-427bee12-7233-41cf-8db5-b757343b849b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:01.953629 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-c2f12764-f278-436e-8b36-fde921c7543c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:59:01.954641 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-c2f12764-f278-436e-8b36-fde921c7543c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:59:01.962455 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c2f12764-f278-436e-8b36-fde921c7543c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:01.962967 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c2f12764-f278-436e-8b36-fde921c7543c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:01.963903 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c2f12764-f278-436e-8b36-fde921c7543c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:01.964398 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c2f12764-f278-436e-8b36-fde921c7543c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:02.145990 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-427bee12-7233-41cf-8db5-b757343b849b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 200 len: 33921 microversion: 2.20 time: 0.266449 Dec 16 14:59:02.146728 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 329/643] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:59:01 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 33921 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:59:02.336242 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-c2f12764-f278-436e-8b36-fde921c7543c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 33960 microversion: 2.1 time: 0.390962 Dec 16 14:59:02.337580 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 315/644] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:59:01 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 33960 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:59:02.732440 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-adcff813-8094-4dd8-becc-c6e7993d0f7b tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:59:02.733206 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-adcff813-8094-4dd8-becc-c6e7993d0f7b tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: 407dd6f1-6f0a-41ba-80e2-9ebe4630fa75] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:59:02.741842 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-adcff813-8094-4dd8-becc-c6e7993d0f7b tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:02.742406 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-adcff813-8094-4dd8-becc-c6e7993d0f7b tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:02.743257 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-adcff813-8094-4dd8-becc-c6e7993d0f7b tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:02.743750 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-adcff813-8094-4dd8-becc-c6e7993d0f7b tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:02.964875 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-adcff813-8094-4dd8-becc-c6e7993d0f7b tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:02.974217 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-adcff813-8094-4dd8-becc-c6e7993d0f7b tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75" status: 200 len: 1547 microversion: 2.1 time: 0.250502 Dec 16 14:59:02.974823 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 330/645] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:59:02 2021] GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75 => generated 1547 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:59:02.996750 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-ab9514e3-97cc-467f-9e53-0b8cec3993c9 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:59:02.997317 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-ab9514e3-97cc-467f-9e53-0b8cec3993c9 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: 407dd6f1-6f0a-41ba-80e2-9ebe4630fa75] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:59:03.005758 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ab9514e3-97cc-467f-9e53-0b8cec3993c9 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:03.006295 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ab9514e3-97cc-467f-9e53-0b8cec3993c9 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:03.007126 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ab9514e3-97cc-467f-9e53-0b8cec3993c9 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:03.007617 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ab9514e3-97cc-467f-9e53-0b8cec3993c9 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:03.162910 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-acd00273-282f-4471-8734-f491749ef32a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:59:03.164076 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-acd00273-282f-4471-8734-f491749ef32a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:59:03.172725 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-acd00273-282f-4471-8734-f491749ef32a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:03.173232 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-acd00273-282f-4471-8734-f491749ef32a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:03.174096 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-acd00273-282f-4471-8734-f491749ef32a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:03.174597 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-acd00273-282f-4471-8734-f491749ef32a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:03.186108 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.wsgi [None req-ab9514e3-97cc-467f-9e53-0b8cec3993c9 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] HTTP exception thrown: Cannot 'detach_volume' instance 407dd6f1-6f0a-41ba-80e2-9ebe4630fa75 while it is in vm_state rescued Dec 16 14:59:03.186914 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-ab9514e3-97cc-467f-9e53-0b8cec3993c9 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Returning 409 to user: Cannot 'detach_volume' instance 407dd6f1-6f0a-41ba-80e2-9ebe4630fa75 while it is in vm_state rescued {{(pid=101355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:941}} Dec 16 14:59:03.187821 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-ab9514e3-97cc-467f-9e53-0b8cec3993c9 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "DELETE /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75/os-volume_attachments/40b9a675-f042-44be-8b73-5ae2d78124b6" status: 409 len: 152 microversion: 2.1 time: 0.200066 Dec 16 14:59:03.188593 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 316/646] 10.222.0.45 () {58 vars in 1406 bytes} [Thu Dec 16 14:59:02 2021] DELETE /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75/os-volume_attachments/40b9a675-f042-44be-8b73-5ae2d78124b6 => generated 152 bytes in 201 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Dec 16 14:59:03.200967 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-c767964b-76ec-493d-a204-2b5fd8e92fae tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:59:03.201553 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-c767964b-76ec-493d-a204-2b5fd8e92fae tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: 407dd6f1-6f0a-41ba-80e2-9ebe4630fa75] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:59:03.209863 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c767964b-76ec-493d-a204-2b5fd8e92fae tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:03.210597 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c767964b-76ec-493d-a204-2b5fd8e92fae tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:03.211223 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c767964b-76ec-493d-a204-2b5fd8e92fae tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:03.211713 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c767964b-76ec-493d-a204-2b5fd8e92fae tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:03.441895 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-c767964b-76ec-493d-a204-2b5fd8e92fae tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "POST /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75/action" status: 202 len: 0 microversion: 2.1 time: 0.248464 Dec 16 14:59:03.442633 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 317/647] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:59:03 2021] POST /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75/action => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 16 14:59:03.452029 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-b528b57c-0da7-47f0-afbc-ebb75c462143 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:59:03.453513 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-b528b57c-0da7-47f0-afbc-ebb75c462143 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:59:03.462298 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b528b57c-0da7-47f0-afbc-ebb75c462143 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:03.462752 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b528b57c-0da7-47f0-afbc-ebb75c462143 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:03.463597 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b528b57c-0da7-47f0-afbc-ebb75c462143 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:03.464088 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b528b57c-0da7-47f0-afbc-ebb75c462143 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:03.469664 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-acd00273-282f-4471-8734-f491749ef32a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 200 len: 34437 microversion: 2.20 time: 0.314941 Dec 16 14:59:03.470431 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 331/648] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:59:03 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 34437 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 16 14:59:03.486803 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-cf4bf192-0583-42bf-b3cd-d4f1f17e3934 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:59:03.487581 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-cf4bf192-0583-42bf-b3cd-d4f1f17e3934 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: 407dd6f1-6f0a-41ba-80e2-9ebe4630fa75] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:59:03.497127 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cf4bf192-0583-42bf-b3cd-d4f1f17e3934 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:03.499296 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cf4bf192-0583-42bf-b3cd-d4f1f17e3934 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:03.499296 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cf4bf192-0583-42bf-b3cd-d4f1f17e3934 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:03.499296 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cf4bf192-0583-42bf-b3cd-d4f1f17e3934 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:03.780419 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-b528b57c-0da7-47f0-afbc-ebb75c462143 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 34573 microversion: 2.1 time: 0.336228 Dec 16 14:59:03.784974 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 318/649] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:59:03 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 34573 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:59:03.855600 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-cf4bf192-0583-42bf-b3cd-d4f1f17e3934 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:03.865095 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-cf4bf192-0583-42bf-b3cd-d4f1f17e3934 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75" status: 200 len: 1555 microversion: 2.1 time: 0.389012 Dec 16 14:59:03.865697 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 332/650] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:59:03 2021] GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75 => generated 1555 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:59:04.487657 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-0a027af5-27e8-48d2-8a37-2933564764f7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:59:04.488810 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-0a027af5-27e8-48d2-8a37-2933564764f7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:59:04.497992 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0a027af5-27e8-48d2-8a37-2933564764f7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:04.498533 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0a027af5-27e8-48d2-8a37-2933564764f7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:04.499393 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0a027af5-27e8-48d2-8a37-2933564764f7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:04.499889 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0a027af5-27e8-48d2-8a37-2933564764f7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:04.670292 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-0a027af5-27e8-48d2-8a37-2933564764f7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 200 len: 34981 microversion: 2.20 time: 0.191442 Dec 16 14:59:04.670986 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 319/651] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:59:04 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 34981 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:59:04.796329 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-7a0e1479-3e80-45d8-9f9f-17323c12400d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:59:04.797321 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-7a0e1479-3e80-45d8-9f9f-17323c12400d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:59:04.807314 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7a0e1479-3e80-45d8-9f9f-17323c12400d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:04.807825 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7a0e1479-3e80-45d8-9f9f-17323c12400d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:04.808671 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7a0e1479-3e80-45d8-9f9f-17323c12400d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:04.809167 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7a0e1479-3e80-45d8-9f9f-17323c12400d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:04.890837 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-920b561c-be17-439f-838b-88288cb000a4 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:59:04.891597 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-920b561c-be17-439f-838b-88288cb000a4 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: 407dd6f1-6f0a-41ba-80e2-9ebe4630fa75] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:59:04.900986 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-920b561c-be17-439f-838b-88288cb000a4 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:04.901496 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-920b561c-be17-439f-838b-88288cb000a4 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:04.902366 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-920b561c-be17-439f-838b-88288cb000a4 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:04.902860 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-920b561c-be17-439f-838b-88288cb000a4 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:04.983981 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-7a0e1479-3e80-45d8-9f9f-17323c12400d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 35328 microversion: 2.1 time: 0.195483 Dec 16 14:59:04.984804 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 333/652] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:59:04 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 35328 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:59:05.315182 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-920b561c-be17-439f-838b-88288cb000a4 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:05.325159 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-920b561c-be17-439f-838b-88288cb000a4 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75" status: 200 len: 1555 microversion: 2.1 time: 0.443862 Dec 16 14:59:05.325756 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 320/653] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:59:04 2021] GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75 => generated 1555 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 14:59:05.687813 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-fa098c72-e40c-404e-987b-61a8cf2285a5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:59:05.688933 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-fa098c72-e40c-404e-987b-61a8cf2285a5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:59:05.697972 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fa098c72-e40c-404e-987b-61a8cf2285a5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:05.698494 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fa098c72-e40c-404e-987b-61a8cf2285a5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:05.699331 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fa098c72-e40c-404e-987b-61a8cf2285a5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:05.699815 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fa098c72-e40c-404e-987b-61a8cf2285a5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:05.904753 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-fa098c72-e40c-404e-987b-61a8cf2285a5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 200 len: 35730 microversion: 2.20 time: 0.225535 Dec 16 14:59:05.905461 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 334/654] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:59:05 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 35730 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:59:06.001550 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-911beb57-1cec-449b-b143-f65d04321421 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:59:06.002638 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-911beb57-1cec-449b-b143-f65d04321421 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:59:06.012199 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-911beb57-1cec-449b-b143-f65d04321421 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:06.012738 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-911beb57-1cec-449b-b143-f65d04321421 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:06.013573 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-911beb57-1cec-449b-b143-f65d04321421 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:06.014082 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-911beb57-1cec-449b-b143-f65d04321421 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:06.176123 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-911beb57-1cec-449b-b143-f65d04321421 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 36239 microversion: 2.1 time: 0.182682 Dec 16 14:59:06.176811 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 321/655] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:59:05 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 36239 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:59:06.348672 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-ac05503c-9c4a-43df-8fef-a9849e9ced3b tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:59:06.349531 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-ac05503c-9c4a-43df-8fef-a9849e9ced3b tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: 407dd6f1-6f0a-41ba-80e2-9ebe4630fa75] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:59:06.358308 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ac05503c-9c4a-43df-8fef-a9849e9ced3b tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:06.358819 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ac05503c-9c4a-43df-8fef-a9849e9ced3b tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:06.359663 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ac05503c-9c4a-43df-8fef-a9849e9ced3b tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:06.360157 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ac05503c-9c4a-43df-8fef-a9849e9ced3b tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:06.577162 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-ac05503c-9c4a-43df-8fef-a9849e9ced3b tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:06.586592 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-ac05503c-9c4a-43df-8fef-a9849e9ced3b tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75" status: 200 len: 1555 microversion: 2.1 time: 0.246159 Dec 16 14:59:06.587190 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 335/656] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:59:06 2021] GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75 => generated 1555 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:59:06.922004 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-b8c2ca13-c828-4fa2-ac11-d6698ebc5611 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:59:06.923189 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-b8c2ca13-c828-4fa2-ac11-d6698ebc5611 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:59:06.932197 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b8c2ca13-c828-4fa2-ac11-d6698ebc5611 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:06.932706 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b8c2ca13-c828-4fa2-ac11-d6698ebc5611 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:06.933560 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b8c2ca13-c828-4fa2-ac11-d6698ebc5611 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:06.934109 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b8c2ca13-c828-4fa2-ac11-d6698ebc5611 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:07.141815 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-b8c2ca13-c828-4fa2-ac11-d6698ebc5611 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 200 len: 36741 microversion: 2.20 time: 0.227864 Dec 16 14:59:07.142576 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 322/657] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:59:06 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 36741 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:59:07.193162 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-1ee8ed89-6d70-47de-8db2-32976d1f0117 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:59:07.194245 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-1ee8ed89-6d70-47de-8db2-32976d1f0117 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:59:07.202977 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1ee8ed89-6d70-47de-8db2-32976d1f0117 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:07.203490 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1ee8ed89-6d70-47de-8db2-32976d1f0117 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:07.204329 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1ee8ed89-6d70-47de-8db2-32976d1f0117 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:07.204821 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1ee8ed89-6d70-47de-8db2-32976d1f0117 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:07.376562 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-1ee8ed89-6d70-47de-8db2-32976d1f0117 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 37282 microversion: 2.1 time: 0.190764 Dec 16 14:59:07.377512 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 336/658] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:59:07 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 37282 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:59:07.609644 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-1df0f043-1d38-40cd-85fa-6fa5f5540443 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:59:07.610442 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-1df0f043-1d38-40cd-85fa-6fa5f5540443 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: 407dd6f1-6f0a-41ba-80e2-9ebe4630fa75] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:59:07.619731 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1df0f043-1d38-40cd-85fa-6fa5f5540443 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:07.620243 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1df0f043-1d38-40cd-85fa-6fa5f5540443 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:07.621090 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1df0f043-1d38-40cd-85fa-6fa5f5540443 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:07.621595 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1df0f043-1d38-40cd-85fa-6fa5f5540443 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:07.836615 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-1df0f043-1d38-40cd-85fa-6fa5f5540443 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:07.845943 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-1df0f043-1d38-40cd-85fa-6fa5f5540443 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75" status: 200 len: 1555 microversion: 2.1 time: 0.245055 Dec 16 14:59:07.846572 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 323/659] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:59:07 2021] GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75 => generated 1555 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:59:08.158918 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-00428977-b75b-446e-9cc6-7e45e5ceeb8d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:59:08.160049 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-00428977-b75b-446e-9cc6-7e45e5ceeb8d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:59:08.168564 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-00428977-b75b-446e-9cc6-7e45e5ceeb8d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:08.169071 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-00428977-b75b-446e-9cc6-7e45e5ceeb8d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:08.169908 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-00428977-b75b-446e-9cc6-7e45e5ceeb8d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:08.170434 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-00428977-b75b-446e-9cc6-7e45e5ceeb8d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:08.323610 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-00428977-b75b-446e-9cc6-7e45e5ceeb8d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 200 len: 37650 microversion: 2.20 time: 0.172784 Dec 16 14:59:08.325843 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 337/660] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:59:08 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 37650 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:59:08.393018 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-af98e089-e201-419e-a055-7194ecc2b45b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:59:08.394075 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-af98e089-e201-419e-a055-7194ecc2b45b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:59:08.401892 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-af98e089-e201-419e-a055-7194ecc2b45b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:08.402433 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-af98e089-e201-419e-a055-7194ecc2b45b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:08.403280 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-af98e089-e201-419e-a055-7194ecc2b45b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:08.403775 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-af98e089-e201-419e-a055-7194ecc2b45b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:08.552622 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-af98e089-e201-419e-a055-7194ecc2b45b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 38120 microversion: 2.1 time: 0.167140 Dec 16 14:59:08.553326 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 324/661] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:59:08 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 38120 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:59:08.869046 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-9918fa48-8560-4826-9307-d26212d525bc tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:59:08.869867 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-9918fa48-8560-4826-9307-d26212d525bc tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: 407dd6f1-6f0a-41ba-80e2-9ebe4630fa75] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:59:08.878905 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9918fa48-8560-4826-9307-d26212d525bc tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:08.879414 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9918fa48-8560-4826-9307-d26212d525bc tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:08.880253 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9918fa48-8560-4826-9307-d26212d525bc tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:08.880748 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9918fa48-8560-4826-9307-d26212d525bc tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:09.105465 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-9918fa48-8560-4826-9307-d26212d525bc tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:09.115015 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-9918fa48-8560-4826-9307-d26212d525bc tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75" status: 200 len: 1555 microversion: 2.1 time: 0.254052 Dec 16 14:59:09.115620 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 338/662] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:59:08 2021] GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75 => generated 1555 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:59:09.341636 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-26a9dafe-46d0-483b-922a-2b3df41d9185 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:59:09.342815 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-26a9dafe-46d0-483b-922a-2b3df41d9185 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:59:09.351493 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-26a9dafe-46d0-483b-922a-2b3df41d9185 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:09.352007 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-26a9dafe-46d0-483b-922a-2b3df41d9185 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:09.352929 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-26a9dafe-46d0-483b-922a-2b3df41d9185 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:09.353426 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-26a9dafe-46d0-483b-922a-2b3df41d9185 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:09.513646 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-26a9dafe-46d0-483b-922a-2b3df41d9185 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 200 len: 38128 microversion: 2.20 time: 0.180611 Dec 16 14:59:09.514385 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 325/663] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:59:09 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 38128 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:59:09.568832 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-fdeda6d6-694a-47f1-88fc-f7f342935c93 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:59:09.569854 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-fdeda6d6-694a-47f1-88fc-f7f342935c93 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:59:09.578569 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fdeda6d6-694a-47f1-88fc-f7f342935c93 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:09.579073 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fdeda6d6-694a-47f1-88fc-f7f342935c93 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:09.579894 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fdeda6d6-694a-47f1-88fc-f7f342935c93 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:09.580382 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fdeda6d6-694a-47f1-88fc-f7f342935c93 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:09.723880 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-fdeda6d6-694a-47f1-88fc-f7f342935c93 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 38120 microversion: 2.1 time: 0.162584 Dec 16 14:59:09.724558 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 339/664] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:59:09 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 38120 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:59:10.138403 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-e55ec64b-c284-477e-abee-6d8c174bc2df tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:59:10.141455 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-e55ec64b-c284-477e-abee-6d8c174bc2df tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: 407dd6f1-6f0a-41ba-80e2-9ebe4630fa75] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:59:10.147677 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e55ec64b-c284-477e-abee-6d8c174bc2df tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:10.148189 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e55ec64b-c284-477e-abee-6d8c174bc2df tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:10.149168 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e55ec64b-c284-477e-abee-6d8c174bc2df tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:10.150213 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e55ec64b-c284-477e-abee-6d8c174bc2df tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:10.365968 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-e55ec64b-c284-477e-abee-6d8c174bc2df tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:10.376025 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-e55ec64b-c284-477e-abee-6d8c174bc2df tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75" status: 200 len: 1555 microversion: 2.1 time: 0.246337 Dec 16 14:59:10.376612 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 326/665] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:59:10 2021] GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75 => generated 1555 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:59:10.530445 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-3e32fee5-8a08-4674-9e5b-0033f4444994 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:59:10.531559 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-3e32fee5-8a08-4674-9e5b-0033f4444994 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:59:10.540377 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3e32fee5-8a08-4674-9e5b-0033f4444994 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:10.540870 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3e32fee5-8a08-4674-9e5b-0033f4444994 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:10.541691 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3e32fee5-8a08-4674-9e5b-0033f4444994 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:10.542221 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3e32fee5-8a08-4674-9e5b-0033f4444994 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:10.697101 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-3e32fee5-8a08-4674-9e5b-0033f4444994 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 200 len: 38128 microversion: 2.20 time: 0.174427 Dec 16 14:59:10.701826 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 340/666] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:59:10 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 38128 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:59:10.740362 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-ec43aee8-aaa0-464f-a796-cf1eca321b0d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:59:10.741456 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-ec43aee8-aaa0-464f-a796-cf1eca321b0d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:59:10.749892 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ec43aee8-aaa0-464f-a796-cf1eca321b0d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:10.750436 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ec43aee8-aaa0-464f-a796-cf1eca321b0d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:10.751282 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ec43aee8-aaa0-464f-a796-cf1eca321b0d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:10.751782 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ec43aee8-aaa0-464f-a796-cf1eca321b0d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:10.913464 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-ec43aee8-aaa0-464f-a796-cf1eca321b0d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 38120 microversion: 2.1 time: 0.180557 Dec 16 14:59:10.914105 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 327/667] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:59:10 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 38120 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:59:11.399257 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-9b4e9518-f177-4e46-9a4f-ffce6f4d022e tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:59:11.400024 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-9b4e9518-f177-4e46-9a4f-ffce6f4d022e tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: 407dd6f1-6f0a-41ba-80e2-9ebe4630fa75] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:59:11.408491 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9b4e9518-f177-4e46-9a4f-ffce6f4d022e tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:11.408991 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9b4e9518-f177-4e46-9a4f-ffce6f4d022e tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:11.409823 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9b4e9518-f177-4e46-9a4f-ffce6f4d022e tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:11.410335 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9b4e9518-f177-4e46-9a4f-ffce6f4d022e tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:11.629043 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-9b4e9518-f177-4e46-9a4f-ffce6f4d022e tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:11.638379 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-9b4e9518-f177-4e46-9a4f-ffce6f4d022e tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75" status: 200 len: 1561 microversion: 2.1 time: 0.247195 Dec 16 14:59:11.638976 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 341/668] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:59:11 2021] GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75 => generated 1561 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:59:11.715855 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-88df4650-ea23-454b-bb1d-5a10862cd3b2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:59:11.717004 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-88df4650-ea23-454b-bb1d-5a10862cd3b2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:59:11.725589 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-88df4650-ea23-454b-bb1d-5a10862cd3b2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:11.726138 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-88df4650-ea23-454b-bb1d-5a10862cd3b2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:11.726995 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-88df4650-ea23-454b-bb1d-5a10862cd3b2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:11.729336 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-88df4650-ea23-454b-bb1d-5a10862cd3b2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:11.761865 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-8aee60b5-40fa-439b-bfa4-bcfea0ba98bb tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:59:11.762439 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-8aee60b5-40fa-439b-bfa4-bcfea0ba98bb tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: 407dd6f1-6f0a-41ba-80e2-9ebe4630fa75] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:59:11.770199 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8aee60b5-40fa-439b-bfa4-bcfea0ba98bb tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:11.770708 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8aee60b5-40fa-439b-bfa4-bcfea0ba98bb tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:11.771556 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8aee60b5-40fa-439b-bfa4-bcfea0ba98bb tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:11.772034 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8aee60b5-40fa-439b-bfa4-bcfea0ba98bb tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:11.889663 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-88df4650-ea23-454b-bb1d-5a10862cd3b2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 200 len: 38128 microversion: 2.20 time: 0.182970 Dec 16 14:59:11.894360 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 328/669] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:59:11 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 38128 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:59:11.931758 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-80f61b1a-f47b-427b-8079-832f4cfdffb2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:59:11.932907 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-80f61b1a-f47b-427b-8079-832f4cfdffb2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:59:11.941445 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-80f61b1a-f47b-427b-8079-832f4cfdffb2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:11.946710 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-80f61b1a-f47b-427b-8079-832f4cfdffb2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:11.947616 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-80f61b1a-f47b-427b-8079-832f4cfdffb2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:11.948116 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-80f61b1a-f47b-427b-8079-832f4cfdffb2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:12.109858 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-80f61b1a-f47b-427b-8079-832f4cfdffb2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 38251 microversion: 2.1 time: 0.186941 Dec 16 14:59:12.110525 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 329/670] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 14:59:11 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 38251 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 14:59:12.125214 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-326a22c2-adaa-4583-9bae-053b55775fdf tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:59:12.125885 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-326a22c2-adaa-4583-9bae-053b55775fdf tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:59:12.128957 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-8aee60b5-40fa-439b-bfa4-bcfea0ba98bb tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "DELETE /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75/os-volume_attachments/40b9a675-f042-44be-8b73-5ae2d78124b6" status: 202 len: 0 microversion: 2.1 time: 0.374835 Dec 16 14:59:12.133112 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 342/671] 10.222.0.45 () {58 vars in 1406 bytes} [Thu Dec 16 14:59:11 2021] DELETE /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75/os-volume_attachments/40b9a675-f042-44be-8b73-5ae2d78124b6 => generated 0 bytes in 380 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:59:12.134536 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-326a22c2-adaa-4583-9bae-053b55775fdf tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:12.135020 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-326a22c2-adaa-4583-9bae-053b55775fdf tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:12.135873 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-326a22c2-adaa-4583-9bae-053b55775fdf tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:12.136357 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-326a22c2-adaa-4583-9bae-053b55775fdf tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:12.143662 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-3e0f1e93-0e93-4c56-b557-3fc5ce33274c tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:59:12.144899 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-3e0f1e93-0e93-4c56-b557-3fc5ce33274c tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: 407dd6f1-6f0a-41ba-80e2-9ebe4630fa75] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:59:12.153014 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3e0f1e93-0e93-4c56-b557-3fc5ce33274c tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:12.153528 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3e0f1e93-0e93-4c56-b557-3fc5ce33274c tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:12.154397 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3e0f1e93-0e93-4c56-b557-3fc5ce33274c tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:12.154991 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3e0f1e93-0e93-4c56-b557-3fc5ce33274c tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:12.200997 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-326a22c2-adaa-4583-9bae-053b55775fdf tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/ips" status: 200 len: 146 microversion: 2.1 time: 0.084078 Dec 16 14:59:12.210103 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 330/672] 10.222.0.45 () {58 vars in 1238 bytes} [Thu Dec 16 14:59:12 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/ips => generated 146 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 14:59:12.235971 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-3e0f1e93-0e93-4c56-b557-3fc5ce33274c tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.101551 Dec 16 14:59:12.236601 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 343/673] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 14:59:12 2021] GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75/os-volume_attachments => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:59:12.906786 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-ed91965c-3048-4604-8b7b-a94d4c9f7115 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:59:12.907989 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-ed91965c-3048-4604-8b7b-a94d4c9f7115 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:59:12.916600 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ed91965c-3048-4604-8b7b-a94d4c9f7115 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:12.917374 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ed91965c-3048-4604-8b7b-a94d4c9f7115 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:12.918352 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ed91965c-3048-4604-8b7b-a94d4c9f7115 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:12.918918 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ed91965c-3048-4604-8b7b-a94d4c9f7115 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:13.094187 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-ed91965c-3048-4604-8b7b-a94d4c9f7115 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 200 len: 38269 microversion: 2.20 time: 0.195274 Dec 16 14:59:13.094834 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 331/674] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:59:12 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 38269 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 14:59:13.109844 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-16f00a58-9c6f-447e-b449-3759965a03b9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:59:13.110422 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-16f00a58-9c6f-447e-b449-3759965a03b9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:59:13.119401 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-16f00a58-9c6f-447e-b449-3759965a03b9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:13.119896 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-16f00a58-9c6f-447e-b449-3759965a03b9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:13.120738 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-16f00a58-9c6f-447e-b449-3759965a03b9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:13.121233 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-16f00a58-9c6f-447e-b449-3759965a03b9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:13.185476 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-16f00a58-9c6f-447e-b449-3759965a03b9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/ips" status: 200 len: 150 microversion: 2.20 time: 0.083768 Dec 16 14:59:13.186121 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 344/675] 10.222.0.45 () {60 vars in 1279 bytes} [Thu Dec 16 14:59:13 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/ips => generated 150 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 14:59:13.253586 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-9b6f1e14-7470-488f-8808-ce936cb095e5 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:59:13.254792 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-9b6f1e14-7470-488f-8808-ce936cb095e5 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: 407dd6f1-6f0a-41ba-80e2-9ebe4630fa75] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:59:13.264332 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9b6f1e14-7470-488f-8808-ce936cb095e5 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:13.264826 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9b6f1e14-7470-488f-8808-ce936cb095e5 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:13.265683 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9b6f1e14-7470-488f-8808-ce936cb095e5 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:13.266212 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9b6f1e14-7470-488f-8808-ce936cb095e5 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:13.339474 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-9b6f1e14-7470-488f-8808-ce936cb095e5 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094283 Dec 16 14:59:13.340422 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 332/676] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 14:59:13 2021] GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:59:14.356025 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-fc86b3e6-e3fd-46c4-a35e-232d2375f484 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:59:14.357652 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-fc86b3e6-e3fd-46c4-a35e-232d2375f484 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: 407dd6f1-6f0a-41ba-80e2-9ebe4630fa75] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:59:14.366111 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fc86b3e6-e3fd-46c4-a35e-232d2375f484 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:14.366604 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fc86b3e6-e3fd-46c4-a35e-232d2375f484 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:14.367459 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fc86b3e6-e3fd-46c4-a35e-232d2375f484 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:14.367933 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fc86b3e6-e3fd-46c4-a35e-232d2375f484 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:14.439606 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-fc86b3e6-e3fd-46c4-a35e-232d2375f484 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.091386 Dec 16 14:59:14.440149 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 345/677] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 14:59:14 2021] GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75/os-volume_attachments => generated 25 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 14:59:17.057013 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-0f1ce010-d799-4091-b0b6-3b6db95a7a7e tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e38aef8f-bdd5-41fa-94f0-73f0a05837d3", "device": "/dev/sdb"}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:59:17.058756 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-0f1ce010-d799-4091-b0b6-3b6db95a7a7e tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] [instance: 64774bdb-b85b-4d86-9110-0b37d9c15bed] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:59:17.067006 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0f1ce010-d799-4091-b0b6-3b6db95a7a7e tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:17.070432 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0f1ce010-d799-4091-b0b6-3b6db95a7a7e tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:17.070432 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0f1ce010-d799-4091-b0b6-3b6db95a7a7e tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:17.070432 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0f1ce010-d799-4091-b0b6-3b6db95a7a7e tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:17.179063 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-fb4beb93-b3dc-44a0-becf-1ea0a5e38451 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:59:17.179693 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-fb4beb93-b3dc-44a0-becf-1ea0a5e38451 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:59:17.188603 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fb4beb93-b3dc-44a0-becf-1ea0a5e38451 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:17.189106 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fb4beb93-b3dc-44a0-becf-1ea0a5e38451 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:17.189941 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fb4beb93-b3dc-44a0-becf-1ea0a5e38451 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:17.190459 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fb4beb93-b3dc-44a0-becf-1ea0a5e38451 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:17.263455 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.objects.instance [None req-fb4beb93-b3dc-44a0-becf-1ea0a5e38451 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lazy-loading 'flavor' on Instance uuid cd5ffc87-035a-4e91-8fb5-8e44ed5704ac {{(pid=101356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 16 14:59:17.787822 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-0f1ce010-d799-4091-b0b6-3b6db95a7a7e tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] 10.222.0.45 "POST /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.738879 Dec 16 14:59:17.788553 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 333/678] 10.222.0.45 () {60 vars in 1313 bytes} [Thu Dec 16 14:59:17 2021] POST /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed/os-volume_attachments => generated 194 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:59:17.798772 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-3664b0d4-1530-43ab-a328-b8337022f33a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dda26be8-4e33-4a32-a210-946feea43411"}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:59:17.800033 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-3664b0d4-1530-43ab-a328-b8337022f33a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:59:17.809472 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3664b0d4-1530-43ab-a328-b8337022f33a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:17.810075 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3664b0d4-1530-43ab-a328-b8337022f33a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:17.810975 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3664b0d4-1530-43ab-a328-b8337022f33a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:17.811475 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3664b0d4-1530-43ab-a328-b8337022f33a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:17.847465 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-fb4beb93-b3dc-44a0-becf-1ea0a5e38451 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 202 len: 0 microversion: 2.20 time: 0.675884 Dec 16 14:59:17.848350 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 346/679] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 14:59:17 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 0 bytes in 678 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Dec 16 14:59:17.862010 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-10d4353f-a827-4e9b-ad1d-02a0f0ce2494 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:59:17.862801 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-10d4353f-a827-4e9b-ad1d-02a0f0ce2494 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:59:17.874191 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-10d4353f-a827-4e9b-ad1d-02a0f0ce2494 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:17.874696 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-10d4353f-a827-4e9b-ad1d-02a0f0ce2494 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:17.875564 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-10d4353f-a827-4e9b-ad1d-02a0f0ce2494 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:17.876218 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-10d4353f-a827-4e9b-ad1d-02a0f0ce2494 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:18.123733 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-10d4353f-a827-4e9b-ad1d-02a0f0ce2494 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:18.136189 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-10d4353f-a827-4e9b-ad1d-02a0f0ce2494 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:18.140648 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-10d4353f-a827-4e9b-ad1d-02a0f0ce2494 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:18.141878 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-10d4353f-a827-4e9b-ad1d-02a0f0ce2494 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1720 microversion: 2.20 time: 0.288762 Dec 16 14:59:18.142499 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 347/680] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 14:59:17 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1720 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:59:18.703385 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-3664b0d4-1530-43ab-a328-b8337022f33a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.913111 Dec 16 14:59:18.704074 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 334/681] 10.222.0.45 () {60 vars in 1313 bytes} [Thu Dec 16 14:59:17 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 194 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:59:19.167088 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-9eb2338e-92ce-4b13-a374-ccd32ad4c2fa tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:59:19.167672 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-9eb2338e-92ce-4b13-a374-ccd32ad4c2fa tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:59:19.175742 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9eb2338e-92ce-4b13-a374-ccd32ad4c2fa tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:19.176244 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9eb2338e-92ce-4b13-a374-ccd32ad4c2fa tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:19.177139 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9eb2338e-92ce-4b13-a374-ccd32ad4c2fa tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:19.177620 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9eb2338e-92ce-4b13-a374-ccd32ad4c2fa tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:19.402330 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-2b48deb3-e6ff-4e3c-8b51-14719eb6eb8f tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:59:19.403034 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-2b48deb3-e6ff-4e3c-8b51-14719eb6eb8f tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: bcaa83bc-5d07-413a-88e5-b7428a5b5d46] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:59:19.405713 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-9eb2338e-92ce-4b13-a374-ccd32ad4c2fa tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:19.412571 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2b48deb3-e6ff-4e3c-8b51-14719eb6eb8f tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:19.412913 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2b48deb3-e6ff-4e3c-8b51-14719eb6eb8f tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:19.413768 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2b48deb3-e6ff-4e3c-8b51-14719eb6eb8f tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:19.416795 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2b48deb3-e6ff-4e3c-8b51-14719eb6eb8f tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:19.428710 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-9eb2338e-92ce-4b13-a374-ccd32ad4c2fa tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:19.433203 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-9eb2338e-92ce-4b13-a374-ccd32ad4c2fa tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:19.434419 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-9eb2338e-92ce-4b13-a374-ccd32ad4c2fa tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1720 microversion: 2.20 time: 0.276318 Dec 16 14:59:19.435206 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 348/682] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 14:59:19 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1720 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:59:19.485241 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-2b48deb3-e6ff-4e3c-8b51-14719eb6eb8f tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: bcaa83bc-5d07-413a-88e5-b7428a5b5d46] Going to try to terminate instance {{(pid=101355) delete /opt/stack/nova/nova/compute/api.py:2496}} Dec 16 14:59:19.684281 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-2b48deb3-e6ff-4e3c-8b51-14719eb6eb8f tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "DELETE /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46" status: 204 len: 0 microversion: 2.1 time: 0.290880 Dec 16 14:59:19.684760 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 335/683] 10.222.0.45 () {58 vars in 1229 bytes} [Thu Dec 16 14:59:19 2021] DELETE /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 16 14:59:19.696657 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-a1711caa-3ae2-4160-9dc6-8a486a53aa52 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:59:19.697321 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-a1711caa-3ae2-4160-9dc6-8a486a53aa52 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: bcaa83bc-5d07-413a-88e5-b7428a5b5d46] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:59:19.705364 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a1711caa-3ae2-4160-9dc6-8a486a53aa52 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:19.705877 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a1711caa-3ae2-4160-9dc6-8a486a53aa52 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:19.706760 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a1711caa-3ae2-4160-9dc6-8a486a53aa52 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:19.707252 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a1711caa-3ae2-4160-9dc6-8a486a53aa52 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:19.928388 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-a1711caa-3ae2-4160-9dc6-8a486a53aa52 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:19.937486 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-a1711caa-3ae2-4160-9dc6-8a486a53aa52 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46" status: 200 len: 1507 microversion: 2.1 time: 0.248212 Dec 16 14:59:19.938067 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 349/684] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:59:19 2021] GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46 => generated 1507 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:59:20.458018 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-338aa789-0775-4174-bd3f-03f078fdb22f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:59:20.458811 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-338aa789-0775-4174-bd3f-03f078fdb22f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:59:20.466673 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-338aa789-0775-4174-bd3f-03f078fdb22f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:20.467183 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-338aa789-0775-4174-bd3f-03f078fdb22f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:20.468016 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-338aa789-0775-4174-bd3f-03f078fdb22f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:20.468507 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-338aa789-0775-4174-bd3f-03f078fdb22f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:20.690808 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-338aa789-0775-4174-bd3f-03f078fdb22f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:20.703230 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-338aa789-0775-4174-bd3f-03f078fdb22f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:20.707722 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-338aa789-0775-4174-bd3f-03f078fdb22f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:20.708907 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-338aa789-0775-4174-bd3f-03f078fdb22f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1720 microversion: 2.20 time: 0.259459 Dec 16 14:59:20.709498 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 336/685] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 14:59:20 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1720 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:59:20.959733 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-d7594f5e-6f01-4510-9d99-5f6311d0a49b tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:59:20.960342 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-d7594f5e-6f01-4510-9d99-5f6311d0a49b tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: bcaa83bc-5d07-413a-88e5-b7428a5b5d46] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:59:20.968657 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d7594f5e-6f01-4510-9d99-5f6311d0a49b tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:20.969164 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d7594f5e-6f01-4510-9d99-5f6311d0a49b tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:20.970005 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d7594f5e-6f01-4510-9d99-5f6311d0a49b tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:20.970526 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d7594f5e-6f01-4510-9d99-5f6311d0a49b tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:21.193507 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-d7594f5e-6f01-4510-9d99-5f6311d0a49b tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:21.202579 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-d7594f5e-6f01-4510-9d99-5f6311d0a49b tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46" status: 200 len: 1507 microversion: 2.1 time: 0.250591 Dec 16 14:59:21.203180 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 350/686] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:59:20 2021] GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46 => generated 1507 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:59:21.733685 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-ca929aa4-9570-435c-a073-9e81690f1ac5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:59:21.734380 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-ca929aa4-9570-435c-a073-9e81690f1ac5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:59:21.743413 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ca929aa4-9570-435c-a073-9e81690f1ac5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:21.748173 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ca929aa4-9570-435c-a073-9e81690f1ac5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:21.748173 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ca929aa4-9570-435c-a073-9e81690f1ac5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:21.748173 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ca929aa4-9570-435c-a073-9e81690f1ac5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:21.957547 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-ca929aa4-9570-435c-a073-9e81690f1ac5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:21.970403 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-ca929aa4-9570-435c-a073-9e81690f1ac5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:21.974944 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-ca929aa4-9570-435c-a073-9e81690f1ac5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:21.976131 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-ca929aa4-9570-435c-a073-9e81690f1ac5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1720 microversion: 2.20 time: 0.250921 Dec 16 14:59:21.976721 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 337/687] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 14:59:21 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1720 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:59:22.224330 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-d969cacd-6b41-4cd0-8df6-1caa9911e83a tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:59:22.224926 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-d969cacd-6b41-4cd0-8df6-1caa9911e83a tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: bcaa83bc-5d07-413a-88e5-b7428a5b5d46] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:59:22.232868 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d969cacd-6b41-4cd0-8df6-1caa9911e83a tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:22.233373 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d969cacd-6b41-4cd0-8df6-1caa9911e83a tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:22.234243 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d969cacd-6b41-4cd0-8df6-1caa9911e83a tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:22.234733 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d969cacd-6b41-4cd0-8df6-1caa9911e83a tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:22.456683 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-d969cacd-6b41-4cd0-8df6-1caa9911e83a tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:22.466362 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-d969cacd-6b41-4cd0-8df6-1caa9911e83a tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46" status: 200 len: 1507 microversion: 2.1 time: 0.249751 Dec 16 14:59:22.466961 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 351/688] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:59:22 2021] GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46 => generated 1507 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:59:22.999251 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-d4591a7c-9529-4111-8fea-514f650dd6f1 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:59:22.999852 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-d4591a7c-9529-4111-8fea-514f650dd6f1 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:59:23.007663 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d4591a7c-9529-4111-8fea-514f650dd6f1 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:23.008179 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d4591a7c-9529-4111-8fea-514f650dd6f1 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:23.009678 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d4591a7c-9529-4111-8fea-514f650dd6f1 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:23.010205 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d4591a7c-9529-4111-8fea-514f650dd6f1 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:23.233737 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-d4591a7c-9529-4111-8fea-514f650dd6f1 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:23.246281 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-d4591a7c-9529-4111-8fea-514f650dd6f1 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:23.250805 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-d4591a7c-9529-4111-8fea-514f650dd6f1 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:23.251946 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-d4591a7c-9529-4111-8fea-514f650dd6f1 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1720 microversion: 2.20 time: 0.261307 Dec 16 14:59:23.252527 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 338/689] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 14:59:22 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1720 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:59:23.488424 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-61e2521e-4d46-48c2-ac31-15b780958a6f tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:59:23.489190 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-61e2521e-4d46-48c2-ac31-15b780958a6f tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: bcaa83bc-5d07-413a-88e5-b7428a5b5d46] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:59:23.497967 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-61e2521e-4d46-48c2-ac31-15b780958a6f tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:23.498506 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-61e2521e-4d46-48c2-ac31-15b780958a6f tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:23.499350 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-61e2521e-4d46-48c2-ac31-15b780958a6f tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:23.499843 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-61e2521e-4d46-48c2-ac31-15b780958a6f tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:23.718892 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-61e2521e-4d46-48c2-ac31-15b780958a6f tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:23.727744 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-61e2521e-4d46-48c2-ac31-15b780958a6f tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46" status: 200 len: 1507 microversion: 2.1 time: 0.246865 Dec 16 14:59:23.728341 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 352/690] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:59:23 2021] GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46 => generated 1507 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:59:24.168561 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [req-6c2d0591-a91d-4934-95c7-0bd5a8f3a0b2 req-04449d1f-38fe-4cde-9a00-3620f4f0293f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcaa83bc-5d07-413a-88e5-b7428a5b5d46", "name": "network-vif-deleted", "tag": "bfc221af-2174-4f65-91cd-8eeec277367d"}]} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:59:24.173773 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:59:24.173773 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: warnings.warn(msg) Dec 16 14:59:24.185280 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-6c2d0591-a91d-4934-95c7-0bd5a8f3a0b2 req-04449d1f-38fe-4cde-9a00-3620f4f0293f service nova] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:24.186104 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-6c2d0591-a91d-4934-95c7-0bd5a8f3a0b2 req-04449d1f-38fe-4cde-9a00-3620f4f0293f service nova] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:24.207479 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.compute.server_external_events [req-6c2d0591-a91d-4934-95c7-0bd5a8f3a0b2 req-04449d1f-38fe-4cde-9a00-3620f4f0293f service nova] Creating event network-vif-deleted:bfc221af-2174-4f65-91cd-8eeec277367d for instance bcaa83bc-5d07-413a-88e5-b7428a5b5d46 on hv-cinder-82189 Dec 16 14:59:24.212670 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [req-6c2d0591-a91d-4934-95c7-0bd5a8f3a0b2 req-04449d1f-38fe-4cde-9a00-3620f4f0293f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053040 Dec 16 14:59:24.214172 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 339/691] 10.222.0.45 () {64 vars in 1308 bytes} [Thu Dec 16 14:59:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:59:24.276204 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-df4cc1d1-2469-40c2-94f1-0ac6e2951bae tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:59:24.287686 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-df4cc1d1-2469-40c2-94f1-0ac6e2951bae tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:59:24.296235 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-df4cc1d1-2469-40c2-94f1-0ac6e2951bae tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:24.296841 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-df4cc1d1-2469-40c2-94f1-0ac6e2951bae tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:24.297770 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-df4cc1d1-2469-40c2-94f1-0ac6e2951bae tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:24.298399 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-df4cc1d1-2469-40c2-94f1-0ac6e2951bae tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:24.542446 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-df4cc1d1-2469-40c2-94f1-0ac6e2951bae tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:24.554651 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-df4cc1d1-2469-40c2-94f1-0ac6e2951bae tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:24.560190 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-df4cc1d1-2469-40c2-94f1-0ac6e2951bae tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:24.561410 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-df4cc1d1-2469-40c2-94f1-0ac6e2951bae tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1720 microversion: 2.20 time: 0.293599 Dec 16 14:59:24.561982 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 353/692] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 14:59:24 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1720 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:59:24.750115 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-4d6f0ca9-3a75-4e81-9d8c-d97d99fdbbd9 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:59:24.750829 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-4d6f0ca9-3a75-4e81-9d8c-d97d99fdbbd9 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: bcaa83bc-5d07-413a-88e5-b7428a5b5d46] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:59:24.759540 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4d6f0ca9-3a75-4e81-9d8c-d97d99fdbbd9 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:24.760050 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4d6f0ca9-3a75-4e81-9d8c-d97d99fdbbd9 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:24.760891 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4d6f0ca9-3a75-4e81-9d8c-d97d99fdbbd9 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:24.761384 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4d6f0ca9-3a75-4e81-9d8c-d97d99fdbbd9 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:24.837524 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4d6f0ca9-3a75-4e81-9d8c-d97d99fdbbd9 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:24.838028 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4d6f0ca9-3a75-4e81-9d8c-d97d99fdbbd9 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:24.838543 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.objects.instance [None req-4d6f0ca9-3a75-4e81-9d8c-d97d99fdbbd9 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lazy-loading 'fault' on Instance uuid bcaa83bc-5d07-413a-88e5-b7428a5b5d46 {{(pid=101355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 16 14:59:24.960076 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-4d6f0ca9-3a75-4e81-9d8c-d97d99fdbbd9 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:24.970453 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-4d6f0ca9-3a75-4e81-9d8c-d97d99fdbbd9 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46" status: 200 len: 1312 microversion: 2.1 time: 0.229125 Dec 16 14:59:24.971191 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 340/693] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:59:24 2021] GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46 => generated 1312 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:59:25.586633 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-8ac2bf82-7f0d-4e16-818a-8f5118cf0e48 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:59:25.587374 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-8ac2bf82-7f0d-4e16-818a-8f5118cf0e48 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:59:25.595144 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8ac2bf82-7f0d-4e16-818a-8f5118cf0e48 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:25.595649 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8ac2bf82-7f0d-4e16-818a-8f5118cf0e48 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:25.596476 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8ac2bf82-7f0d-4e16-818a-8f5118cf0e48 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:25.596965 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8ac2bf82-7f0d-4e16-818a-8f5118cf0e48 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:25.813792 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-8ac2bf82-7f0d-4e16-818a-8f5118cf0e48 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:25.825864 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-8ac2bf82-7f0d-4e16-818a-8f5118cf0e48 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:25.830667 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-8ac2bf82-7f0d-4e16-818a-8f5118cf0e48 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:25.831848 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-8ac2bf82-7f0d-4e16-818a-8f5118cf0e48 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1720 microversion: 2.20 time: 0.252809 Dec 16 14:59:25.832436 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 354/694] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 14:59:25 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1720 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:59:25.993321 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-ff468d53-fe02-4557-a37d-d15d40be65f8 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:59:25.994008 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-ff468d53-fe02-4557-a37d-d15d40be65f8 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: bcaa83bc-5d07-413a-88e5-b7428a5b5d46] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:59:26.003157 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ff468d53-fe02-4557-a37d-d15d40be65f8 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:26.003758 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ff468d53-fe02-4557-a37d-d15d40be65f8 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:26.004583 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ff468d53-fe02-4557-a37d-d15d40be65f8 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:26.005086 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ff468d53-fe02-4557-a37d-d15d40be65f8 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:26.058013 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.wsgi [None req-ff468d53-fe02-4557-a37d-d15d40be65f8 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] HTTP exception thrown: Instance bcaa83bc-5d07-413a-88e5-b7428a5b5d46 could not be found. Dec 16 14:59:26.058733 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-ff468d53-fe02-4557-a37d-d15d40be65f8 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Returning 404 to user: Instance bcaa83bc-5d07-413a-88e5-b7428a5b5d46 could not be found. {{(pid=101355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:941}} Dec 16 14:59:26.059638 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-ff468d53-fe02-4557-a37d-d15d40be65f8 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46" status: 404 len: 111 microversion: 2.1 time: 0.073998 Dec 16 14:59:26.060253 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 341/695] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:59:25 2021] GET /compute/v2.1/servers/bcaa83bc-5d07-413a-88e5-b7428a5b5d46 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 14:59:26.072857 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-6e70dc94-fdcd-47ee-8ae5-7d1c95fdc9c5 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:59:26.073462 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-6e70dc94-fdcd-47ee-8ae5-7d1c95fdc9c5 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: 407dd6f1-6f0a-41ba-80e2-9ebe4630fa75] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:59:26.081469 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6e70dc94-fdcd-47ee-8ae5-7d1c95fdc9c5 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:26.081975 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6e70dc94-fdcd-47ee-8ae5-7d1c95fdc9c5 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:26.083525 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6e70dc94-fdcd-47ee-8ae5-7d1c95fdc9c5 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:26.084221 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6e70dc94-fdcd-47ee-8ae5-7d1c95fdc9c5 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:26.155207 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-6e70dc94-fdcd-47ee-8ae5-7d1c95fdc9c5 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: 407dd6f1-6f0a-41ba-80e2-9ebe4630fa75] Going to try to terminate instance {{(pid=101356) delete /opt/stack/nova/nova/compute/api.py:2496}} Dec 16 14:59:26.403711 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-6e70dc94-fdcd-47ee-8ae5-7d1c95fdc9c5 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "DELETE /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75" status: 204 len: 0 microversion: 2.1 time: 0.338302 Dec 16 14:59:26.404351 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 355/696] 10.222.0.45 () {58 vars in 1229 bytes} [Thu Dec 16 14:59:26 2021] DELETE /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 16 14:59:26.417576 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-67ccf401-a656-4653-aa74-5ebcc3f2efba tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:59:26.418308 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-67ccf401-a656-4653-aa74-5ebcc3f2efba tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: 407dd6f1-6f0a-41ba-80e2-9ebe4630fa75] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:59:26.426118 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-67ccf401-a656-4653-aa74-5ebcc3f2efba tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:26.426685 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-67ccf401-a656-4653-aa74-5ebcc3f2efba tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:26.427765 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-67ccf401-a656-4653-aa74-5ebcc3f2efba tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:26.428332 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-67ccf401-a656-4653-aa74-5ebcc3f2efba tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:26.644887 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-67ccf401-a656-4653-aa74-5ebcc3f2efba tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:26.654630 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-67ccf401-a656-4653-aa74-5ebcc3f2efba tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75" status: 200 len: 1521 microversion: 2.1 time: 0.245783 Dec 16 14:59:26.655227 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 342/697] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:59:26 2021] GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75 => generated 1521 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:59:26.855872 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-9aba7bf8-6caf-4079-8322-a92f8c92478d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:59:26.857483 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-9aba7bf8-6caf-4079-8322-a92f8c92478d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:59:26.864429 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9aba7bf8-6caf-4079-8322-a92f8c92478d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:26.864924 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9aba7bf8-6caf-4079-8322-a92f8c92478d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:26.865747 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9aba7bf8-6caf-4079-8322-a92f8c92478d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:26.866257 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9aba7bf8-6caf-4079-8322-a92f8c92478d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:27.092515 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-9aba7bf8-6caf-4079-8322-a92f8c92478d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:27.105201 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-9aba7bf8-6caf-4079-8322-a92f8c92478d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:27.109671 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-9aba7bf8-6caf-4079-8322-a92f8c92478d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:27.110817 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-9aba7bf8-6caf-4079-8322-a92f8c92478d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1720 microversion: 2.20 time: 0.263407 Dec 16 14:59:27.111407 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 356/698] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 14:59:26 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1720 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:59:27.677645 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-0d3cb2f4-a91c-48c3-af9a-8918eb0ea7e1 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:59:27.678343 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-0d3cb2f4-a91c-48c3-af9a-8918eb0ea7e1 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: 407dd6f1-6f0a-41ba-80e2-9ebe4630fa75] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:59:27.686796 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0d3cb2f4-a91c-48c3-af9a-8918eb0ea7e1 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:27.687305 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0d3cb2f4-a91c-48c3-af9a-8918eb0ea7e1 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:27.688148 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0d3cb2f4-a91c-48c3-af9a-8918eb0ea7e1 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:27.688646 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0d3cb2f4-a91c-48c3-af9a-8918eb0ea7e1 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:27.905685 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-0d3cb2f4-a91c-48c3-af9a-8918eb0ea7e1 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:27.914517 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-0d3cb2f4-a91c-48c3-af9a-8918eb0ea7e1 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75" status: 200 len: 1521 microversion: 2.1 time: 0.244404 Dec 16 14:59:27.920070 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 343/699] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:59:27 2021] GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75 => generated 1521 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:59:28.134740 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-d3a58315-06fc-43cd-9081-6477071200d0 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:59:28.135404 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-d3a58315-06fc-43cd-9081-6477071200d0 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:59:28.143145 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d3a58315-06fc-43cd-9081-6477071200d0 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:28.143650 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d3a58315-06fc-43cd-9081-6477071200d0 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:28.144481 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d3a58315-06fc-43cd-9081-6477071200d0 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:28.144970 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d3a58315-06fc-43cd-9081-6477071200d0 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:28.364347 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-d3a58315-06fc-43cd-9081-6477071200d0 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:28.376719 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-d3a58315-06fc-43cd-9081-6477071200d0 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:28.381159 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-d3a58315-06fc-43cd-9081-6477071200d0 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:28.382366 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-d3a58315-06fc-43cd-9081-6477071200d0 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1720 microversion: 2.20 time: 0.255330 Dec 16 14:59:28.382951 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 357/700] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 14:59:28 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1720 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:59:28.940748 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-ee3455db-714a-40cd-991e-dec29d4a999c tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:59:28.941423 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-ee3455db-714a-40cd-991e-dec29d4a999c tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: 407dd6f1-6f0a-41ba-80e2-9ebe4630fa75] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:59:28.949776 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ee3455db-714a-40cd-991e-dec29d4a999c tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:28.950322 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ee3455db-714a-40cd-991e-dec29d4a999c tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:28.951172 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ee3455db-714a-40cd-991e-dec29d4a999c tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:28.951667 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ee3455db-714a-40cd-991e-dec29d4a999c tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:29.160820 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-ee3455db-714a-40cd-991e-dec29d4a999c tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:29.169649 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-ee3455db-714a-40cd-991e-dec29d4a999c tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75" status: 200 len: 1521 microversion: 2.1 time: 0.236620 Dec 16 14:59:29.170209 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 344/701] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:59:28 2021] GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75 => generated 1521 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:59:29.404617 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-65f9930f-41ae-4d2b-adb2-b97b66cdb590 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:59:29.405291 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-65f9930f-41ae-4d2b-adb2-b97b66cdb590 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:59:29.413581 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-65f9930f-41ae-4d2b-adb2-b97b66cdb590 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:29.414116 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-65f9930f-41ae-4d2b-adb2-b97b66cdb590 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:29.415496 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-65f9930f-41ae-4d2b-adb2-b97b66cdb590 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:29.415996 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-65f9930f-41ae-4d2b-adb2-b97b66cdb590 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:29.627132 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-65f9930f-41ae-4d2b-adb2-b97b66cdb590 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:29.639206 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-65f9930f-41ae-4d2b-adb2-b97b66cdb590 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:29.643614 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-65f9930f-41ae-4d2b-adb2-b97b66cdb590 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:29.644773 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-65f9930f-41ae-4d2b-adb2-b97b66cdb590 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1720 microversion: 2.20 time: 0.247770 Dec 16 14:59:29.645397 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 358/702] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 14:59:29 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1720 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:59:30.191184 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-d8bb01ca-15a3-41e3-aec4-f9f0b0edc59b tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:59:30.191851 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-d8bb01ca-15a3-41e3-aec4-f9f0b0edc59b tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: 407dd6f1-6f0a-41ba-80e2-9ebe4630fa75] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:59:30.200223 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d8bb01ca-15a3-41e3-aec4-f9f0b0edc59b tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:30.200729 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d8bb01ca-15a3-41e3-aec4-f9f0b0edc59b tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:30.201563 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d8bb01ca-15a3-41e3-aec4-f9f0b0edc59b tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:30.202344 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d8bb01ca-15a3-41e3-aec4-f9f0b0edc59b tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:30.421338 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-d8bb01ca-15a3-41e3-aec4-f9f0b0edc59b tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:30.430180 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-d8bb01ca-15a3-41e3-aec4-f9f0b0edc59b tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75" status: 200 len: 1521 microversion: 2.1 time: 0.246615 Dec 16 14:59:30.430809 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 345/703] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:59:30 2021] GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75 => generated 1521 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:59:30.668740 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-9f809885-5310-4336-a7b5-c6b27bab7cd9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:59:30.669395 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-9f809885-5310-4336-a7b5-c6b27bab7cd9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:59:30.677164 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9f809885-5310-4336-a7b5-c6b27bab7cd9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:30.677660 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9f809885-5310-4336-a7b5-c6b27bab7cd9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:30.678507 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9f809885-5310-4336-a7b5-c6b27bab7cd9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:30.678992 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9f809885-5310-4336-a7b5-c6b27bab7cd9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:30.894225 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-9f809885-5310-4336-a7b5-c6b27bab7cd9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:30.907067 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-9f809885-5310-4336-a7b5-c6b27bab7cd9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:30.911575 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-9f809885-5310-4336-a7b5-c6b27bab7cd9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:30.912749 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-9f809885-5310-4336-a7b5-c6b27bab7cd9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1720 microversion: 2.20 time: 0.252258 Dec 16 14:59:30.913330 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 359/704] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 14:59:30 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1720 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:59:31.453087 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-0b985710-bdb5-480e-bd79-16e8ab9b4bec tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:59:31.453682 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-0b985710-bdb5-480e-bd79-16e8ab9b4bec tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: 407dd6f1-6f0a-41ba-80e2-9ebe4630fa75] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:59:31.461464 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0b985710-bdb5-480e-bd79-16e8ab9b4bec tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:31.461973 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0b985710-bdb5-480e-bd79-16e8ab9b4bec tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:31.462858 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0b985710-bdb5-480e-bd79-16e8ab9b4bec tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:31.463343 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0b985710-bdb5-480e-bd79-16e8ab9b4bec tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:31.678788 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-0b985710-bdb5-480e-bd79-16e8ab9b4bec tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:31.688176 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-0b985710-bdb5-480e-bd79-16e8ab9b4bec tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75" status: 200 len: 1521 microversion: 2.1 time: 0.243841 Dec 16 14:59:31.688762 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 346/705] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:59:31 2021] GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75 => generated 1521 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:59:31.936582 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-de5ac934-d6c5-4d0a-b2c2-ce8ea5f2e520 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:59:31.937242 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-de5ac934-d6c5-4d0a-b2c2-ce8ea5f2e520 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:59:31.944994 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-de5ac934-d6c5-4d0a-b2c2-ce8ea5f2e520 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:31.945568 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-de5ac934-d6c5-4d0a-b2c2-ce8ea5f2e520 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:31.946421 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-de5ac934-d6c5-4d0a-b2c2-ce8ea5f2e520 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:31.946901 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-de5ac934-d6c5-4d0a-b2c2-ce8ea5f2e520 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:32.164795 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-de5ac934-d6c5-4d0a-b2c2-ce8ea5f2e520 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:32.176971 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-de5ac934-d6c5-4d0a-b2c2-ce8ea5f2e520 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:32.182051 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-de5ac934-d6c5-4d0a-b2c2-ce8ea5f2e520 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:32.183241 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-de5ac934-d6c5-4d0a-b2c2-ce8ea5f2e520 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1720 microversion: 2.20 time: 0.254321 Dec 16 14:59:32.183818 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 360/706] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 14:59:31 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1720 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:59:32.709922 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-d3e11dfd-726e-43a8-8a1d-ce0dfbf49cd8 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:59:32.710623 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-d3e11dfd-726e-43a8-8a1d-ce0dfbf49cd8 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: 407dd6f1-6f0a-41ba-80e2-9ebe4630fa75] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:59:32.718975 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d3e11dfd-726e-43a8-8a1d-ce0dfbf49cd8 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:32.719483 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d3e11dfd-726e-43a8-8a1d-ce0dfbf49cd8 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:32.720331 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d3e11dfd-726e-43a8-8a1d-ce0dfbf49cd8 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:32.720829 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d3e11dfd-726e-43a8-8a1d-ce0dfbf49cd8 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:32.930514 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-d3e11dfd-726e-43a8-8a1d-ce0dfbf49cd8 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:32.939375 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-d3e11dfd-726e-43a8-8a1d-ce0dfbf49cd8 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75" status: 200 len: 1521 microversion: 2.1 time: 0.237300 Dec 16 14:59:32.939970 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 347/707] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:59:32 2021] GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75 => generated 1521 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:59:33.207039 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-3778d3c7-ddaa-48b3-9164-4e96ea7c7e1f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:59:33.207702 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-3778d3c7-ddaa-48b3-9164-4e96ea7c7e1f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:59:33.216305 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3778d3c7-ddaa-48b3-9164-4e96ea7c7e1f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:33.216811 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3778d3c7-ddaa-48b3-9164-4e96ea7c7e1f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:33.217651 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3778d3c7-ddaa-48b3-9164-4e96ea7c7e1f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:33.218170 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3778d3c7-ddaa-48b3-9164-4e96ea7c7e1f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:33.441312 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-3778d3c7-ddaa-48b3-9164-4e96ea7c7e1f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:33.454282 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-3778d3c7-ddaa-48b3-9164-4e96ea7c7e1f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:33.458850 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-3778d3c7-ddaa-48b3-9164-4e96ea7c7e1f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:33.459974 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-3778d3c7-ddaa-48b3-9164-4e96ea7c7e1f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1720 microversion: 2.20 time: 0.261022 Dec 16 14:59:33.460556 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 361/708] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 14:59:33 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1720 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:59:33.961406 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-5c11d525-172f-4e42-a9a8-86cf53f357e0 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:59:33.962148 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-5c11d525-172f-4e42-a9a8-86cf53f357e0 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: 407dd6f1-6f0a-41ba-80e2-9ebe4630fa75] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:59:33.969918 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5c11d525-172f-4e42-a9a8-86cf53f357e0 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:33.970461 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5c11d525-172f-4e42-a9a8-86cf53f357e0 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:33.971293 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5c11d525-172f-4e42-a9a8-86cf53f357e0 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:33.971798 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5c11d525-172f-4e42-a9a8-86cf53f357e0 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:34.193163 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-5c11d525-172f-4e42-a9a8-86cf53f357e0 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:34.202807 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-5c11d525-172f-4e42-a9a8-86cf53f357e0 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75" status: 200 len: 1521 microversion: 2.1 time: 0.249169 Dec 16 14:59:34.203399 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 348/709] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:59:33 2021] GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75 => generated 1521 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:59:34.483665 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-b0d524a3-e1c7-452e-b6e0-d777297d8abe tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:59:34.484330 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-b0d524a3-e1c7-452e-b6e0-d777297d8abe tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:59:34.492153 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b0d524a3-e1c7-452e-b6e0-d777297d8abe tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:34.492655 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b0d524a3-e1c7-452e-b6e0-d777297d8abe tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:34.494113 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b0d524a3-e1c7-452e-b6e0-d777297d8abe tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:34.494606 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b0d524a3-e1c7-452e-b6e0-d777297d8abe tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:34.718975 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-b0d524a3-e1c7-452e-b6e0-d777297d8abe tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:34.731603 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-b0d524a3-e1c7-452e-b6e0-d777297d8abe tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:34.735988 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-b0d524a3-e1c7-452e-b6e0-d777297d8abe tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:34.737160 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-b0d524a3-e1c7-452e-b6e0-d777297d8abe tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1720 microversion: 2.20 time: 0.261734 Dec 16 14:59:34.737744 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 362/710] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 14:59:34 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1720 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:59:35.224406 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-74a2a119-de06-4edc-a8de-15f4ad9d2de5 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:59:35.225084 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-74a2a119-de06-4edc-a8de-15f4ad9d2de5 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: 407dd6f1-6f0a-41ba-80e2-9ebe4630fa75] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:59:35.232925 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-74a2a119-de06-4edc-a8de-15f4ad9d2de5 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:35.233438 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-74a2a119-de06-4edc-a8de-15f4ad9d2de5 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:35.234318 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-74a2a119-de06-4edc-a8de-15f4ad9d2de5 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:35.234815 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-74a2a119-de06-4edc-a8de-15f4ad9d2de5 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:35.587181 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-74a2a119-de06-4edc-a8de-15f4ad9d2de5 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:35.599317 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-74a2a119-de06-4edc-a8de-15f4ad9d2de5 tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75" status: 200 len: 1521 microversion: 2.1 time: 0.379290 Dec 16 14:59:35.599317 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 349/711] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:59:35 2021] GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75 => generated 1521 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:59:35.761404 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-aae9ad79-779c-4cbe-9070-20c18c05a39c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:59:35.762226 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-aae9ad79-779c-4cbe-9070-20c18c05a39c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:59:35.770282 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-aae9ad79-779c-4cbe-9070-20c18c05a39c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:35.770789 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-aae9ad79-779c-4cbe-9070-20c18c05a39c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:35.771627 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-aae9ad79-779c-4cbe-9070-20c18c05a39c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:35.772123 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-aae9ad79-779c-4cbe-9070-20c18c05a39c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:35.796371 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [req-75df724d-47e5-41aa-b810-84e807c5b9bf req-5d3f4afc-e1d0-4f95-aee6-0cfe4cfa9b40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "407dd6f1-6f0a-41ba-80e2-9ebe4630fa75", "name": "network-vif-deleted", "tag": "5e762ff6-a901-4d0e-aaba-533a8b07ea32"}]} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:59:35.801011 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:59:35.801011 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: warnings.warn(msg) Dec 16 14:59:35.810448 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-75df724d-47e5-41aa-b810-84e807c5b9bf req-5d3f4afc-e1d0-4f95-aee6-0cfe4cfa9b40 service nova] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:35.810972 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-75df724d-47e5-41aa-b810-84e807c5b9bf req-5d3f4afc-e1d0-4f95-aee6-0cfe4cfa9b40 service nova] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:35.830067 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.compute.server_external_events [req-75df724d-47e5-41aa-b810-84e807c5b9bf req-5d3f4afc-e1d0-4f95-aee6-0cfe4cfa9b40 service nova] Creating event network-vif-deleted:5e762ff6-a901-4d0e-aaba-533a8b07ea32 for instance 407dd6f1-6f0a-41ba-80e2-9ebe4630fa75 on hv-cinder-82189 Dec 16 14:59:35.835299 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [req-75df724d-47e5-41aa-b810-84e807c5b9bf req-5d3f4afc-e1d0-4f95-aee6-0cfe4cfa9b40 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047571 Dec 16 14:59:35.836218 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 350/712] 10.222.0.45 () {64 vars in 1308 bytes} [Thu Dec 16 14:59:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:59:35.992172 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-aae9ad79-779c-4cbe-9070-20c18c05a39c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:36.005803 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-aae9ad79-779c-4cbe-9070-20c18c05a39c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:36.013646 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-aae9ad79-779c-4cbe-9070-20c18c05a39c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:36.015445 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-aae9ad79-779c-4cbe-9070-20c18c05a39c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1720 microversion: 2.20 time: 0.261862 Dec 16 14:59:36.016236 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 363/713] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 14:59:35 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1720 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:59:36.617743 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-f5f91e46-174d-4e8f-8a29-da7b9dacc67b tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:59:36.619176 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-f5f91e46-174d-4e8f-8a29-da7b9dacc67b tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: 407dd6f1-6f0a-41ba-80e2-9ebe4630fa75] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:59:36.627330 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f5f91e46-174d-4e8f-8a29-da7b9dacc67b tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:36.627834 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f5f91e46-174d-4e8f-8a29-da7b9dacc67b tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:36.628718 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f5f91e46-174d-4e8f-8a29-da7b9dacc67b tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:36.629190 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f5f91e46-174d-4e8f-8a29-da7b9dacc67b tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:36.710610 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f5f91e46-174d-4e8f-8a29-da7b9dacc67b tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:36.711118 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f5f91e46-174d-4e8f-8a29-da7b9dacc67b tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:36.711749 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.objects.instance [None req-f5f91e46-174d-4e8f-8a29-da7b9dacc67b tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lazy-loading 'fault' on Instance uuid 407dd6f1-6f0a-41ba-80e2-9ebe4630fa75 {{(pid=101355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 16 14:59:36.839629 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-f5f91e46-174d-4e8f-8a29-da7b9dacc67b tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c77eab7702e4838812d02bac0d5db0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7679aab0dd4c2589d94c145df1f4b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:36.847924 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-f5f91e46-174d-4e8f-8a29-da7b9dacc67b tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75" status: 200 len: 1311 microversion: 2.1 time: 0.238208 Dec 16 14:59:36.848523 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 351/714] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:59:36 2021] GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75 => generated 1311 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 14:59:37.038171 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-34cc690a-6cf9-4916-9d3b-5e5b2fb7db5b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:59:37.038844 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-34cc690a-6cf9-4916-9d3b-5e5b2fb7db5b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:59:37.047288 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-34cc690a-6cf9-4916-9d3b-5e5b2fb7db5b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:37.047799 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-34cc690a-6cf9-4916-9d3b-5e5b2fb7db5b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:37.048642 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-34cc690a-6cf9-4916-9d3b-5e5b2fb7db5b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:37.049136 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-34cc690a-6cf9-4916-9d3b-5e5b2fb7db5b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:37.268798 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-34cc690a-6cf9-4916-9d3b-5e5b2fb7db5b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:37.281466 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-34cc690a-6cf9-4916-9d3b-5e5b2fb7db5b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:37.285948 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-34cc690a-6cf9-4916-9d3b-5e5b2fb7db5b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:37.287197 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-34cc690a-6cf9-4916-9d3b-5e5b2fb7db5b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1741 microversion: 2.20 time: 0.256714 Dec 16 14:59:37.287780 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 364/715] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 14:59:37 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1741 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:59:37.870788 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-5814dd3f-4f15-4ef6-8048-668c639b752e tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:59:37.871453 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-5814dd3f-4f15-4ef6-8048-668c639b752e tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] [instance: 407dd6f1-6f0a-41ba-80e2-9ebe4630fa75] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:59:37.879257 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5814dd3f-4f15-4ef6-8048-668c639b752e tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:37.879769 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5814dd3f-4f15-4ef6-8048-668c639b752e tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:37.880619 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5814dd3f-4f15-4ef6-8048-668c639b752e tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:37.881114 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5814dd3f-4f15-4ef6-8048-668c639b752e tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:37.935827 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.wsgi [None req-5814dd3f-4f15-4ef6-8048-668c639b752e tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] HTTP exception thrown: Instance 407dd6f1-6f0a-41ba-80e2-9ebe4630fa75 could not be found. Dec 16 14:59:37.936494 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-5814dd3f-4f15-4ef6-8048-668c639b752e tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] Returning 404 to user: Instance 407dd6f1-6f0a-41ba-80e2-9ebe4630fa75 could not be found. {{(pid=101355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:941}} Dec 16 14:59:37.937401 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-5814dd3f-4f15-4ef6-8048-668c639b752e tempest-ServerRescueNegativeTestJSON-1989194761 tempest-ServerRescueNegativeTestJSON-1989194761-project] 10.222.0.45 "GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75" status: 404 len: 111 microversion: 2.1 time: 0.074904 Dec 16 14:59:37.938017 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 352/716] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 14:59:37 2021] GET /compute/v2.1/servers/407dd6f1-6f0a-41ba-80e2-9ebe4630fa75 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 14:59:38.313084 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-16ab0a13-667a-4b92-8aa9-87bcea11c9a2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:59:38.313663 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-16ab0a13-667a-4b92-8aa9-87bcea11c9a2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:59:38.322575 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-16ab0a13-667a-4b92-8aa9-87bcea11c9a2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:38.323070 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-16ab0a13-667a-4b92-8aa9-87bcea11c9a2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:38.323903 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-16ab0a13-667a-4b92-8aa9-87bcea11c9a2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:38.324388 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-16ab0a13-667a-4b92-8aa9-87bcea11c9a2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:38.874577 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-16ab0a13-667a-4b92-8aa9-87bcea11c9a2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:38.893008 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-16ab0a13-667a-4b92-8aa9-87bcea11c9a2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:38.897905 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-16ab0a13-667a-4b92-8aa9-87bcea11c9a2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:38.900033 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-16ab0a13-667a-4b92-8aa9-87bcea11c9a2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1741 microversion: 2.20 time: 0.593965 Dec 16 14:59:38.901003 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 365/717] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 14:59:38 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1741 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:59:39.923825 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-12b27fb4-59f2-42cf-8f20-04ad15be709b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:59:39.924480 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-12b27fb4-59f2-42cf-8f20-04ad15be709b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:59:39.932620 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-12b27fb4-59f2-42cf-8f20-04ad15be709b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:39.933130 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-12b27fb4-59f2-42cf-8f20-04ad15be709b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:39.933971 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-12b27fb4-59f2-42cf-8f20-04ad15be709b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:39.934494 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-12b27fb4-59f2-42cf-8f20-04ad15be709b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:40.200616 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-12b27fb4-59f2-42cf-8f20-04ad15be709b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:40.215228 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-12b27fb4-59f2-42cf-8f20-04ad15be709b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:40.221504 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-12b27fb4-59f2-42cf-8f20-04ad15be709b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:40.223203 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-12b27fb4-59f2-42cf-8f20-04ad15be709b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1741 microversion: 2.20 time: 0.307338 Dec 16 14:59:40.224038 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 353/718] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 14:59:39 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1741 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:59:40.424201 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [req-037661d2-2d69-4df0-a78a-90ffc43910cf req-10980645-d663-45f4-bd89-f58a44d2b597 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd5ffc87-035a-4e91-8fb5-8e44ed5704ac", "name": "network-vif-plugged", "status": "completed", "tag": "53c4bcf8-a1ba-44b2-b6d2-735e655c1b9f"}]} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 14:59:40.428923 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 14:59:40.428923 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: warnings.warn(msg) Dec 16 14:59:40.439077 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-037661d2-2d69-4df0-a78a-90ffc43910cf req-10980645-d663-45f4-bd89-f58a44d2b597 service nova] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:40.439602 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-037661d2-2d69-4df0-a78a-90ffc43910cf req-10980645-d663-45f4-bd89-f58a44d2b597 service nova] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:40.462081 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.compute.server_external_events [req-037661d2-2d69-4df0-a78a-90ffc43910cf req-10980645-d663-45f4-bd89-f58a44d2b597 service nova] Creating event network-vif-plugged:53c4bcf8-a1ba-44b2-b6d2-735e655c1b9f for instance cd5ffc87-035a-4e91-8fb5-8e44ed5704ac on hv-cinder-82189 Dec 16 14:59:40.467353 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [req-037661d2-2d69-4df0-a78a-90ffc43910cf req-10980645-d663-45f4-bd89-f58a44d2b597 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052371 Dec 16 14:59:40.468166 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 366/719] 10.222.0.45 () {64 vars in 1308 bytes} [Thu Dec 16 14:59:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 14:59:41.248044 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-63774e29-f310-4f07-8b52-b0a499d2a6b3 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:59:41.248716 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-63774e29-f310-4f07-8b52-b0a499d2a6b3 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:59:41.256654 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-63774e29-f310-4f07-8b52-b0a499d2a6b3 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:41.257169 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-63774e29-f310-4f07-8b52-b0a499d2a6b3 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:41.257999 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-63774e29-f310-4f07-8b52-b0a499d2a6b3 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:41.259245 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-63774e29-f310-4f07-8b52-b0a499d2a6b3 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:41.482827 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-63774e29-f310-4f07-8b52-b0a499d2a6b3 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:41.496084 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-63774e29-f310-4f07-8b52-b0a499d2a6b3 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:41.500716 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-63774e29-f310-4f07-8b52-b0a499d2a6b3 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:41.501894 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-63774e29-f310-4f07-8b52-b0a499d2a6b3 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1741 microversion: 2.20 time: 0.262334 Dec 16 14:59:41.502511 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 354/720] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 14:59:41 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1741 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:59:42.526306 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-2a8d5b42-84b6-4f22-93b5-ebdff378e3b4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:59:42.527001 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-2a8d5b42-84b6-4f22-93b5-ebdff378e3b4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:59:42.537859 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2a8d5b42-84b6-4f22-93b5-ebdff378e3b4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:42.538389 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2a8d5b42-84b6-4f22-93b5-ebdff378e3b4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:42.539243 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2a8d5b42-84b6-4f22-93b5-ebdff378e3b4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:42.540335 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2a8d5b42-84b6-4f22-93b5-ebdff378e3b4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:43.166492 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-2a8d5b42-84b6-4f22-93b5-ebdff378e3b4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:43.178976 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-2a8d5b42-84b6-4f22-93b5-ebdff378e3b4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:43.183979 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-2a8d5b42-84b6-4f22-93b5-ebdff378e3b4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:43.185157 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-2a8d5b42-84b6-4f22-93b5-ebdff378e3b4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1741 microversion: 2.20 time: 0.667911 Dec 16 14:59:43.185720 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 367/721] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 14:59:42 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1741 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:59:44.213393 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-6a1264b9-cb18-4edf-b9ce-e3ad01a5ee73 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:59:44.214101 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-6a1264b9-cb18-4edf-b9ce-e3ad01a5ee73 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:59:44.225135 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6a1264b9-cb18-4edf-b9ce-e3ad01a5ee73 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:44.225651 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6a1264b9-cb18-4edf-b9ce-e3ad01a5ee73 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:44.226594 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6a1264b9-cb18-4edf-b9ce-e3ad01a5ee73 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:44.227697 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6a1264b9-cb18-4edf-b9ce-e3ad01a5ee73 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:44.530677 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-6a1264b9-cb18-4edf-b9ce-e3ad01a5ee73 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:44.545749 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-6a1264b9-cb18-4edf-b9ce-e3ad01a5ee73 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:44.551630 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-6a1264b9-cb18-4edf-b9ce-e3ad01a5ee73 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:44.553095 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-6a1264b9-cb18-4edf-b9ce-e3ad01a5ee73 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1736 microversion: 2.20 time: 0.350461 Dec 16 14:59:44.553669 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 355/722] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 14:59:44 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1736 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:59:45.577914 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-d46f73f0-8dd3-48a8-affb-848f79087540 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:59:45.603249 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-d46f73f0-8dd3-48a8-affb-848f79087540 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:59:45.632122 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d46f73f0-8dd3-48a8-affb-848f79087540 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:45.646654 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d46f73f0-8dd3-48a8-affb-848f79087540 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:45.650662 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d46f73f0-8dd3-48a8-affb-848f79087540 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:45.651368 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d46f73f0-8dd3-48a8-affb-848f79087540 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:45.949003 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-d46f73f0-8dd3-48a8-affb-848f79087540 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:45.967491 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-d46f73f0-8dd3-48a8-affb-848f79087540 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:45.972275 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-d46f73f0-8dd3-48a8-affb-848f79087540 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:45.974066 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-d46f73f0-8dd3-48a8-affb-848f79087540 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1736 microversion: 2.20 time: 0.404798 Dec 16 14:59:45.974841 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 368/723] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 14:59:45 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1736 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:59:46.998854 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-6212b1be-ee97-4a83-8cfc-6ec0627a8214 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:59:46.999495 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-6212b1be-ee97-4a83-8cfc-6ec0627a8214 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:59:47.008260 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6212b1be-ee97-4a83-8cfc-6ec0627a8214 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:47.008986 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6212b1be-ee97-4a83-8cfc-6ec0627a8214 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:47.011168 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6212b1be-ee97-4a83-8cfc-6ec0627a8214 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:47.011879 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6212b1be-ee97-4a83-8cfc-6ec0627a8214 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:47.284432 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-6212b1be-ee97-4a83-8cfc-6ec0627a8214 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:47.298076 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-6212b1be-ee97-4a83-8cfc-6ec0627a8214 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:47.302637 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-6212b1be-ee97-4a83-8cfc-6ec0627a8214 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:47.303879 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-6212b1be-ee97-4a83-8cfc-6ec0627a8214 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1736 microversion: 2.20 time: 0.314346 Dec 16 14:59:47.304685 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 356/724] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 14:59:46 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1736 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:59:48.330619 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-b2b1100a-7457-4ee6-a256-b9ccec53ca23 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:59:48.331304 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-b2b1100a-7457-4ee6-a256-b9ccec53ca23 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:59:48.341714 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b2b1100a-7457-4ee6-a256-b9ccec53ca23 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:48.342443 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b2b1100a-7457-4ee6-a256-b9ccec53ca23 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:48.343569 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b2b1100a-7457-4ee6-a256-b9ccec53ca23 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:48.344236 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b2b1100a-7457-4ee6-a256-b9ccec53ca23 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:48.592811 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-b2b1100a-7457-4ee6-a256-b9ccec53ca23 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:48.607605 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-b2b1100a-7457-4ee6-a256-b9ccec53ca23 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:48.610033 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-b2b1100a-7457-4ee6-a256-b9ccec53ca23 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:48.611248 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-b2b1100a-7457-4ee6-a256-b9ccec53ca23 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1736 microversion: 2.20 time: 0.289579 Dec 16 14:59:48.611823 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 369/725] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 14:59:48 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1736 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:59:49.634884 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-0e497b40-1605-4486-ab02-ba30c1c7cd89 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:59:49.636122 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-0e497b40-1605-4486-ab02-ba30c1c7cd89 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:59:49.644212 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0e497b40-1605-4486-ab02-ba30c1c7cd89 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:49.644938 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0e497b40-1605-4486-ab02-ba30c1c7cd89 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:49.645986 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0e497b40-1605-4486-ab02-ba30c1c7cd89 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:49.646517 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0e497b40-1605-4486-ab02-ba30c1c7cd89 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:49.872743 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-0e497b40-1605-4486-ab02-ba30c1c7cd89 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:49.909189 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-0e497b40-1605-4486-ab02-ba30c1c7cd89 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:49.914909 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-0e497b40-1605-4486-ab02-ba30c1c7cd89 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:49.917416 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-0e497b40-1605-4486-ab02-ba30c1c7cd89 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1736 microversion: 2.20 time: 0.290212 Dec 16 14:59:49.918208 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 357/726] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 14:59:49 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1736 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:59:50.941620 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-2f631f9a-b02b-413e-894c-36cb4e60a1db tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:59:50.942327 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-2f631f9a-b02b-413e-894c-36cb4e60a1db tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:59:50.950903 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2f631f9a-b02b-413e-894c-36cb4e60a1db tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:50.951669 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2f631f9a-b02b-413e-894c-36cb4e60a1db tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:50.952524 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2f631f9a-b02b-413e-894c-36cb4e60a1db tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:50.953023 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2f631f9a-b02b-413e-894c-36cb4e60a1db tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:51.210666 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-2f631f9a-b02b-413e-894c-36cb4e60a1db tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:51.224665 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-2f631f9a-b02b-413e-894c-36cb4e60a1db tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:51.230006 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-2f631f9a-b02b-413e-894c-36cb4e60a1db tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:51.239407 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-2f631f9a-b02b-413e-894c-36cb4e60a1db tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1736 microversion: 2.20 time: 0.297636 Dec 16 14:59:51.239407 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 370/727] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 14:59:50 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1736 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:59:52.257678 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-28f29626-fa7a-4c3b-87f2-0a8048d6a203 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:59:52.258374 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-28f29626-fa7a-4c3b-87f2-0a8048d6a203 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:59:52.267725 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-28f29626-fa7a-4c3b-87f2-0a8048d6a203 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:52.268232 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-28f29626-fa7a-4c3b-87f2-0a8048d6a203 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:52.269076 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-28f29626-fa7a-4c3b-87f2-0a8048d6a203 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:52.269567 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-28f29626-fa7a-4c3b-87f2-0a8048d6a203 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:52.516107 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-28f29626-fa7a-4c3b-87f2-0a8048d6a203 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:52.541265 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-28f29626-fa7a-4c3b-87f2-0a8048d6a203 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:52.548197 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-28f29626-fa7a-4c3b-87f2-0a8048d6a203 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:52.550756 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-28f29626-fa7a-4c3b-87f2-0a8048d6a203 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1736 microversion: 2.20 time: 0.303310 Dec 16 14:59:52.551362 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 358/728] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 14:59:52 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1736 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:59:53.575515 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-4323e2a7-bbff-4b94-b0ae-4262f6e05ef2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:59:53.576094 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-4323e2a7-bbff-4b94-b0ae-4262f6e05ef2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:59:53.584576 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4323e2a7-bbff-4b94-b0ae-4262f6e05ef2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:53.585086 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4323e2a7-bbff-4b94-b0ae-4262f6e05ef2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:53.585931 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4323e2a7-bbff-4b94-b0ae-4262f6e05ef2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:53.586475 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4323e2a7-bbff-4b94-b0ae-4262f6e05ef2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:53.841536 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-4323e2a7-bbff-4b94-b0ae-4262f6e05ef2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:53.854804 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-4323e2a7-bbff-4b94-b0ae-4262f6e05ef2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:53.859401 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-4323e2a7-bbff-4b94-b0ae-4262f6e05ef2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:53.860622 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-4323e2a7-bbff-4b94-b0ae-4262f6e05ef2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1736 microversion: 2.20 time: 0.293433 Dec 16 14:59:53.861268 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 371/729] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 14:59:53 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1736 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:59:54.886897 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-04a37d26-75a7-46cc-b464-e67ad34b37ce tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:59:54.888199 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-04a37d26-75a7-46cc-b464-e67ad34b37ce tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:59:54.897931 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-04a37d26-75a7-46cc-b464-e67ad34b37ce tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:54.898468 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-04a37d26-75a7-46cc-b464-e67ad34b37ce tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:54.899327 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-04a37d26-75a7-46cc-b464-e67ad34b37ce tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:54.899938 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-04a37d26-75a7-46cc-b464-e67ad34b37ce tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:55.132745 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-04a37d26-75a7-46cc-b464-e67ad34b37ce tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:55.146700 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-04a37d26-75a7-46cc-b464-e67ad34b37ce tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:55.151658 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-04a37d26-75a7-46cc-b464-e67ad34b37ce tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:55.152437 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-04a37d26-75a7-46cc-b464-e67ad34b37ce tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1736 microversion: 2.20 time: 0.275449 Dec 16 14:59:55.153193 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 359/730] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 14:59:54 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1736 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:59:56.189604 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-9ea68b46-4a65-4c77-87c7-f5827428b223 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:59:56.189604 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-9ea68b46-4a65-4c77-87c7-f5827428b223 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:59:56.189604 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9ea68b46-4a65-4c77-87c7-f5827428b223 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:56.189604 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9ea68b46-4a65-4c77-87c7-f5827428b223 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:56.190410 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9ea68b46-4a65-4c77-87c7-f5827428b223 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:56.190410 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9ea68b46-4a65-4c77-87c7-f5827428b223 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:56.411550 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-9ea68b46-4a65-4c77-87c7-f5827428b223 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:56.426829 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-9ea68b46-4a65-4c77-87c7-f5827428b223 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:56.432403 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-9ea68b46-4a65-4c77-87c7-f5827428b223 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:56.433640 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-9ea68b46-4a65-4c77-87c7-f5827428b223 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1736 microversion: 2.20 time: 0.265189 Dec 16 14:59:56.434264 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 372/731] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 14:59:56 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1736 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:59:57.456966 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-8b115cae-2ab6-4f54-8fd7-70ce2118986d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:59:57.457636 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-8b115cae-2ab6-4f54-8fd7-70ce2118986d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:59:57.466266 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8b115cae-2ab6-4f54-8fd7-70ce2118986d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:57.466769 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8b115cae-2ab6-4f54-8fd7-70ce2118986d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:57.467618 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8b115cae-2ab6-4f54-8fd7-70ce2118986d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:57.468110 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8b115cae-2ab6-4f54-8fd7-70ce2118986d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:57.817685 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-8b115cae-2ab6-4f54-8fd7-70ce2118986d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:57.830750 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-8b115cae-2ab6-4f54-8fd7-70ce2118986d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:57.835337 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-8b115cae-2ab6-4f54-8fd7-70ce2118986d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:57.836522 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-8b115cae-2ab6-4f54-8fd7-70ce2118986d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1736 microversion: 2.20 time: 0.387357 Dec 16 14:59:57.837109 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 360/732] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 14:59:57 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1736 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 14:59:58.858512 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-4e31cb83-0619-4848-95a9-576522752d07 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 14:59:58.859178 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-4e31cb83-0619-4848-95a9-576522752d07 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 14:59:58.869239 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4e31cb83-0619-4848-95a9-576522752d07 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:58.869725 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4e31cb83-0619-4848-95a9-576522752d07 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:58.871035 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4e31cb83-0619-4848-95a9-576522752d07 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 14:59:58.871507 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4e31cb83-0619-4848-95a9-576522752d07 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 14:59:59.097219 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-4e31cb83-0619-4848-95a9-576522752d07 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:59.110857 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-4e31cb83-0619-4848-95a9-576522752d07 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:59.115479 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-4e31cb83-0619-4848-95a9-576522752d07 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 14:59:59.117412 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-4e31cb83-0619-4848-95a9-576522752d07 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1718 microversion: 2.20 time: 0.265800 Dec 16 14:59:59.117412 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 373/733] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 14:59:58 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1718 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:00:00.140472 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-db8cdda0-7e9f-4faa-94e2-366badfcdc37 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:00:00.141133 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-db8cdda0-7e9f-4faa-94e2-366badfcdc37 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:00:00.148898 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-db8cdda0-7e9f-4faa-94e2-366badfcdc37 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:00.149401 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-db8cdda0-7e9f-4faa-94e2-366badfcdc37 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:00.150276 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-db8cdda0-7e9f-4faa-94e2-366badfcdc37 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:00.150753 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-db8cdda0-7e9f-4faa-94e2-366badfcdc37 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:00.371478 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-db8cdda0-7e9f-4faa-94e2-366badfcdc37 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:00.384479 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-db8cdda0-7e9f-4faa-94e2-366badfcdc37 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:00.389180 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-db8cdda0-7e9f-4faa-94e2-366badfcdc37 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:00.390533 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-db8cdda0-7e9f-4faa-94e2-366badfcdc37 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1718 microversion: 2.20 time: 0.257683 Dec 16 15:00:00.391361 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 361/734] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:00:00 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1718 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:00:00.453072 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [req-26a43ba9-8195-4619-ab5a-76e3dfb4a478 req-3d226355-da28-4732-ad2f-7671158f7f35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd5ffc87-035a-4e91-8fb5-8e44ed5704ac", "name": "network-vif-unplugged", "status": "completed", "tag": "53c4bcf8-a1ba-44b2-b6d2-735e655c1b9f"}]} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:00:00.457636 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:00:00.457636 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: warnings.warn(msg) Dec 16 15:00:00.466776 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-26a43ba9-8195-4619-ab5a-76e3dfb4a478 req-3d226355-da28-4732-ad2f-7671158f7f35 service nova] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:00.467747 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-26a43ba9-8195-4619-ab5a-76e3dfb4a478 req-3d226355-da28-4732-ad2f-7671158f7f35 service nova] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:00.484803 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.compute.server_external_events [req-26a43ba9-8195-4619-ab5a-76e3dfb4a478 req-3d226355-da28-4732-ad2f-7671158f7f35 service nova] Creating event network-vif-unplugged:53c4bcf8-a1ba-44b2-b6d2-735e655c1b9f for instance cd5ffc87-035a-4e91-8fb5-8e44ed5704ac on hv-cinder-82189 Dec 16 15:00:00.489918 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [req-26a43ba9-8195-4619-ab5a-76e3dfb4a478 req-3d226355-da28-4732-ad2f-7671158f7f35 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044786 Dec 16 15:00:00.490759 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 374/735] 10.222.0.45 () {64 vars in 1308 bytes} [Thu Dec 16 15:00:00 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:00:01.414297 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-5bbde1bc-2edf-49d0-923a-297465359182 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:00:01.414945 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-5bbde1bc-2edf-49d0-923a-297465359182 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:00:01.423455 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5bbde1bc-2edf-49d0-923a-297465359182 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:01.423969 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5bbde1bc-2edf-49d0-923a-297465359182 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:01.424819 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5bbde1bc-2edf-49d0-923a-297465359182 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:01.425356 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5bbde1bc-2edf-49d0-923a-297465359182 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:01.649744 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-5bbde1bc-2edf-49d0-923a-297465359182 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:01.662461 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-5bbde1bc-2edf-49d0-923a-297465359182 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:01.667100 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-5bbde1bc-2edf-49d0-923a-297465359182 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:01.668278 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-5bbde1bc-2edf-49d0-923a-297465359182 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1721 microversion: 2.20 time: 0.261877 Dec 16 15:00:01.668865 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 362/736] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:00:01 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1721 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:00:01.691321 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-64cd4f09-645c-4d69-b67d-fda7aab779ec tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4fbf6f0d-a11f-422b-b252-123f878a2093"}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:00:01.692588 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-64cd4f09-645c-4d69-b67d-fda7aab779ec tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:00:01.701158 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-64cd4f09-645c-4d69-b67d-fda7aab779ec tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:01.701918 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-64cd4f09-645c-4d69-b67d-fda7aab779ec tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:01.702777 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-64cd4f09-645c-4d69-b67d-fda7aab779ec tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:01.703263 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-64cd4f09-645c-4d69-b67d-fda7aab779ec tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:02.628471 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-64cd4f09-645c-4d69-b67d-fda7aab779ec tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.945200 Dec 16 15:00:02.629068 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 375/737] 10.222.0.45 () {62 vars in 1354 bytes} [Thu Dec 16 15:00:01 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/os-volume_attachments => generated 188 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:00:02.863973 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-58075476-c899-4a60-a034-8e431503174c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:00:02.864584 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-58075476-c899-4a60-a034-8e431503174c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:00:02.872365 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-58075476-c899-4a60-a034-8e431503174c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:02.872865 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-58075476-c899-4a60-a034-8e431503174c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:02.873688 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-58075476-c899-4a60-a034-8e431503174c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:02.874202 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-58075476-c899-4a60-a034-8e431503174c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:03.169991 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-58075476-c899-4a60-a034-8e431503174c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action" status: 202 len: 0 microversion: 2.20 time: 0.313529 Dec 16 15:00:03.170782 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 363/738] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 15:00:02 2021] POST /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/action => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 16 15:00:03.185069 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-b9b4a3d4-af47-4e5c-a5a1-4fc23e31bb44 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:00:03.185747 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-b9b4a3d4-af47-4e5c-a5a1-4fc23e31bb44 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:00:03.193715 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b9b4a3d4-af47-4e5c-a5a1-4fc23e31bb44 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:03.194271 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b9b4a3d4-af47-4e5c-a5a1-4fc23e31bb44 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:03.195231 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b9b4a3d4-af47-4e5c-a5a1-4fc23e31bb44 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:03.195721 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b9b4a3d4-af47-4e5c-a5a1-4fc23e31bb44 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:03.470496 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-b9b4a3d4-af47-4e5c-a5a1-4fc23e31bb44 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:03.483308 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-b9b4a3d4-af47-4e5c-a5a1-4fc23e31bb44 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:03.487777 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-b9b4a3d4-af47-4e5c-a5a1-4fc23e31bb44 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:03.488964 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-b9b4a3d4-af47-4e5c-a5a1-4fc23e31bb44 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1747 microversion: 2.20 time: 0.313637 Dec 16 15:00:03.489550 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 376/739] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:00:03 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1747 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 15:00:04.513507 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-45188549-2fee-49b4-b517-cba96e5eded6 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:00:04.514212 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-45188549-2fee-49b4-b517-cba96e5eded6 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:00:04.522183 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-45188549-2fee-49b4-b517-cba96e5eded6 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:04.522689 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-45188549-2fee-49b4-b517-cba96e5eded6 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:04.523515 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-45188549-2fee-49b4-b517-cba96e5eded6 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:04.524022 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-45188549-2fee-49b4-b517-cba96e5eded6 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:04.815728 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-45188549-2fee-49b4-b517-cba96e5eded6 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:04.829271 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-45188549-2fee-49b4-b517-cba96e5eded6 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:04.833736 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-45188549-2fee-49b4-b517-cba96e5eded6 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:04.835011 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-45188549-2fee-49b4-b517-cba96e5eded6 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1749 microversion: 2.20 time: 0.329871 Dec 16 15:00:04.835595 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 364/740] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:00:04 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1749 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:00:05.859839 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-62b13fde-13a1-4378-82f1-a33c0f70430b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:00:05.860542 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-62b13fde-13a1-4378-82f1-a33c0f70430b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:00:05.868497 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-62b13fde-13a1-4378-82f1-a33c0f70430b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:05.868992 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-62b13fde-13a1-4378-82f1-a33c0f70430b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:05.869819 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-62b13fde-13a1-4378-82f1-a33c0f70430b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:05.870329 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-62b13fde-13a1-4378-82f1-a33c0f70430b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:06.083659 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-62b13fde-13a1-4378-82f1-a33c0f70430b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:06.097623 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-62b13fde-13a1-4378-82f1-a33c0f70430b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:06.102408 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-62b13fde-13a1-4378-82f1-a33c0f70430b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:06.104155 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-62b13fde-13a1-4378-82f1-a33c0f70430b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1749 microversion: 2.20 time: 0.252541 Dec 16 15:00:06.104738 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 377/741] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:00:05 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1749 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 15:00:07.127779 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-aa8c6f10-06eb-41a2-8613-d48f2b5a9bcd tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:00:07.128498 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-aa8c6f10-06eb-41a2-8613-d48f2b5a9bcd tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:00:07.137532 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-aa8c6f10-06eb-41a2-8613-d48f2b5a9bcd tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:07.138071 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-aa8c6f10-06eb-41a2-8613-d48f2b5a9bcd tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:07.138923 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-aa8c6f10-06eb-41a2-8613-d48f2b5a9bcd tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:07.139417 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-aa8c6f10-06eb-41a2-8613-d48f2b5a9bcd tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:07.359874 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-aa8c6f10-06eb-41a2-8613-d48f2b5a9bcd tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:07.377717 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-aa8c6f10-06eb-41a2-8613-d48f2b5a9bcd tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:07.382395 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-aa8c6f10-06eb-41a2-8613-d48f2b5a9bcd tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:07.383544 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-aa8c6f10-06eb-41a2-8613-d48f2b5a9bcd tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1749 microversion: 2.20 time: 0.263521 Dec 16 15:00:07.384750 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 365/742] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:00:07 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1749 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 15:00:08.410661 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-e66e5303-c3d2-4cce-b510-ed46ad97fb57 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:00:08.411406 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-e66e5303-c3d2-4cce-b510-ed46ad97fb57 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:00:08.420258 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e66e5303-c3d2-4cce-b510-ed46ad97fb57 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:08.420847 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e66e5303-c3d2-4cce-b510-ed46ad97fb57 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:08.421701 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e66e5303-c3d2-4cce-b510-ed46ad97fb57 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:08.422221 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e66e5303-c3d2-4cce-b510-ed46ad97fb57 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:08.631618 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-e66e5303-c3d2-4cce-b510-ed46ad97fb57 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:08.645221 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-e66e5303-c3d2-4cce-b510-ed46ad97fb57 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:08.651922 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-e66e5303-c3d2-4cce-b510-ed46ad97fb57 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:08.653126 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-e66e5303-c3d2-4cce-b510-ed46ad97fb57 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1749 microversion: 2.20 time: 0.250675 Dec 16 15:00:08.653716 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 378/743] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:00:08 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1749 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:00:09.676280 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-b381ade5-f699-4be4-8434-29b353860827 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:00:09.676884 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-b381ade5-f699-4be4-8434-29b353860827 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:00:09.685542 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b381ade5-f699-4be4-8434-29b353860827 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:09.686069 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b381ade5-f699-4be4-8434-29b353860827 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:09.686919 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b381ade5-f699-4be4-8434-29b353860827 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:09.687416 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b381ade5-f699-4be4-8434-29b353860827 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:09.906955 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-b381ade5-f699-4be4-8434-29b353860827 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:09.920472 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-b381ade5-f699-4be4-8434-29b353860827 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:09.926608 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-b381ade5-f699-4be4-8434-29b353860827 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:09.928170 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-b381ade5-f699-4be4-8434-29b353860827 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1749 microversion: 2.20 time: 0.259612 Dec 16 15:00:09.928783 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 366/744] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:00:09 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1749 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:00:10.951994 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-cbe77d26-ac26-47c2-9cf4-775b466e35f9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:00:10.952627 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-cbe77d26-ac26-47c2-9cf4-775b466e35f9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:00:10.960408 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cbe77d26-ac26-47c2-9cf4-775b466e35f9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:10.960907 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cbe77d26-ac26-47c2-9cf4-775b466e35f9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:10.961733 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cbe77d26-ac26-47c2-9cf4-775b466e35f9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:10.962743 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cbe77d26-ac26-47c2-9cf4-775b466e35f9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:11.204003 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-cbe77d26-ac26-47c2-9cf4-775b466e35f9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:11.217199 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-cbe77d26-ac26-47c2-9cf4-775b466e35f9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:11.221653 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-cbe77d26-ac26-47c2-9cf4-775b466e35f9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:11.222848 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-cbe77d26-ac26-47c2-9cf4-775b466e35f9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1749 microversion: 2.20 time: 0.278907 Dec 16 15:00:11.223428 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 379/745] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:00:10 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1749 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:00:12.247303 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-f12f2276-8b59-48c5-bedc-81f18723266c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:00:12.247961 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-f12f2276-8b59-48c5-bedc-81f18723266c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:00:12.255795 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f12f2276-8b59-48c5-bedc-81f18723266c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:12.256296 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f12f2276-8b59-48c5-bedc-81f18723266c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:12.257145 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f12f2276-8b59-48c5-bedc-81f18723266c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:12.257605 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f12f2276-8b59-48c5-bedc-81f18723266c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:12.472071 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-f12f2276-8b59-48c5-bedc-81f18723266c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:12.486337 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-f12f2276-8b59-48c5-bedc-81f18723266c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:12.490824 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-f12f2276-8b59-48c5-bedc-81f18723266c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:12.492009 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-f12f2276-8b59-48c5-bedc-81f18723266c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1749 microversion: 2.20 time: 0.253306 Dec 16 15:00:12.492597 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 367/746] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:00:12 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1749 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:00:13.514954 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-338e9f2c-5e71-4d81-8bde-db78d96984d5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:00:13.515619 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-338e9f2c-5e71-4d81-8bde-db78d96984d5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:00:13.523522 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-338e9f2c-5e71-4d81-8bde-db78d96984d5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:13.524025 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-338e9f2c-5e71-4d81-8bde-db78d96984d5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:13.524861 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-338e9f2c-5e71-4d81-8bde-db78d96984d5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:13.525352 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-338e9f2c-5e71-4d81-8bde-db78d96984d5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:13.739535 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-338e9f2c-5e71-4d81-8bde-db78d96984d5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:13.755858 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-338e9f2c-5e71-4d81-8bde-db78d96984d5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:13.760313 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-338e9f2c-5e71-4d81-8bde-db78d96984d5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:13.761529 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-338e9f2c-5e71-4d81-8bde-db78d96984d5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1749 microversion: 2.20 time: 0.254141 Dec 16 15:00:13.762145 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 380/747] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:00:13 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1749 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:00:14.793553 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-2ce89af3-2f52-4342-aaff-2b1a8b7f04ad tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:00:14.794242 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-2ce89af3-2f52-4342-aaff-2b1a8b7f04ad tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:00:14.802137 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2ce89af3-2f52-4342-aaff-2b1a8b7f04ad tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:14.802647 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2ce89af3-2f52-4342-aaff-2b1a8b7f04ad tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:14.803485 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2ce89af3-2f52-4342-aaff-2b1a8b7f04ad tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:14.803977 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2ce89af3-2f52-4342-aaff-2b1a8b7f04ad tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:15.018890 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-2ce89af3-2f52-4342-aaff-2b1a8b7f04ad tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:15.032260 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-2ce89af3-2f52-4342-aaff-2b1a8b7f04ad tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:15.042070 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-2ce89af3-2f52-4342-aaff-2b1a8b7f04ad tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:15.043470 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-2ce89af3-2f52-4342-aaff-2b1a8b7f04ad tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1749 microversion: 2.20 time: 0.257651 Dec 16 15:00:15.044233 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 368/748] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:00:14 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1749 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:00:16.067080 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-20ad759e-18cf-4fcf-9c5e-38ed4e0680a5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:00:16.067984 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-20ad759e-18cf-4fcf-9c5e-38ed4e0680a5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:00:16.077223 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-20ad759e-18cf-4fcf-9c5e-38ed4e0680a5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:16.077741 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-20ad759e-18cf-4fcf-9c5e-38ed4e0680a5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:16.078620 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-20ad759e-18cf-4fcf-9c5e-38ed4e0680a5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:16.079120 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-20ad759e-18cf-4fcf-9c5e-38ed4e0680a5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:16.289613 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-20ad759e-18cf-4fcf-9c5e-38ed4e0680a5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:16.302342 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-20ad759e-18cf-4fcf-9c5e-38ed4e0680a5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:16.307341 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-20ad759e-18cf-4fcf-9c5e-38ed4e0680a5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:16.308519 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-20ad759e-18cf-4fcf-9c5e-38ed4e0680a5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1749 microversion: 2.20 time: 0.249507 Dec 16 15:00:16.309102 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 381/749] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:00:16 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1749 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:00:17.331859 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-47d4dc9a-0595-4031-ad3c-2a88e645edfc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:00:17.332474 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-47d4dc9a-0595-4031-ad3c-2a88e645edfc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:00:17.340359 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-47d4dc9a-0595-4031-ad3c-2a88e645edfc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:17.341263 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-47d4dc9a-0595-4031-ad3c-2a88e645edfc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:17.341676 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-47d4dc9a-0595-4031-ad3c-2a88e645edfc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:17.342617 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-47d4dc9a-0595-4031-ad3c-2a88e645edfc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:17.563608 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-47d4dc9a-0595-4031-ad3c-2a88e645edfc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:17.576753 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-47d4dc9a-0595-4031-ad3c-2a88e645edfc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:17.581192 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-47d4dc9a-0595-4031-ad3c-2a88e645edfc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:17.582408 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-47d4dc9a-0595-4031-ad3c-2a88e645edfc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1749 microversion: 2.20 time: 0.258541 Dec 16 15:00:17.582991 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 369/750] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:00:17 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1749 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:00:18.606121 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-fb0ca560-5b8e-4bdc-9b7b-9ffc63e873a0 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:00:18.606777 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-fb0ca560-5b8e-4bdc-9b7b-9ffc63e873a0 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:00:18.614652 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fb0ca560-5b8e-4bdc-9b7b-9ffc63e873a0 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:18.615151 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fb0ca560-5b8e-4bdc-9b7b-9ffc63e873a0 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:18.615974 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fb0ca560-5b8e-4bdc-9b7b-9ffc63e873a0 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:18.616588 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fb0ca560-5b8e-4bdc-9b7b-9ffc63e873a0 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:18.839171 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-fb0ca560-5b8e-4bdc-9b7b-9ffc63e873a0 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:18.851822 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-fb0ca560-5b8e-4bdc-9b7b-9ffc63e873a0 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:18.856882 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-fb0ca560-5b8e-4bdc-9b7b-9ffc63e873a0 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:18.858010 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-fb0ca560-5b8e-4bdc-9b7b-9ffc63e873a0 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1749 microversion: 2.20 time: 0.259845 Dec 16 15:00:18.858616 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 382/751] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:00:18 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1749 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:00:19.882060 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-02dc1dee-38c6-4110-851f-d1f3cb31f389 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:00:19.882828 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-02dc1dee-38c6-4110-851f-d1f3cb31f389 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:00:19.891352 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-02dc1dee-38c6-4110-851f-d1f3cb31f389 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:19.891873 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-02dc1dee-38c6-4110-851f-d1f3cb31f389 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:19.892723 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-02dc1dee-38c6-4110-851f-d1f3cb31f389 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:19.893222 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-02dc1dee-38c6-4110-851f-d1f3cb31f389 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:20.105535 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-02dc1dee-38c6-4110-851f-d1f3cb31f389 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:20.118877 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-02dc1dee-38c6-4110-851f-d1f3cb31f389 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:20.123414 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-02dc1dee-38c6-4110-851f-d1f3cb31f389 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:20.124596 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-02dc1dee-38c6-4110-851f-d1f3cb31f389 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1749 microversion: 2.20 time: 0.250510 Dec 16 15:00:20.125190 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 370/752] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:00:19 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1749 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:00:21.149467 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-6d9bab33-8279-4176-9646-4fc5ab0bc17e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:00:21.150166 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-6d9bab33-8279-4176-9646-4fc5ab0bc17e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:00:21.159458 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6d9bab33-8279-4176-9646-4fc5ab0bc17e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:21.159900 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6d9bab33-8279-4176-9646-4fc5ab0bc17e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:21.160989 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6d9bab33-8279-4176-9646-4fc5ab0bc17e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:21.161487 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6d9bab33-8279-4176-9646-4fc5ab0bc17e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:21.390342 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-6d9bab33-8279-4176-9646-4fc5ab0bc17e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:21.405082 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-6d9bab33-8279-4176-9646-4fc5ab0bc17e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:21.409820 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-6d9bab33-8279-4176-9646-4fc5ab0bc17e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:21.411022 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-6d9bab33-8279-4176-9646-4fc5ab0bc17e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1749 microversion: 2.20 time: 0.270176 Dec 16 15:00:21.411613 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 383/753] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:00:21 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1749 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:00:22.577761 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-32b1acc3-2e56-46cc-847d-affbe0e1bc34 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:00:22.578548 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-32b1acc3-2e56-46cc-847d-affbe0e1bc34 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:00:22.586661 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-32b1acc3-2e56-46cc-847d-affbe0e1bc34 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:22.587817 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-32b1acc3-2e56-46cc-847d-affbe0e1bc34 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:22.588668 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-32b1acc3-2e56-46cc-847d-affbe0e1bc34 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:22.589159 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-32b1acc3-2e56-46cc-847d-affbe0e1bc34 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:22.806264 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-32b1acc3-2e56-46cc-847d-affbe0e1bc34 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:22.818986 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-32b1acc3-2e56-46cc-847d-affbe0e1bc34 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:22.823953 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-32b1acc3-2e56-46cc-847d-affbe0e1bc34 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:22.825135 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-32b1acc3-2e56-46cc-847d-affbe0e1bc34 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1749 microversion: 2.20 time: 0.397505 Dec 16 15:00:22.825720 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 371/754] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:00:22 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1749 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:00:23.848940 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-e935a6bd-3a49-4f9e-b80d-c070232ec823 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:00:23.849741 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-e935a6bd-3a49-4f9e-b80d-c070232ec823 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:00:23.854345 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 15:00:23.854532 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: Thu Dec 16 15:00:23 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac (ip 10.222.0.45) !!! Dec 16 15:00:23.872853 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e935a6bd-3a49-4f9e-b80d-c070232ec823 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:23.873879 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e935a6bd-3a49-4f9e-b80d-c070232ec823 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:23.874782 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e935a6bd-3a49-4f9e-b80d-c070232ec823 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:23.875264 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e935a6bd-3a49-4f9e-b80d-c070232ec823 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:24.094773 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-e935a6bd-3a49-4f9e-b80d-c070232ec823 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:24.108249 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-e935a6bd-3a49-4f9e-b80d-c070232ec823 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:24.112649 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-e935a6bd-3a49-4f9e-b80d-c070232ec823 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:24.113830 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-e935a6bd-3a49-4f9e-b80d-c070232ec823 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1749 microversion: 2.20 time: 0.272835 Dec 16 15:00:24.114441 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 384/755] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:00:23 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1749 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:00:25.136722 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-8d4620f5-d028-436b-a0ef-b6ec7baed5cd tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:00:25.137393 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-8d4620f5-d028-436b-a0ef-b6ec7baed5cd tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:00:25.145519 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8d4620f5-d028-436b-a0ef-b6ec7baed5cd tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:25.146027 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8d4620f5-d028-436b-a0ef-b6ec7baed5cd tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:25.146911 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8d4620f5-d028-436b-a0ef-b6ec7baed5cd tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:25.147410 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8d4620f5-d028-436b-a0ef-b6ec7baed5cd tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:25.367148 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-8d4620f5-d028-436b-a0ef-b6ec7baed5cd tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:25.389832 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-8d4620f5-d028-436b-a0ef-b6ec7baed5cd tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:25.396390 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-8d4620f5-d028-436b-a0ef-b6ec7baed5cd tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:25.397947 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-8d4620f5-d028-436b-a0ef-b6ec7baed5cd tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1749 microversion: 2.20 time: 0.268982 Dec 16 15:00:25.398983 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 372/756] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:00:25 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1749 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:00:26.421339 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-dc652498-6f16-4cce-a9f8-9c7cf4ef846f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:00:26.422004 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-dc652498-6f16-4cce-a9f8-9c7cf4ef846f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:00:26.429922 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-dc652498-6f16-4cce-a9f8-9c7cf4ef846f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:26.431108 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-dc652498-6f16-4cce-a9f8-9c7cf4ef846f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:26.431955 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-dc652498-6f16-4cce-a9f8-9c7cf4ef846f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:26.432445 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-dc652498-6f16-4cce-a9f8-9c7cf4ef846f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:26.655174 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-dc652498-6f16-4cce-a9f8-9c7cf4ef846f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:26.668465 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-dc652498-6f16-4cce-a9f8-9c7cf4ef846f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:26.672925 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-dc652498-6f16-4cce-a9f8-9c7cf4ef846f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:26.674122 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-dc652498-6f16-4cce-a9f8-9c7cf4ef846f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1749 microversion: 2.20 time: 0.260942 Dec 16 15:00:26.674710 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 385/757] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:00:26 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1749 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:00:27.699134 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-c0476388-163d-4e6b-966a-7258fc09aba0 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:00:27.699800 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-c0476388-163d-4e6b-966a-7258fc09aba0 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:00:27.708830 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c0476388-163d-4e6b-966a-7258fc09aba0 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:27.709337 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c0476388-163d-4e6b-966a-7258fc09aba0 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:27.710208 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c0476388-163d-4e6b-966a-7258fc09aba0 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:27.710704 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c0476388-163d-4e6b-966a-7258fc09aba0 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:27.920448 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-c0476388-163d-4e6b-966a-7258fc09aba0 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:27.934136 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-c0476388-163d-4e6b-966a-7258fc09aba0 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:27.938657 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-c0476388-163d-4e6b-966a-7258fc09aba0 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:27.939730 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-c0476388-163d-4e6b-966a-7258fc09aba0 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1749 microversion: 2.20 time: 0.250775 Dec 16 15:00:27.940320 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 373/758] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:00:27 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1749 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:00:28.966153 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-42aa1d91-c064-4de5-9331-1c928d0aa34f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:00:28.966713 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-42aa1d91-c064-4de5-9331-1c928d0aa34f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:00:28.974562 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-42aa1d91-c064-4de5-9331-1c928d0aa34f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:28.975062 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-42aa1d91-c064-4de5-9331-1c928d0aa34f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:28.975896 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-42aa1d91-c064-4de5-9331-1c928d0aa34f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:28.976389 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-42aa1d91-c064-4de5-9331-1c928d0aa34f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:29.191398 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-42aa1d91-c064-4de5-9331-1c928d0aa34f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:29.204952 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-42aa1d91-c064-4de5-9331-1c928d0aa34f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:29.209423 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-42aa1d91-c064-4de5-9331-1c928d0aa34f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:29.210635 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-42aa1d91-c064-4de5-9331-1c928d0aa34f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1749 microversion: 2.20 time: 0.252217 Dec 16 15:00:29.211224 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 386/759] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:00:28 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1749 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:00:30.234187 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-5e4145b5-86f8-4498-afef-5490653623e4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:00:30.234865 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-5e4145b5-86f8-4498-afef-5490653623e4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:00:30.243963 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5e4145b5-86f8-4498-afef-5490653623e4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:30.244473 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5e4145b5-86f8-4498-afef-5490653623e4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:30.245316 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5e4145b5-86f8-4498-afef-5490653623e4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:30.245813 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5e4145b5-86f8-4498-afef-5490653623e4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:30.460138 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-5e4145b5-86f8-4498-afef-5490653623e4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:30.473441 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-5e4145b5-86f8-4498-afef-5490653623e4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:30.478605 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-5e4145b5-86f8-4498-afef-5490653623e4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:30.479787 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-5e4145b5-86f8-4498-afef-5490653623e4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1749 microversion: 2.20 time: 0.253870 Dec 16 15:00:30.480378 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 374/760] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:00:30 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1749 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:00:31.502054 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-86431fc5-f550-4a31-b096-d32b71bfde78 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:00:31.502744 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-86431fc5-f550-4a31-b096-d32b71bfde78 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:00:31.511307 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-86431fc5-f550-4a31-b096-d32b71bfde78 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:31.511816 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-86431fc5-f550-4a31-b096-d32b71bfde78 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:31.512652 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-86431fc5-f550-4a31-b096-d32b71bfde78 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:31.513151 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-86431fc5-f550-4a31-b096-d32b71bfde78 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:31.728918 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-86431fc5-f550-4a31-b096-d32b71bfde78 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:31.741417 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-86431fc5-f550-4a31-b096-d32b71bfde78 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:31.745839 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-86431fc5-f550-4a31-b096-d32b71bfde78 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:31.747048 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-86431fc5-f550-4a31-b096-d32b71bfde78 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1749 microversion: 2.20 time: 0.252733 Dec 16 15:00:31.747630 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 387/761] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:00:31 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1749 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:00:32.770533 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-966832d6-7cd5-4d43-964a-888524ffc3c8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:00:32.771200 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-966832d6-7cd5-4d43-964a-888524ffc3c8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:00:32.779297 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-966832d6-7cd5-4d43-964a-888524ffc3c8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:32.779805 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-966832d6-7cd5-4d43-964a-888524ffc3c8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:32.780642 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-966832d6-7cd5-4d43-964a-888524ffc3c8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:32.781135 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-966832d6-7cd5-4d43-964a-888524ffc3c8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:32.993782 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-966832d6-7cd5-4d43-964a-888524ffc3c8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:33.006414 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-966832d6-7cd5-4d43-964a-888524ffc3c8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:33.010894 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-966832d6-7cd5-4d43-964a-888524ffc3c8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:33.012069 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-966832d6-7cd5-4d43-964a-888524ffc3c8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1749 microversion: 2.20 time: 0.249224 Dec 16 15:00:33.012651 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 375/762] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:00:32 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1749 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:00:34.046179 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-e819471c-8896-4963-aeac-3dbc31de69dd tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:00:34.046179 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-e819471c-8896-4963-aeac-3dbc31de69dd tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:00:34.046179 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e819471c-8896-4963-aeac-3dbc31de69dd tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:34.046179 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e819471c-8896-4963-aeac-3dbc31de69dd tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:34.047683 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e819471c-8896-4963-aeac-3dbc31de69dd tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:34.047683 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e819471c-8896-4963-aeac-3dbc31de69dd tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:34.261422 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-e819471c-8896-4963-aeac-3dbc31de69dd tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:34.274727 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-e819471c-8896-4963-aeac-3dbc31de69dd tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:34.279203 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-e819471c-8896-4963-aeac-3dbc31de69dd tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:34.280378 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-e819471c-8896-4963-aeac-3dbc31de69dd tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1749 microversion: 2.20 time: 0.252326 Dec 16 15:00:34.280965 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 388/763] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:00:34 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1749 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:00:35.304153 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-d8a6d404-0055-47c4-9b41-12dd4533e2b3 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:00:35.304866 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-d8a6d404-0055-47c4-9b41-12dd4533e2b3 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:00:35.313332 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d8a6d404-0055-47c4-9b41-12dd4533e2b3 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:35.313846 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d8a6d404-0055-47c4-9b41-12dd4533e2b3 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:35.314711 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d8a6d404-0055-47c4-9b41-12dd4533e2b3 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:35.315203 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d8a6d404-0055-47c4-9b41-12dd4533e2b3 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:35.529040 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-d8a6d404-0055-47c4-9b41-12dd4533e2b3 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:35.542159 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-d8a6d404-0055-47c4-9b41-12dd4533e2b3 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:35.546614 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-d8a6d404-0055-47c4-9b41-12dd4533e2b3 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:35.547788 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-d8a6d404-0055-47c4-9b41-12dd4533e2b3 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1749 microversion: 2.20 time: 0.251309 Dec 16 15:00:35.548366 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 376/764] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:00:35 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1749 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:00:36.572104 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-5d6b42cc-1c7c-44c5-a3ba-c047d803d4a8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:00:36.572715 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-5d6b42cc-1c7c-44c5-a3ba-c047d803d4a8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:00:36.580743 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5d6b42cc-1c7c-44c5-a3ba-c047d803d4a8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:36.581248 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5d6b42cc-1c7c-44c5-a3ba-c047d803d4a8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:36.582106 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5d6b42cc-1c7c-44c5-a3ba-c047d803d4a8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:36.582604 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5d6b42cc-1c7c-44c5-a3ba-c047d803d4a8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:36.799687 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-5d6b42cc-1c7c-44c5-a3ba-c047d803d4a8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:36.813033 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-5d6b42cc-1c7c-44c5-a3ba-c047d803d4a8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:36.817474 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-5d6b42cc-1c7c-44c5-a3ba-c047d803d4a8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:36.818671 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-5d6b42cc-1c7c-44c5-a3ba-c047d803d4a8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1749 microversion: 2.20 time: 0.254816 Dec 16 15:00:36.819262 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 389/765] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:00:36 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1749 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:00:37.762928 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-6e0ddfbe-48ab-418d-ace2-f8f752765855 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:00:37.770909 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6e0ddfbe-48ab-418d-ace2-f8f752765855 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:37.771486 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6e0ddfbe-48ab-418d-ace2-f8f752765855 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:37.833564 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-6e0ddfbe-48ab-418d-ace2-f8f752765855 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Going to try to stop instance {{(pid=101355) force_stop /opt/stack/nova/nova/compute/api.py:2536}} Dec 16 15:00:37.843112 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-fe4baf64-25d1-4262-a328-8dba85b4c633 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:00:37.843772 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-fe4baf64-25d1-4262-a328-8dba85b4c633 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:00:37.851646 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fe4baf64-25d1-4262-a328-8dba85b4c633 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:37.852138 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fe4baf64-25d1-4262-a328-8dba85b4c633 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:37.853002 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fe4baf64-25d1-4262-a328-8dba85b4c633 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:37.853486 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fe4baf64-25d1-4262-a328-8dba85b4c633 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:37.991787 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-6e0ddfbe-48ab-418d-ace2-f8f752765855 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 202 len: 0 microversion: 2.1 time: 0.236794 Dec 16 15:00:37.992865 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 377/766] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 15:00:37 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:00:38.005477 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-30808096-8f12-4293-95cb-08ccf4bc5e2d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:00:38.006531 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-30808096-8f12-4293-95cb-08ccf4bc5e2d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:00:38.027638 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-30808096-8f12-4293-95cb-08ccf4bc5e2d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:38.027638 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-30808096-8f12-4293-95cb-08ccf4bc5e2d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:38.027638 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-30808096-8f12-4293-95cb-08ccf4bc5e2d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:38.027638 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-30808096-8f12-4293-95cb-08ccf4bc5e2d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:38.071802 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-fe4baf64-25d1-4262-a328-8dba85b4c633 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:38.089372 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-fe4baf64-25d1-4262-a328-8dba85b4c633 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:38.094108 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-fe4baf64-25d1-4262-a328-8dba85b4c633 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:38.095384 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-fe4baf64-25d1-4262-a328-8dba85b4c633 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1749 microversion: 2.20 time: 0.260451 Dec 16 15:00:38.095974 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 390/767] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:00:37 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1749 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 15:00:38.235969 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-30808096-8f12-4293-95cb-08ccf4bc5e2d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:38.246135 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-30808096-8f12-4293-95cb-08ccf4bc5e2d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14" status: 200 len: 1724 microversion: 2.1 time: 0.248636 Dec 16 15:00:38.246681 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 378/768] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:00:37 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14 => generated 1724 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:00:39.118904 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-edbcb1c4-ee31-41c7-8189-9567d841337e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:00:39.119563 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-edbcb1c4-ee31-41c7-8189-9567d841337e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:00:39.122690 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 15:00:39.122837 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: Thu Dec 16 15:00:39 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac (ip 10.222.0.45) !!! Dec 16 15:00:39.139141 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-edbcb1c4-ee31-41c7-8189-9567d841337e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:39.139681 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-edbcb1c4-ee31-41c7-8189-9567d841337e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:39.140509 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-edbcb1c4-ee31-41c7-8189-9567d841337e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:39.140997 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-edbcb1c4-ee31-41c7-8189-9567d841337e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:39.268816 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-da468540-6e6c-494e-94db-461b7bbe7d6d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:00:39.269519 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-da468540-6e6c-494e-94db-461b7bbe7d6d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:00:39.278415 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-da468540-6e6c-494e-94db-461b7bbe7d6d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:39.278929 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-da468540-6e6c-494e-94db-461b7bbe7d6d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:39.279821 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-da468540-6e6c-494e-94db-461b7bbe7d6d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:39.280419 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-da468540-6e6c-494e-94db-461b7bbe7d6d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:39.376577 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-edbcb1c4-ee31-41c7-8189-9567d841337e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:39.390439 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-edbcb1c4-ee31-41c7-8189-9567d841337e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:39.394947 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-edbcb1c4-ee31-41c7-8189-9567d841337e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:39.396158 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-edbcb1c4-ee31-41c7-8189-9567d841337e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1749 microversion: 2.20 time: 0.285463 Dec 16 15:00:39.396786 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 391/769] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:00:39 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1749 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:00:39.506170 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-da468540-6e6c-494e-94db-461b7bbe7d6d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:39.516195 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-da468540-6e6c-494e-94db-461b7bbe7d6d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14" status: 200 len: 1724 microversion: 2.1 time: 0.255266 Dec 16 15:00:39.516797 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 379/770] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:00:39 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14 => generated 1724 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:00:40.419456 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-8eeea26d-8634-4c2a-aa07-c742b958b062 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:00:40.420244 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-8eeea26d-8634-4c2a-aa07-c742b958b062 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:00:40.428447 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8eeea26d-8634-4c2a-aa07-c742b958b062 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:40.428952 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8eeea26d-8634-4c2a-aa07-c742b958b062 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:40.430386 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8eeea26d-8634-4c2a-aa07-c742b958b062 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:40.430898 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8eeea26d-8634-4c2a-aa07-c742b958b062 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:40.538382 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-0f614e47-03f5-4642-b8ee-2d3acb89dcf0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:00:40.539064 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-0f614e47-03f5-4642-b8ee-2d3acb89dcf0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:00:40.547485 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0f614e47-03f5-4642-b8ee-2d3acb89dcf0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:40.548000 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0f614e47-03f5-4642-b8ee-2d3acb89dcf0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:40.548853 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0f614e47-03f5-4642-b8ee-2d3acb89dcf0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:40.549353 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0f614e47-03f5-4642-b8ee-2d3acb89dcf0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:40.646465 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-8eeea26d-8634-4c2a-aa07-c742b958b062 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:40.659158 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-8eeea26d-8634-4c2a-aa07-c742b958b062 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:40.663627 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-8eeea26d-8634-4c2a-aa07-c742b958b062 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:40.665343 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-8eeea26d-8634-4c2a-aa07-c742b958b062 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1749 microversion: 2.20 time: 0.253676 Dec 16 15:00:40.665937 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 392/771] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:00:40 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1749 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:00:40.770051 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-0f614e47-03f5-4642-b8ee-2d3acb89dcf0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:40.779486 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-0f614e47-03f5-4642-b8ee-2d3acb89dcf0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14" status: 200 len: 1724 microversion: 2.1 time: 0.248710 Dec 16 15:00:40.780075 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 380/772] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:00:40 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14 => generated 1724 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:00:41.688438 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-efc66572-94a1-40dd-ac80-28fe40dfc99c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:00:41.689126 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-efc66572-94a1-40dd-ac80-28fe40dfc99c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:00:41.697632 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-efc66572-94a1-40dd-ac80-28fe40dfc99c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:41.698168 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-efc66572-94a1-40dd-ac80-28fe40dfc99c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:41.699009 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-efc66572-94a1-40dd-ac80-28fe40dfc99c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:41.699506 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-efc66572-94a1-40dd-ac80-28fe40dfc99c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:41.803028 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-47876103-3065-426f-a380-79f4a0cea16f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:00:41.803778 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-47876103-3065-426f-a380-79f4a0cea16f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:00:41.812362 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-47876103-3065-426f-a380-79f4a0cea16f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:41.812965 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-47876103-3065-426f-a380-79f4a0cea16f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:41.813881 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-47876103-3065-426f-a380-79f4a0cea16f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:41.814499 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-47876103-3065-426f-a380-79f4a0cea16f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:41.915426 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-efc66572-94a1-40dd-ac80-28fe40dfc99c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:41.928891 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-efc66572-94a1-40dd-ac80-28fe40dfc99c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:41.933860 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-efc66572-94a1-40dd-ac80-28fe40dfc99c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:41.935161 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-efc66572-94a1-40dd-ac80-28fe40dfc99c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1749 microversion: 2.20 time: 0.254955 Dec 16 15:00:41.935748 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 393/773] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:00:41 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1749 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:00:42.029616 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-47876103-3065-426f-a380-79f4a0cea16f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:42.038988 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-47876103-3065-426f-a380-79f4a0cea16f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14" status: 200 len: 1724 microversion: 2.1 time: 0.244273 Dec 16 15:00:42.040087 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 381/774] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:00:41 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14 => generated 1724 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:00:42.959173 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-9fe4729e-15b6-43c1-9482-682bc12fd25c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:00:42.959926 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-9fe4729e-15b6-43c1-9482-682bc12fd25c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:00:42.968387 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9fe4729e-15b6-43c1-9482-682bc12fd25c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:42.968898 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9fe4729e-15b6-43c1-9482-682bc12fd25c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:42.969735 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9fe4729e-15b6-43c1-9482-682bc12fd25c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:42.970260 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9fe4729e-15b6-43c1-9482-682bc12fd25c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:43.060824 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-e2eacc6b-cc2d-4036-832d-eaecf30729d3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:00:43.061602 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-e2eacc6b-cc2d-4036-832d-eaecf30729d3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:00:43.069453 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e2eacc6b-cc2d-4036-832d-eaecf30729d3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:43.070104 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e2eacc6b-cc2d-4036-832d-eaecf30729d3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:43.071449 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e2eacc6b-cc2d-4036-832d-eaecf30729d3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:43.071937 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e2eacc6b-cc2d-4036-832d-eaecf30729d3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:43.207021 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-9fe4729e-15b6-43c1-9482-682bc12fd25c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:43.221383 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-9fe4729e-15b6-43c1-9482-682bc12fd25c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:43.226159 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-9fe4729e-15b6-43c1-9482-682bc12fd25c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:43.227379 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-9fe4729e-15b6-43c1-9482-682bc12fd25c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1749 microversion: 2.20 time: 0.275930 Dec 16 15:00:43.227968 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 394/775] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:00:42 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1749 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:00:43.303127 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-e2eacc6b-cc2d-4036-832d-eaecf30729d3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:43.312930 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-e2eacc6b-cc2d-4036-832d-eaecf30729d3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14" status: 200 len: 1724 microversion: 2.1 time: 0.259960 Dec 16 15:00:43.313527 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 382/776] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:00:43 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14 => generated 1724 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:00:44.250609 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-591ee665-eacf-4fb7-b1d8-7da3eaa01499 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:00:44.251208 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-591ee665-eacf-4fb7-b1d8-7da3eaa01499 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:00:44.259590 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-591ee665-eacf-4fb7-b1d8-7da3eaa01499 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:44.260097 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-591ee665-eacf-4fb7-b1d8-7da3eaa01499 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:44.260935 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-591ee665-eacf-4fb7-b1d8-7da3eaa01499 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:44.261433 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-591ee665-eacf-4fb7-b1d8-7da3eaa01499 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:44.351060 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-6ee01263-512a-41b0-9501-ee939ed021ce tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:00:44.351770 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-6ee01263-512a-41b0-9501-ee939ed021ce tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:00:44.359828 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6ee01263-512a-41b0-9501-ee939ed021ce tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:44.360345 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6ee01263-512a-41b0-9501-ee939ed021ce tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:44.361196 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6ee01263-512a-41b0-9501-ee939ed021ce tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:44.361695 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6ee01263-512a-41b0-9501-ee939ed021ce tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:44.476313 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-591ee665-eacf-4fb7-b1d8-7da3eaa01499 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:44.489543 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-591ee665-eacf-4fb7-b1d8-7da3eaa01499 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:44.494289 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-591ee665-eacf-4fb7-b1d8-7da3eaa01499 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:44.495581 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-591ee665-eacf-4fb7-b1d8-7da3eaa01499 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1749 microversion: 2.20 time: 0.252822 Dec 16 15:00:44.496174 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 395/777] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:00:44 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1749 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:00:44.583543 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-6ee01263-512a-41b0-9501-ee939ed021ce tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:44.593386 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-6ee01263-512a-41b0-9501-ee939ed021ce tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14" status: 200 len: 1724 microversion: 2.1 time: 0.265298 Dec 16 15:00:44.593976 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 383/778] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:00:44 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14 => generated 1724 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:00:45.523486 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-90c28db8-274c-482a-ab11-49c1cf6ef8b0 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:00:45.524157 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-90c28db8-274c-482a-ab11-49c1cf6ef8b0 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:00:45.531928 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-90c28db8-274c-482a-ab11-49c1cf6ef8b0 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:45.532429 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-90c28db8-274c-482a-ab11-49c1cf6ef8b0 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:45.533258 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-90c28db8-274c-482a-ab11-49c1cf6ef8b0 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:45.533737 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-90c28db8-274c-482a-ab11-49c1cf6ef8b0 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:45.615490 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-01fa6ec7-53a0-447b-9a4a-a160cac0b14d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:00:45.616198 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-01fa6ec7-53a0-447b-9a4a-a160cac0b14d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:00:45.624655 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-01fa6ec7-53a0-447b-9a4a-a160cac0b14d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:45.625168 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-01fa6ec7-53a0-447b-9a4a-a160cac0b14d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:45.626029 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-01fa6ec7-53a0-447b-9a4a-a160cac0b14d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:45.626548 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-01fa6ec7-53a0-447b-9a4a-a160cac0b14d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:45.754181 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-90c28db8-274c-482a-ab11-49c1cf6ef8b0 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:45.767015 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-90c28db8-274c-482a-ab11-49c1cf6ef8b0 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:45.771692 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-90c28db8-274c-482a-ab11-49c1cf6ef8b0 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:45.772883 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-90c28db8-274c-482a-ab11-49c1cf6ef8b0 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1749 microversion: 2.20 time: 0.256924 Dec 16 15:00:45.773511 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 396/779] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:00:45 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1749 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:00:45.840808 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-01fa6ec7-53a0-447b-9a4a-a160cac0b14d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:45.850225 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-01fa6ec7-53a0-447b-9a4a-a160cac0b14d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14" status: 200 len: 1724 microversion: 2.1 time: 0.242741 Dec 16 15:00:45.850822 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 384/780] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:00:45 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14 => generated 1724 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:00:46.795959 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-ce5c1447-4f2d-4bba-915b-ef53dd6fef26 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:00:46.796626 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-ce5c1447-4f2d-4bba-915b-ef53dd6fef26 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:00:46.804479 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ce5c1447-4f2d-4bba-915b-ef53dd6fef26 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:46.804988 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ce5c1447-4f2d-4bba-915b-ef53dd6fef26 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:46.805829 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ce5c1447-4f2d-4bba-915b-ef53dd6fef26 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:46.806352 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ce5c1447-4f2d-4bba-915b-ef53dd6fef26 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:46.873050 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-2dfae8a9-335d-4819-b095-628b284796f2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:00:46.873716 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-2dfae8a9-335d-4819-b095-628b284796f2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:00:46.881518 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2dfae8a9-335d-4819-b095-628b284796f2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:46.882021 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2dfae8a9-335d-4819-b095-628b284796f2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:46.883594 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2dfae8a9-335d-4819-b095-628b284796f2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:46.884092 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2dfae8a9-335d-4819-b095-628b284796f2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:47.039295 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-ce5c1447-4f2d-4bba-915b-ef53dd6fef26 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:47.051999 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-ce5c1447-4f2d-4bba-915b-ef53dd6fef26 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:47.057085 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-ce5c1447-4f2d-4bba-915b-ef53dd6fef26 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:47.058353 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-ce5c1447-4f2d-4bba-915b-ef53dd6fef26 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1749 microversion: 2.20 time: 0.269961 Dec 16 15:00:47.059156 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 397/781] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:00:46 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1749 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:00:47.277532 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-2dfae8a9-335d-4819-b095-628b284796f2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:47.287078 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-2dfae8a9-335d-4819-b095-628b284796f2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14" status: 200 len: 1724 microversion: 2.1 time: 0.422232 Dec 16 15:00:47.287681 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 385/782] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:00:46 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14 => generated 1724 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:00:48.083103 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-a6ea3ce4-1f9b-41d9-8426-347442a5fda1 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:00:48.083780 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-a6ea3ce4-1f9b-41d9-8426-347442a5fda1 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:00:48.103381 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a6ea3ce4-1f9b-41d9-8426-347442a5fda1 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:48.103899 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a6ea3ce4-1f9b-41d9-8426-347442a5fda1 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:48.104789 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a6ea3ce4-1f9b-41d9-8426-347442a5fda1 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:48.105289 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a6ea3ce4-1f9b-41d9-8426-347442a5fda1 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:48.310792 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-59a73149-b7e5-478a-b969-1e72c5065a80 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:00:48.311475 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-59a73149-b7e5-478a-b969-1e72c5065a80 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:00:48.319758 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-59a73149-b7e5-478a-b969-1e72c5065a80 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:48.320266 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-59a73149-b7e5-478a-b969-1e72c5065a80 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:48.321113 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-59a73149-b7e5-478a-b969-1e72c5065a80 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:48.321606 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-59a73149-b7e5-478a-b969-1e72c5065a80 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:48.340724 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-a6ea3ce4-1f9b-41d9-8426-347442a5fda1 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:48.355987 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-a6ea3ce4-1f9b-41d9-8426-347442a5fda1 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:48.361103 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-a6ea3ce4-1f9b-41d9-8426-347442a5fda1 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:48.363720 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-a6ea3ce4-1f9b-41d9-8426-347442a5fda1 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1749 microversion: 2.20 time: 0.287420 Dec 16 15:00:48.374376 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 398/783] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:00:48 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1749 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:00:48.545659 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-59a73149-b7e5-478a-b969-1e72c5065a80 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:48.555509 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-59a73149-b7e5-478a-b969-1e72c5065a80 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14" status: 200 len: 1724 microversion: 2.1 time: 0.253935 Dec 16 15:00:48.556096 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 386/784] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:00:48 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14 => generated 1724 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:00:49.385610 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-540dc009-a6f6-41db-a885-350d66d5d809 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:00:49.386198 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-540dc009-a6f6-41db-a885-350d66d5d809 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:00:49.394042 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-540dc009-a6f6-41db-a885-350d66d5d809 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:49.394576 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-540dc009-a6f6-41db-a885-350d66d5d809 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:49.395417 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-540dc009-a6f6-41db-a885-350d66d5d809 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:49.395910 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-540dc009-a6f6-41db-a885-350d66d5d809 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:49.577521 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-db8a3a71-ae51-4492-8c27-a65e0ccaa6a6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:00:49.578262 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-db8a3a71-ae51-4492-8c27-a65e0ccaa6a6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:00:49.586830 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-db8a3a71-ae51-4492-8c27-a65e0ccaa6a6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:49.587344 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-db8a3a71-ae51-4492-8c27-a65e0ccaa6a6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:49.588192 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-db8a3a71-ae51-4492-8c27-a65e0ccaa6a6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:49.588690 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-db8a3a71-ae51-4492-8c27-a65e0ccaa6a6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:49.616725 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-540dc009-a6f6-41db-a885-350d66d5d809 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:49.629474 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-540dc009-a6f6-41db-a885-350d66d5d809 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:49.634530 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-540dc009-a6f6-41db-a885-350d66d5d809 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:49.635753 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-540dc009-a6f6-41db-a885-350d66d5d809 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1749 microversion: 2.20 time: 0.257905 Dec 16 15:00:49.636283 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 399/785] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:00:49 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1749 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:00:49.800189 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-db8a3a71-ae51-4492-8c27-a65e0ccaa6a6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:49.809658 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-db8a3a71-ae51-4492-8c27-a65e0ccaa6a6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14" status: 200 len: 1724 microversion: 2.1 time: 0.240775 Dec 16 15:00:49.810281 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 387/786] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:00:49 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14 => generated 1724 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:00:50.658598 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-3d922a8c-d8f3-44d8-8da9-e574d8edc495 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:00:50.659267 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-3d922a8c-d8f3-44d8-8da9-e574d8edc495 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:00:50.667070 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3d922a8c-d8f3-44d8-8da9-e574d8edc495 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:50.667580 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3d922a8c-d8f3-44d8-8da9-e574d8edc495 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:50.668426 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3d922a8c-d8f3-44d8-8da9-e574d8edc495 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:50.668918 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3d922a8c-d8f3-44d8-8da9-e574d8edc495 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:50.832136 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-47be50f1-fcff-4771-8a61-17dfa52edafd tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:00:50.832812 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-47be50f1-fcff-4771-8a61-17dfa52edafd tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:00:50.840912 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-47be50f1-fcff-4771-8a61-17dfa52edafd tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:50.841419 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-47be50f1-fcff-4771-8a61-17dfa52edafd tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:50.842297 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-47be50f1-fcff-4771-8a61-17dfa52edafd tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:50.842796 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-47be50f1-fcff-4771-8a61-17dfa52edafd tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:51.017766 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-3d922a8c-d8f3-44d8-8da9-e574d8edc495 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:51.030726 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-3d922a8c-d8f3-44d8-8da9-e574d8edc495 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:51.035132 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-3d922a8c-d8f3-44d8-8da9-e574d8edc495 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:51.036322 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-3d922a8c-d8f3-44d8-8da9-e574d8edc495 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1749 microversion: 2.20 time: 0.385284 Dec 16 15:00:51.036921 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 400/787] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:00:50 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1749 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:00:51.059628 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-47be50f1-fcff-4771-8a61-17dfa52edafd tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:51.070801 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-47be50f1-fcff-4771-8a61-17dfa52edafd tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14" status: 200 len: 1724 microversion: 2.1 time: 0.246753 Dec 16 15:00:51.071396 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 388/788] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:00:50 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14 => generated 1724 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:00:52.060173 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-7c742a80-a363-45c7-8649-f9443e00d892 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:00:52.060845 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-7c742a80-a363-45c7-8649-f9443e00d892 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:00:52.068725 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7c742a80-a363-45c7-8649-f9443e00d892 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:52.069231 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7c742a80-a363-45c7-8649-f9443e00d892 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:52.070114 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7c742a80-a363-45c7-8649-f9443e00d892 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:52.070606 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7c742a80-a363-45c7-8649-f9443e00d892 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:52.093223 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-0c2d14a9-7234-41cb-b19e-af035ad05364 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:00:52.093979 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-0c2d14a9-7234-41cb-b19e-af035ad05364 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:00:52.102512 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0c2d14a9-7234-41cb-b19e-af035ad05364 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:52.103013 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0c2d14a9-7234-41cb-b19e-af035ad05364 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:52.103853 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0c2d14a9-7234-41cb-b19e-af035ad05364 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:52.104372 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0c2d14a9-7234-41cb-b19e-af035ad05364 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:52.333238 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-0c2d14a9-7234-41cb-b19e-af035ad05364 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:52.344210 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-0c2d14a9-7234-41cb-b19e-af035ad05364 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14" status: 200 len: 1724 microversion: 2.1 time: 0.258912 Dec 16 15:00:52.344850 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 389/789] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:00:52 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14 => generated 1724 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:00:52.493575 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-7c742a80-a363-45c7-8649-f9443e00d892 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:52.506610 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-7c742a80-a363-45c7-8649-f9443e00d892 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:52.511678 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-7c742a80-a363-45c7-8649-f9443e00d892 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:52.512862 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-7c742a80-a363-45c7-8649-f9443e00d892 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1749 microversion: 2.20 time: 0.460951 Dec 16 15:00:52.513583 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 401/790] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:00:52 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1749 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:00:53.367859 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-26081ee3-952d-4dbe-9cf2-dface84fb54c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:00:53.368551 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-26081ee3-952d-4dbe-9cf2-dface84fb54c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:00:53.376468 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-26081ee3-952d-4dbe-9cf2-dface84fb54c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:53.376977 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-26081ee3-952d-4dbe-9cf2-dface84fb54c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:53.377810 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-26081ee3-952d-4dbe-9cf2-dface84fb54c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:53.378329 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-26081ee3-952d-4dbe-9cf2-dface84fb54c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:53.536614 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-ee2c3d8f-3335-49c8-80e1-53e3318e8956 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:00:53.537432 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-ee2c3d8f-3335-49c8-80e1-53e3318e8956 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:00:53.546023 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ee2c3d8f-3335-49c8-80e1-53e3318e8956 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:53.546504 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ee2c3d8f-3335-49c8-80e1-53e3318e8956 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:53.547447 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ee2c3d8f-3335-49c8-80e1-53e3318e8956 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:53.547938 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ee2c3d8f-3335-49c8-80e1-53e3318e8956 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:53.597806 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-26081ee3-952d-4dbe-9cf2-dface84fb54c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:53.608075 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-26081ee3-952d-4dbe-9cf2-dface84fb54c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14" status: 200 len: 1724 microversion: 2.1 time: 0.248539 Dec 16 15:00:53.608896 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 390/791] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:00:53 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14 => generated 1724 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:00:53.766991 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-ee2c3d8f-3335-49c8-80e1-53e3318e8956 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:53.780191 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-ee2c3d8f-3335-49c8-80e1-53e3318e8956 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:53.784633 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-ee2c3d8f-3335-49c8-80e1-53e3318e8956 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:53.785808 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-ee2c3d8f-3335-49c8-80e1-53e3318e8956 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1749 microversion: 2.20 time: 0.256924 Dec 16 15:00:53.786443 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 402/792] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:00:53 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1749 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 15:00:54.629836 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-de22fa7e-5110-4c09-ae99-cde45e53c58f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:00:54.630530 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-de22fa7e-5110-4c09-ae99-cde45e53c58f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:00:54.638979 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-de22fa7e-5110-4c09-ae99-cde45e53c58f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:54.639438 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-de22fa7e-5110-4c09-ae99-cde45e53c58f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:54.640285 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-de22fa7e-5110-4c09-ae99-cde45e53c58f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:54.640780 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-de22fa7e-5110-4c09-ae99-cde45e53c58f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:54.809339 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-455c1ff2-6d88-4750-92c3-5958d65a4320 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:00:54.810019 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-455c1ff2-6d88-4750-92c3-5958d65a4320 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:00:54.818117 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-455c1ff2-6d88-4750-92c3-5958d65a4320 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:54.818646 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-455c1ff2-6d88-4750-92c3-5958d65a4320 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:54.819504 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-455c1ff2-6d88-4750-92c3-5958d65a4320 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:54.819998 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-455c1ff2-6d88-4750-92c3-5958d65a4320 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:54.861620 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-de22fa7e-5110-4c09-ae99-cde45e53c58f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:54.871959 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-de22fa7e-5110-4c09-ae99-cde45e53c58f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14" status: 200 len: 1724 microversion: 2.1 time: 0.249761 Dec 16 15:00:54.872782 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 391/793] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:00:54 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14 => generated 1724 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:00:55.038026 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-455c1ff2-6d88-4750-92c3-5958d65a4320 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:55.051632 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-455c1ff2-6d88-4750-92c3-5958d65a4320 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:55.056600 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-455c1ff2-6d88-4750-92c3-5958d65a4320 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:55.057772 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-455c1ff2-6d88-4750-92c3-5958d65a4320 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1749 microversion: 2.20 time: 0.256926 Dec 16 15:00:55.058437 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 403/794] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:00:54 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1749 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:00:55.894137 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-1e7666c9-9a52-4c60-9bfc-d7094a55410d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:00:55.894808 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-1e7666c9-9a52-4c60-9bfc-d7094a55410d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:00:55.904051 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1e7666c9-9a52-4c60-9bfc-d7094a55410d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:55.904473 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1e7666c9-9a52-4c60-9bfc-d7094a55410d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:55.905637 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1e7666c9-9a52-4c60-9bfc-d7094a55410d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:55.906168 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1e7666c9-9a52-4c60-9bfc-d7094a55410d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:56.080994 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-72cf88ec-3ac9-4f49-a69d-e452168d22fa tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:00:56.081665 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-72cf88ec-3ac9-4f49-a69d-e452168d22fa tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:00:56.089578 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-72cf88ec-3ac9-4f49-a69d-e452168d22fa tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:56.090149 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-72cf88ec-3ac9-4f49-a69d-e452168d22fa tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:56.091002 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-72cf88ec-3ac9-4f49-a69d-e452168d22fa tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:56.091490 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-72cf88ec-3ac9-4f49-a69d-e452168d22fa tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:56.136276 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-1e7666c9-9a52-4c60-9bfc-d7094a55410d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:56.146208 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-1e7666c9-9a52-4c60-9bfc-d7094a55410d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14" status: 200 len: 1724 microversion: 2.1 time: 0.259809 Dec 16 15:00:56.146811 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 392/795] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:00:55 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14 => generated 1724 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:00:56.309816 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-72cf88ec-3ac9-4f49-a69d-e452168d22fa tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:56.323575 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-72cf88ec-3ac9-4f49-a69d-e452168d22fa tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:56.328393 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-72cf88ec-3ac9-4f49-a69d-e452168d22fa tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:56.329575 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-72cf88ec-3ac9-4f49-a69d-e452168d22fa tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1749 microversion: 2.20 time: 0.256335 Dec 16 15:00:56.330172 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 404/796] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:00:56 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1749 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:00:57.168536 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-7c6ef877-424d-41bd-81d3-e59db2f51232 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:00:57.169214 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-7c6ef877-424d-41bd-81d3-e59db2f51232 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:00:57.177196 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7c6ef877-424d-41bd-81d3-e59db2f51232 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:57.178553 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7c6ef877-424d-41bd-81d3-e59db2f51232 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:57.180095 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7c6ef877-424d-41bd-81d3-e59db2f51232 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:57.180626 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7c6ef877-424d-41bd-81d3-e59db2f51232 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:57.353325 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-37910c9e-6116-4b78-a096-2dae0e84bbc2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:00:57.354003 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-37910c9e-6116-4b78-a096-2dae0e84bbc2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:00:57.361851 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-37910c9e-6116-4b78-a096-2dae0e84bbc2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:57.362404 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-37910c9e-6116-4b78-a096-2dae0e84bbc2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:57.363233 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-37910c9e-6116-4b78-a096-2dae0e84bbc2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:57.363927 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-37910c9e-6116-4b78-a096-2dae0e84bbc2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:57.397750 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-7c6ef877-424d-41bd-81d3-e59db2f51232 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:57.407613 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-7c6ef877-424d-41bd-81d3-e59db2f51232 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14" status: 200 len: 1724 microversion: 2.1 time: 0.247320 Dec 16 15:00:57.408205 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 393/797] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:00:57 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14 => generated 1724 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:00:57.575837 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-37910c9e-6116-4b78-a096-2dae0e84bbc2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:57.588941 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-37910c9e-6116-4b78-a096-2dae0e84bbc2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:57.593404 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-37910c9e-6116-4b78-a096-2dae0e84bbc2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:57.602481 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-37910c9e-6116-4b78-a096-2dae0e84bbc2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1749 microversion: 2.20 time: 0.249594 Dec 16 15:00:57.602481 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 405/798] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:00:57 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1749 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:00:58.430095 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-526ac110-76ec-42a8-ba16-1fb8942b5bab tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:00:58.430777 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-526ac110-76ec-42a8-ba16-1fb8942b5bab tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:00:58.438633 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-526ac110-76ec-42a8-ba16-1fb8942b5bab tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:58.439143 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-526ac110-76ec-42a8-ba16-1fb8942b5bab tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:58.439978 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-526ac110-76ec-42a8-ba16-1fb8942b5bab tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:58.440474 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-526ac110-76ec-42a8-ba16-1fb8942b5bab tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:58.619828 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-b83a3b42-431a-4b0b-ba2f-038fd9960ce5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:00:58.620604 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-b83a3b42-431a-4b0b-ba2f-038fd9960ce5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:00:58.628767 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b83a3b42-431a-4b0b-ba2f-038fd9960ce5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:58.635015 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b83a3b42-431a-4b0b-ba2f-038fd9960ce5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:58.635015 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b83a3b42-431a-4b0b-ba2f-038fd9960ce5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:58.635015 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b83a3b42-431a-4b0b-ba2f-038fd9960ce5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:58.660198 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-526ac110-76ec-42a8-ba16-1fb8942b5bab tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:58.669890 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-526ac110-76ec-42a8-ba16-1fb8942b5bab tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14" status: 200 len: 1724 microversion: 2.1 time: 0.247398 Dec 16 15:00:58.670567 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 394/799] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:00:58 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14 => generated 1724 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:00:58.864055 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-b83a3b42-431a-4b0b-ba2f-038fd9960ce5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:58.877223 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-b83a3b42-431a-4b0b-ba2f-038fd9960ce5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:58.881658 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-b83a3b42-431a-4b0b-ba2f-038fd9960ce5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:00:58.882956 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-b83a3b42-431a-4b0b-ba2f-038fd9960ce5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1749 microversion: 2.20 time: 0.270928 Dec 16 15:00:58.883548 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 406/800] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:00:58 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1749 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 15:00:59.692282 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-14cef521-570c-4bd7-9eae-4e1716588cd0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:00:59.692966 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-14cef521-570c-4bd7-9eae-4e1716588cd0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:00:59.701162 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-14cef521-570c-4bd7-9eae-4e1716588cd0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:59.701674 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-14cef521-570c-4bd7-9eae-4e1716588cd0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:59.702568 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-14cef521-570c-4bd7-9eae-4e1716588cd0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:59.703071 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-14cef521-570c-4bd7-9eae-4e1716588cd0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:59.906650 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-632ef41d-1933-4b22-8dc3-afceb8d63a7f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:00:59.907485 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-632ef41d-1933-4b22-8dc3-afceb8d63a7f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:00:59.916094 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-632ef41d-1933-4b22-8dc3-afceb8d63a7f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:59.916684 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-632ef41d-1933-4b22-8dc3-afceb8d63a7f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:00:59.917528 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-632ef41d-1933-4b22-8dc3-afceb8d63a7f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:00:59.918022 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-632ef41d-1933-4b22-8dc3-afceb8d63a7f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:00.138881 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-632ef41d-1933-4b22-8dc3-afceb8d63a7f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:00.152062 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-632ef41d-1933-4b22-8dc3-afceb8d63a7f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:00.156409 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-632ef41d-1933-4b22-8dc3-afceb8d63a7f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:00.157602 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-632ef41d-1933-4b22-8dc3-afceb8d63a7f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1749 microversion: 2.20 time: 0.258621 Dec 16 15:01:00.158212 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 407/801] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:00:59 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1749 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 15:01:00.198645 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-14cef521-570c-4bd7-9eae-4e1716588cd0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:00.209267 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-14cef521-570c-4bd7-9eae-4e1716588cd0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14" status: 200 len: 1701 microversion: 2.1 time: 0.524797 Dec 16 15:01:00.209873 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 395/802] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:00:59 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14 => generated 1701 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:01:00.230652 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-49ed0f31-c1d2-4459-bcdb-a7474b4ea5b6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:01:00.238806 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-49ed0f31-c1d2-4459-bcdb-a7474b4ea5b6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:00.239394 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-49ed0f31-c1d2-4459-bcdb-a7474b4ea5b6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:00.302153 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-49ed0f31-c1d2-4459-bcdb-a7474b4ea5b6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Going to try to start instance {{(pid=101356) start /opt/stack/nova/nova/compute/api.py:2559}} Dec 16 15:01:00.444578 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-49ed0f31-c1d2-4459-bcdb-a7474b4ea5b6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 202 len: 0 microversion: 2.1 time: 0.221758 Dec 16 15:01:00.445388 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 408/803] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 15:01:00 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:01:00.457787 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-0eaca477-b564-4213-a66c-d918b4376ac4 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:01:00.458497 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-0eaca477-b564-4213-a66c-d918b4376ac4 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:01:00.475945 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0eaca477-b564-4213-a66c-d918b4376ac4 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:00.477074 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0eaca477-b564-4213-a66c-d918b4376ac4 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:00.478119 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0eaca477-b564-4213-a66c-d918b4376ac4 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:00.478619 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0eaca477-b564-4213-a66c-d918b4376ac4 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:00.755976 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-0eaca477-b564-4213-a66c-d918b4376ac4 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:00.766197 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-0eaca477-b564-4213-a66c-d918b4376ac4 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14" status: 200 len: 1710 microversion: 2.1 time: 0.316195 Dec 16 15:01:00.766897 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 396/804] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:01:00 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14 => generated 1710 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:01:01.183378 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-74326821-9577-4d1e-b01e-2a3eda186d63 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:01:01.184224 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-74326821-9577-4d1e-b01e-2a3eda186d63 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:01:01.199590 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-74326821-9577-4d1e-b01e-2a3eda186d63 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:01.200398 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-74326821-9577-4d1e-b01e-2a3eda186d63 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:01.201729 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-74326821-9577-4d1e-b01e-2a3eda186d63 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:01.202261 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-74326821-9577-4d1e-b01e-2a3eda186d63 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:01.435085 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-74326821-9577-4d1e-b01e-2a3eda186d63 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:01.448703 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-74326821-9577-4d1e-b01e-2a3eda186d63 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:01.453375 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-74326821-9577-4d1e-b01e-2a3eda186d63 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:01.454580 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-74326821-9577-4d1e-b01e-2a3eda186d63 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1749 microversion: 2.20 time: 0.281371 Dec 16 15:01:01.455158 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 409/805] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:01:01 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1749 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:01:01.789215 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-5ab3622a-465c-4e08-8965-c9e757967102 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:01:01.789827 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-5ab3622a-465c-4e08-8965-c9e757967102 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:01:01.797666 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5ab3622a-465c-4e08-8965-c9e757967102 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:01.798233 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5ab3622a-465c-4e08-8965-c9e757967102 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:01.799077 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5ab3622a-465c-4e08-8965-c9e757967102 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:01.799575 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5ab3622a-465c-4e08-8965-c9e757967102 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:02.011668 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-5ab3622a-465c-4e08-8965-c9e757967102 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:02.020974 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-5ab3622a-465c-4e08-8965-c9e757967102 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14" status: 200 len: 1710 microversion: 2.1 time: 0.240013 Dec 16 15:01:02.021555 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 397/806] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:01:01 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14 => generated 1710 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:01:02.478491 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-ff52a7a4-799c-40cc-8ae4-a87c9d07d372 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:01:02.479167 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-ff52a7a4-799c-40cc-8ae4-a87c9d07d372 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:01:02.488641 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ff52a7a4-799c-40cc-8ae4-a87c9d07d372 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:02.489155 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ff52a7a4-799c-40cc-8ae4-a87c9d07d372 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:02.490007 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ff52a7a4-799c-40cc-8ae4-a87c9d07d372 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:02.490534 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ff52a7a4-799c-40cc-8ae4-a87c9d07d372 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:02.705006 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-ff52a7a4-799c-40cc-8ae4-a87c9d07d372 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:02.717745 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-ff52a7a4-799c-40cc-8ae4-a87c9d07d372 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:02.722180 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-ff52a7a4-799c-40cc-8ae4-a87c9d07d372 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:02.723364 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-ff52a7a4-799c-40cc-8ae4-a87c9d07d372 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1749 microversion: 2.20 time: 0.252618 Dec 16 15:01:02.723950 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 410/807] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:01:02 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1749 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:01:03.043763 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-fc8979eb-c2ea-4bbd-a755-b0573b3813ec tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:01:03.044437 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-fc8979eb-c2ea-4bbd-a755-b0573b3813ec tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:01:03.052316 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fc8979eb-c2ea-4bbd-a755-b0573b3813ec tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:03.052828 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fc8979eb-c2ea-4bbd-a755-b0573b3813ec tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:03.053670 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fc8979eb-c2ea-4bbd-a755-b0573b3813ec tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:03.054853 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fc8979eb-c2ea-4bbd-a755-b0573b3813ec tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:03.268372 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-fc8979eb-c2ea-4bbd-a755-b0573b3813ec tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:03.277669 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-fc8979eb-c2ea-4bbd-a755-b0573b3813ec tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14" status: 200 len: 1714 microversion: 2.1 time: 0.242099 Dec 16 15:01:03.278301 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 398/808] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:01:03 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14 => generated 1714 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:01:03.747053 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-d301b61f-79c3-4c00-aed0-6ddabdef26bd tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:01:03.747649 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-d301b61f-79c3-4c00-aed0-6ddabdef26bd tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:01:03.755513 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d301b61f-79c3-4c00-aed0-6ddabdef26bd tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:03.756023 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d301b61f-79c3-4c00-aed0-6ddabdef26bd tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:03.756858 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d301b61f-79c3-4c00-aed0-6ddabdef26bd tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:03.757351 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d301b61f-79c3-4c00-aed0-6ddabdef26bd tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:03.973499 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-d301b61f-79c3-4c00-aed0-6ddabdef26bd tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:03.986587 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-d301b61f-79c3-4c00-aed0-6ddabdef26bd tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:03.990974 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-d301b61f-79c3-4c00-aed0-6ddabdef26bd tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:03.992795 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-d301b61f-79c3-4c00-aed0-6ddabdef26bd tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1749 microversion: 2.20 time: 0.254030 Dec 16 15:01:03.993355 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 411/809] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:01:03 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1749 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:01:05.015389 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-b607765c-2eeb-428f-9977-18d1b6960c8f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:01:05.016050 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-b607765c-2eeb-428f-9977-18d1b6960c8f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:01:05.024188 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b607765c-2eeb-428f-9977-18d1b6960c8f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:05.024695 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b607765c-2eeb-428f-9977-18d1b6960c8f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:05.025533 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b607765c-2eeb-428f-9977-18d1b6960c8f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:05.026022 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b607765c-2eeb-428f-9977-18d1b6960c8f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:05.239868 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-b607765c-2eeb-428f-9977-18d1b6960c8f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:05.253031 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-b607765c-2eeb-428f-9977-18d1b6960c8f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:05.257574 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-b607765c-2eeb-428f-9977-18d1b6960c8f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:05.258785 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-b607765c-2eeb-428f-9977-18d1b6960c8f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1749 microversion: 2.20 time: 0.251773 Dec 16 15:01:05.259364 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 399/810] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:01:05 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1749 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:01:06.282503 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-25deb8d2-7412-46e1-966f-5e951bdce076 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:01:06.283101 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-25deb8d2-7412-46e1-966f-5e951bdce076 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:01:06.290963 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-25deb8d2-7412-46e1-966f-5e951bdce076 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:06.291465 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-25deb8d2-7412-46e1-966f-5e951bdce076 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:06.292300 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-25deb8d2-7412-46e1-966f-5e951bdce076 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:06.292788 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-25deb8d2-7412-46e1-966f-5e951bdce076 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:06.511900 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-25deb8d2-7412-46e1-966f-5e951bdce076 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:06.524531 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-25deb8d2-7412-46e1-966f-5e951bdce076 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:06.528988 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-25deb8d2-7412-46e1-966f-5e951bdce076 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:06.530186 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-25deb8d2-7412-46e1-966f-5e951bdce076 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1749 microversion: 2.20 time: 0.255264 Dec 16 15:01:06.530781 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 412/811] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:01:06 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1749 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:01:07.553373 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-e5d2ee4d-2f81-4049-905c-843ad5f9b8ac tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:01:07.554646 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-e5d2ee4d-2f81-4049-905c-843ad5f9b8ac tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:01:07.562487 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e5d2ee4d-2f81-4049-905c-843ad5f9b8ac tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:07.562998 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e5d2ee4d-2f81-4049-905c-843ad5f9b8ac tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:07.563833 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e5d2ee4d-2f81-4049-905c-843ad5f9b8ac tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:07.564323 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e5d2ee4d-2f81-4049-905c-843ad5f9b8ac tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:07.773145 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-e5d2ee4d-2f81-4049-905c-843ad5f9b8ac tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:07.786683 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-e5d2ee4d-2f81-4049-905c-843ad5f9b8ac tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:07.791935 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-e5d2ee4d-2f81-4049-905c-843ad5f9b8ac tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:07.793300 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-e5d2ee4d-2f81-4049-905c-843ad5f9b8ac tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1749 microversion: 2.20 time: 0.247650 Dec 16 15:01:07.793750 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 400/812] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:01:07 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1749 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:01:08.817079 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-9847e000-450c-49f5-87f6-68a265961746 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:01:08.817683 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-9847e000-450c-49f5-87f6-68a265961746 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:01:08.825850 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9847e000-450c-49f5-87f6-68a265961746 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:08.826396 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9847e000-450c-49f5-87f6-68a265961746 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:08.827235 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9847e000-450c-49f5-87f6-68a265961746 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:08.827730 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9847e000-450c-49f5-87f6-68a265961746 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:09.041708 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-9847e000-450c-49f5-87f6-68a265961746 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:09.055161 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-9847e000-450c-49f5-87f6-68a265961746 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:09.059635 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-9847e000-450c-49f5-87f6-68a265961746 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:09.060813 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-9847e000-450c-49f5-87f6-68a265961746 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1749 microversion: 2.20 time: 0.251580 Dec 16 15:01:09.061394 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 413/813] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:01:08 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1749 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:01:10.084386 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-ea83d886-d31c-48eb-a7e6-d520fe7bc24a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:01:10.085898 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-ea83d886-d31c-48eb-a7e6-d520fe7bc24a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:01:10.093881 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ea83d886-d31c-48eb-a7e6-d520fe7bc24a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:10.094476 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ea83d886-d31c-48eb-a7e6-d520fe7bc24a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:10.095333 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ea83d886-d31c-48eb-a7e6-d520fe7bc24a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:10.095832 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ea83d886-d31c-48eb-a7e6-d520fe7bc24a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:10.315102 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-ea83d886-d31c-48eb-a7e6-d520fe7bc24a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:10.330025 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-ea83d886-d31c-48eb-a7e6-d520fe7bc24a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:10.334545 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-ea83d886-d31c-48eb-a7e6-d520fe7bc24a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:10.335801 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-ea83d886-d31c-48eb-a7e6-d520fe7bc24a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1749 microversion: 2.20 time: 0.259310 Dec 16 15:01:10.336579 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 401/814] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:01:10 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1749 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:01:11.359702 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-3991a42b-9fe9-4b09-be60-5ba2470f35f2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:01:11.360607 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-3991a42b-9fe9-4b09-be60-5ba2470f35f2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:01:11.369255 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3991a42b-9fe9-4b09-be60-5ba2470f35f2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:11.369767 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3991a42b-9fe9-4b09-be60-5ba2470f35f2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:11.370712 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3991a42b-9fe9-4b09-be60-5ba2470f35f2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:11.371206 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3991a42b-9fe9-4b09-be60-5ba2470f35f2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:11.602872 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-3991a42b-9fe9-4b09-be60-5ba2470f35f2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:11.615774 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-3991a42b-9fe9-4b09-be60-5ba2470f35f2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:11.620181 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-3991a42b-9fe9-4b09-be60-5ba2470f35f2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:11.621353 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-3991a42b-9fe9-4b09-be60-5ba2470f35f2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1749 microversion: 2.20 time: 0.269419 Dec 16 15:01:11.621935 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 414/815] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:01:11 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1749 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:01:12.645553 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-547a1c89-f782-4572-bd71-1b3dbcf7142a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:01:12.646232 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-547a1c89-f782-4572-bd71-1b3dbcf7142a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:01:12.654125 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-547a1c89-f782-4572-bd71-1b3dbcf7142a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:12.654637 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-547a1c89-f782-4572-bd71-1b3dbcf7142a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:12.655476 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-547a1c89-f782-4572-bd71-1b3dbcf7142a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:12.655968 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-547a1c89-f782-4572-bd71-1b3dbcf7142a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:12.865640 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-547a1c89-f782-4572-bd71-1b3dbcf7142a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:12.879119 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-547a1c89-f782-4572-bd71-1b3dbcf7142a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:12.883742 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-547a1c89-f782-4572-bd71-1b3dbcf7142a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:12.884927 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-547a1c89-f782-4572-bd71-1b3dbcf7142a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1749 microversion: 2.20 time: 0.247846 Dec 16 15:01:12.885509 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 402/816] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:01:12 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1749 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:01:13.908482 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-8626ea15-0e25-4412-8214-5c57f88cf76b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:01:13.909051 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-8626ea15-0e25-4412-8214-5c57f88cf76b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:01:13.917587 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8626ea15-0e25-4412-8214-5c57f88cf76b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:13.918128 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8626ea15-0e25-4412-8214-5c57f88cf76b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:13.918970 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8626ea15-0e25-4412-8214-5c57f88cf76b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:13.919464 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8626ea15-0e25-4412-8214-5c57f88cf76b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:14.133659 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-8626ea15-0e25-4412-8214-5c57f88cf76b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:14.147767 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-8626ea15-0e25-4412-8214-5c57f88cf76b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:14.152908 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-8626ea15-0e25-4412-8214-5c57f88cf76b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:14.154320 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-8626ea15-0e25-4412-8214-5c57f88cf76b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1749 microversion: 2.20 time: 0.253502 Dec 16 15:01:14.154903 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 415/817] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:01:13 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1749 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:01:15.177600 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-9919da11-6919-47c2-95b9-ad754bafe2fb tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:01:15.178336 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-9919da11-6919-47c2-95b9-ad754bafe2fb tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:01:15.186766 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9919da11-6919-47c2-95b9-ad754bafe2fb tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:15.187275 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9919da11-6919-47c2-95b9-ad754bafe2fb tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:15.188115 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9919da11-6919-47c2-95b9-ad754bafe2fb tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:15.188611 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9919da11-6919-47c2-95b9-ad754bafe2fb tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:15.403261 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-9919da11-6919-47c2-95b9-ad754bafe2fb tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:15.416683 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-9919da11-6919-47c2-95b9-ad754bafe2fb tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:15.421264 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-9919da11-6919-47c2-95b9-ad754bafe2fb tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:15.422480 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-9919da11-6919-47c2-95b9-ad754bafe2fb tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1749 microversion: 2.20 time: 0.252567 Dec 16 15:01:15.423070 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 403/818] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:01:15 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1749 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:01:16.446173 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-26037439-293b-449c-b129-1443fe1cf601 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:01:16.446843 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-26037439-293b-449c-b129-1443fe1cf601 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:01:16.454857 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-26037439-293b-449c-b129-1443fe1cf601 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:16.455359 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-26037439-293b-449c-b129-1443fe1cf601 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:16.456180 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-26037439-293b-449c-b129-1443fe1cf601 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:16.456699 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-26037439-293b-449c-b129-1443fe1cf601 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:16.682444 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-26037439-293b-449c-b129-1443fe1cf601 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:16.696376 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-26037439-293b-449c-b129-1443fe1cf601 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:16.701076 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-26037439-293b-449c-b129-1443fe1cf601 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:16.702304 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-26037439-293b-449c-b129-1443fe1cf601 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1749 microversion: 2.20 time: 0.264280 Dec 16 15:01:16.702897 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 416/819] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:01:16 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1749 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:01:17.726912 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-1631f72f-237f-44e5-abd3-a9a2cc9675aa tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:01:17.727482 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-1631f72f-237f-44e5-abd3-a9a2cc9675aa tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:01:17.735368 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1631f72f-237f-44e5-abd3-a9a2cc9675aa tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:17.735885 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1631f72f-237f-44e5-abd3-a9a2cc9675aa tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:17.736721 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1631f72f-237f-44e5-abd3-a9a2cc9675aa tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:17.737219 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1631f72f-237f-44e5-abd3-a9a2cc9675aa tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:17.962326 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-1631f72f-237f-44e5-abd3-a9a2cc9675aa tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:17.975031 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-1631f72f-237f-44e5-abd3-a9a2cc9675aa tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:17.979591 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-1631f72f-237f-44e5-abd3-a9a2cc9675aa tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:17.980735 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-1631f72f-237f-44e5-abd3-a9a2cc9675aa tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1749 microversion: 2.20 time: 0.262036 Dec 16 15:01:17.981318 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 404/820] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:01:17 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1749 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:01:19.003670 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-50934b56-b9ce-4074-b774-1dabf9a58862 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:01:19.004334 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-50934b56-b9ce-4074-b774-1dabf9a58862 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:01:19.012160 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-50934b56-b9ce-4074-b774-1dabf9a58862 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:19.012659 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-50934b56-b9ce-4074-b774-1dabf9a58862 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:19.013485 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-50934b56-b9ce-4074-b774-1dabf9a58862 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:19.013971 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-50934b56-b9ce-4074-b774-1dabf9a58862 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:19.232796 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-50934b56-b9ce-4074-b774-1dabf9a58862 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:19.245436 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-50934b56-b9ce-4074-b774-1dabf9a58862 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:19.249860 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-50934b56-b9ce-4074-b774-1dabf9a58862 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:19.251065 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-50934b56-b9ce-4074-b774-1dabf9a58862 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1749 microversion: 2.20 time: 0.255048 Dec 16 15:01:19.251652 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 417/821] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:01:18 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1749 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:01:20.274416 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-1cf11e36-391c-4bb4-a158-ccd05ed2bc28 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:01:20.275090 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-1cf11e36-391c-4bb4-a158-ccd05ed2bc28 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:01:20.282894 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1cf11e36-391c-4bb4-a158-ccd05ed2bc28 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:20.283399 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1cf11e36-391c-4bb4-a158-ccd05ed2bc28 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:20.284225 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1cf11e36-391c-4bb4-a158-ccd05ed2bc28 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:20.284713 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1cf11e36-391c-4bb4-a158-ccd05ed2bc28 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:20.495881 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-1cf11e36-391c-4bb4-a158-ccd05ed2bc28 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:20.508401 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-1cf11e36-391c-4bb4-a158-ccd05ed2bc28 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:20.513033 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-1cf11e36-391c-4bb4-a158-ccd05ed2bc28 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:20.514326 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-1cf11e36-391c-4bb4-a158-ccd05ed2bc28 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1749 microversion: 2.20 time: 0.247885 Dec 16 15:01:20.514900 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 405/822] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:01:20 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1749 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:01:21.537168 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-6e81cb2e-add4-4b3d-81ec-ac77b8e49963 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:01:21.538456 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-6e81cb2e-add4-4b3d-81ec-ac77b8e49963 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:01:21.546246 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6e81cb2e-add4-4b3d-81ec-ac77b8e49963 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:21.546748 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6e81cb2e-add4-4b3d-81ec-ac77b8e49963 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:21.547571 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6e81cb2e-add4-4b3d-81ec-ac77b8e49963 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:21.548060 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6e81cb2e-add4-4b3d-81ec-ac77b8e49963 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:21.757101 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-6e81cb2e-add4-4b3d-81ec-ac77b8e49963 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:21.769685 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-6e81cb2e-add4-4b3d-81ec-ac77b8e49963 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:21.774808 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-6e81cb2e-add4-4b3d-81ec-ac77b8e49963 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:21.775983 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-6e81cb2e-add4-4b3d-81ec-ac77b8e49963 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1749 microversion: 2.20 time: 0.246441 Dec 16 15:01:21.776575 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 418/823] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:01:21 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1749 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:01:22.799060 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-1886eeb9-0441-4ae7-a7d5-26f045e5b2fc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:01:22.799663 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-1886eeb9-0441-4ae7-a7d5-26f045e5b2fc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:01:22.807564 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1886eeb9-0441-4ae7-a7d5-26f045e5b2fc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:22.808072 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1886eeb9-0441-4ae7-a7d5-26f045e5b2fc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:22.808910 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1886eeb9-0441-4ae7-a7d5-26f045e5b2fc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:22.809403 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1886eeb9-0441-4ae7-a7d5-26f045e5b2fc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:23.210526 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-1886eeb9-0441-4ae7-a7d5-26f045e5b2fc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:23.223287 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-1886eeb9-0441-4ae7-a7d5-26f045e5b2fc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:23.228297 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-1886eeb9-0441-4ae7-a7d5-26f045e5b2fc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:23.229490 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-1886eeb9-0441-4ae7-a7d5-26f045e5b2fc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1749 microversion: 2.20 time: 0.438148 Dec 16 15:01:23.230092 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 406/824] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:01:22 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1749 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:01:24.253684 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-1b1f6e4d-71b4-483b-a452-323ccb2fb627 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:01:24.254360 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-1b1f6e4d-71b4-483b-a452-323ccb2fb627 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:01:24.262109 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1b1f6e4d-71b4-483b-a452-323ccb2fb627 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:24.262614 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1b1f6e4d-71b4-483b-a452-323ccb2fb627 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:24.263440 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1b1f6e4d-71b4-483b-a452-323ccb2fb627 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:24.263927 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1b1f6e4d-71b4-483b-a452-323ccb2fb627 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:24.482727 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-1b1f6e4d-71b4-483b-a452-323ccb2fb627 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:24.495555 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-1b1f6e4d-71b4-483b-a452-323ccb2fb627 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:24.500063 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-1b1f6e4d-71b4-483b-a452-323ccb2fb627 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:24.501248 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-1b1f6e4d-71b4-483b-a452-323ccb2fb627 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1749 microversion: 2.20 time: 0.255218 Dec 16 15:01:24.501828 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 419/825] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:01:24 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1749 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:01:25.524581 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-e6ee173c-c4e7-4f0b-bf1c-adc4a0d5f402 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:01:25.525255 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-e6ee173c-c4e7-4f0b-bf1c-adc4a0d5f402 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:01:25.533067 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e6ee173c-c4e7-4f0b-bf1c-adc4a0d5f402 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:25.533568 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e6ee173c-c4e7-4f0b-bf1c-adc4a0d5f402 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:25.534445 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e6ee173c-c4e7-4f0b-bf1c-adc4a0d5f402 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:25.535040 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e6ee173c-c4e7-4f0b-bf1c-adc4a0d5f402 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:25.749702 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-e6ee173c-c4e7-4f0b-bf1c-adc4a0d5f402 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:25.762443 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-e6ee173c-c4e7-4f0b-bf1c-adc4a0d5f402 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:25.767065 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-e6ee173c-c4e7-4f0b-bf1c-adc4a0d5f402 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:25.768258 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-e6ee173c-c4e7-4f0b-bf1c-adc4a0d5f402 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1749 microversion: 2.20 time: 0.251438 Dec 16 15:01:25.768833 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 407/826] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:01:25 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1749 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:01:26.791969 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-ed3706e4-8099-4df4-af67-1a12f1f12252 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:01:26.792621 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-ed3706e4-8099-4df4-af67-1a12f1f12252 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:01:26.800540 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ed3706e4-8099-4df4-af67-1a12f1f12252 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:26.801051 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ed3706e4-8099-4df4-af67-1a12f1f12252 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:26.801916 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ed3706e4-8099-4df4-af67-1a12f1f12252 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:26.802469 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ed3706e4-8099-4df4-af67-1a12f1f12252 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:27.030308 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-ed3706e4-8099-4df4-af67-1a12f1f12252 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:27.042991 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-ed3706e4-8099-4df4-af67-1a12f1f12252 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:27.047423 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-ed3706e4-8099-4df4-af67-1a12f1f12252 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:27.048603 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-ed3706e4-8099-4df4-af67-1a12f1f12252 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1749 microversion: 2.20 time: 0.265063 Dec 16 15:01:27.049185 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 420/827] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:01:26 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1749 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:01:28.071663 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-9b5c75fa-6cfd-49a6-87a1-00fc94fdd5c6 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:01:28.072384 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-9b5c75fa-6cfd-49a6-87a1-00fc94fdd5c6 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:01:28.080512 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9b5c75fa-6cfd-49a6-87a1-00fc94fdd5c6 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:28.081021 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9b5c75fa-6cfd-49a6-87a1-00fc94fdd5c6 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:28.081863 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9b5c75fa-6cfd-49a6-87a1-00fc94fdd5c6 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:28.082377 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9b5c75fa-6cfd-49a6-87a1-00fc94fdd5c6 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:28.295556 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-9b5c75fa-6cfd-49a6-87a1-00fc94fdd5c6 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:28.308341 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-9b5c75fa-6cfd-49a6-87a1-00fc94fdd5c6 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:28.312787 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-9b5c75fa-6cfd-49a6-87a1-00fc94fdd5c6 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:28.313964 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-9b5c75fa-6cfd-49a6-87a1-00fc94fdd5c6 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1749 microversion: 2.20 time: 0.249900 Dec 16 15:01:28.314602 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 408/828] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:01:28 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1749 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:01:29.337293 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-17286e62-2de5-4246-803b-035e17333186 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:01:29.337958 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-17286e62-2de5-4246-803b-035e17333186 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:01:29.345798 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-17286e62-2de5-4246-803b-035e17333186 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:29.346329 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-17286e62-2de5-4246-803b-035e17333186 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:29.347156 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-17286e62-2de5-4246-803b-035e17333186 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:29.347637 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-17286e62-2de5-4246-803b-035e17333186 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:29.562355 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-17286e62-2de5-4246-803b-035e17333186 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:29.577313 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-17286e62-2de5-4246-803b-035e17333186 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:29.585449 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-17286e62-2de5-4246-803b-035e17333186 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:29.586698 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-17286e62-2de5-4246-803b-035e17333186 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1749 microversion: 2.20 time: 0.257097 Dec 16 15:01:29.587861 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 421/829] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:01:29 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1749 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:01:30.614552 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-b71aceaf-13b0-4db7-984b-9d0d6500c541 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:01:30.615243 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-b71aceaf-13b0-4db7-984b-9d0d6500c541 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:01:30.623294 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b71aceaf-13b0-4db7-984b-9d0d6500c541 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:30.623799 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b71aceaf-13b0-4db7-984b-9d0d6500c541 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:30.624640 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b71aceaf-13b0-4db7-984b-9d0d6500c541 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:30.625135 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b71aceaf-13b0-4db7-984b-9d0d6500c541 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:30.839702 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-b71aceaf-13b0-4db7-984b-9d0d6500c541 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:30.852930 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-b71aceaf-13b0-4db7-984b-9d0d6500c541 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:30.857634 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-b71aceaf-13b0-4db7-984b-9d0d6500c541 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:30.858869 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-b71aceaf-13b0-4db7-984b-9d0d6500c541 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1749 microversion: 2.20 time: 0.252001 Dec 16 15:01:30.859458 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 409/830] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:01:30 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1749 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:01:31.883223 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-2c3b2bb7-ab8f-4c17-93a0-c5115cb10fb7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:01:31.883888 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-2c3b2bb7-ab8f-4c17-93a0-c5115cb10fb7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:01:31.891694 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2c3b2bb7-ab8f-4c17-93a0-c5115cb10fb7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:31.892239 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2c3b2bb7-ab8f-4c17-93a0-c5115cb10fb7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:31.893113 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2c3b2bb7-ab8f-4c17-93a0-c5115cb10fb7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:31.893609 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2c3b2bb7-ab8f-4c17-93a0-c5115cb10fb7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:32.106989 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-2c3b2bb7-ab8f-4c17-93a0-c5115cb10fb7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:32.121085 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-2c3b2bb7-ab8f-4c17-93a0-c5115cb10fb7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:32.125551 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-2c3b2bb7-ab8f-4c17-93a0-c5115cb10fb7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:32.126789 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-2c3b2bb7-ab8f-4c17-93a0-c5115cb10fb7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1749 microversion: 2.20 time: 0.251829 Dec 16 15:01:32.127376 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 422/831] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:01:31 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1749 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:01:33.150323 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-3bb0f2b0-c9a7-4975-a769-4ef15b2663e5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:01:33.151062 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-3bb0f2b0-c9a7-4975-a769-4ef15b2663e5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:01:33.158961 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3bb0f2b0-c9a7-4975-a769-4ef15b2663e5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:33.159477 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3bb0f2b0-c9a7-4975-a769-4ef15b2663e5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:33.160319 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3bb0f2b0-c9a7-4975-a769-4ef15b2663e5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:33.160809 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3bb0f2b0-c9a7-4975-a769-4ef15b2663e5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:33.381928 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-3bb0f2b0-c9a7-4975-a769-4ef15b2663e5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:33.395065 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-3bb0f2b0-c9a7-4975-a769-4ef15b2663e5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:33.399676 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-3bb0f2b0-c9a7-4975-a769-4ef15b2663e5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:33.400883 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-3bb0f2b0-c9a7-4975-a769-4ef15b2663e5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1749 microversion: 2.20 time: 0.258312 Dec 16 15:01:33.401471 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 410/832] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:01:33 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1749 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:01:34.426746 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-edc1eadf-02f4-450a-8073-05861e096c0b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:01:34.427451 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-edc1eadf-02f4-450a-8073-05861e096c0b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:01:34.436183 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-edc1eadf-02f4-450a-8073-05861e096c0b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:34.436692 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-edc1eadf-02f4-450a-8073-05861e096c0b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:34.437536 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-edc1eadf-02f4-450a-8073-05861e096c0b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:34.438026 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-edc1eadf-02f4-450a-8073-05861e096c0b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:34.657243 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-edc1eadf-02f4-450a-8073-05861e096c0b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:34.670380 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-edc1eadf-02f4-450a-8073-05861e096c0b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:34.674829 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-edc1eadf-02f4-450a-8073-05861e096c0b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:34.676010 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-edc1eadf-02f4-450a-8073-05861e096c0b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1749 microversion: 2.20 time: 0.256949 Dec 16 15:01:34.676590 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 423/833] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:01:34 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1749 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 15:01:35.700271 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-5b629cd6-a09c-4065-a0ec-4f1b36278ad7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:01:35.700939 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-5b629cd6-a09c-4065-a0ec-4f1b36278ad7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:01:35.708870 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5b629cd6-a09c-4065-a0ec-4f1b36278ad7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:35.709915 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5b629cd6-a09c-4065-a0ec-4f1b36278ad7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:35.710781 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5b629cd6-a09c-4065-a0ec-4f1b36278ad7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:35.711277 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5b629cd6-a09c-4065-a0ec-4f1b36278ad7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:35.923896 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-5b629cd6-a09c-4065-a0ec-4f1b36278ad7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:35.937031 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-5b629cd6-a09c-4065-a0ec-4f1b36278ad7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:35.941607 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-5b629cd6-a09c-4065-a0ec-4f1b36278ad7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:35.942807 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-5b629cd6-a09c-4065-a0ec-4f1b36278ad7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1749 microversion: 2.20 time: 0.250781 Dec 16 15:01:35.943365 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 411/834] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:01:35 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1749 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:01:36.966902 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-29d87d4c-b3c7-4491-8367-7c9654d7d70a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:01:36.967496 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-29d87d4c-b3c7-4491-8367-7c9654d7d70a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:01:36.975975 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-29d87d4c-b3c7-4491-8367-7c9654d7d70a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:36.976486 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-29d87d4c-b3c7-4491-8367-7c9654d7d70a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:36.977325 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-29d87d4c-b3c7-4491-8367-7c9654d7d70a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:36.977819 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-29d87d4c-b3c7-4491-8367-7c9654d7d70a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:37.192917 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-29d87d4c-b3c7-4491-8367-7c9654d7d70a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:37.206646 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-29d87d4c-b3c7-4491-8367-7c9654d7d70a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:37.211183 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-29d87d4c-b3c7-4491-8367-7c9654d7d70a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:37.212365 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-29d87d4c-b3c7-4491-8367-7c9654d7d70a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1749 microversion: 2.20 time: 0.253291 Dec 16 15:01:37.212962 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 424/835] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:01:36 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1749 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 15:01:38.235527 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-95a54b3c-5bfd-4fc0-b669-b80ab3d3c877 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:01:38.236175 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-95a54b3c-5bfd-4fc0-b669-b80ab3d3c877 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:01:38.245066 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-95a54b3c-5bfd-4fc0-b669-b80ab3d3c877 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:38.245569 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-95a54b3c-5bfd-4fc0-b669-b80ab3d3c877 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:38.246437 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-95a54b3c-5bfd-4fc0-b669-b80ab3d3c877 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:38.246927 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-95a54b3c-5bfd-4fc0-b669-b80ab3d3c877 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:38.457960 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-95a54b3c-5bfd-4fc0-b669-b80ab3d3c877 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:38.476114 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-95a54b3c-5bfd-4fc0-b669-b80ab3d3c877 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:38.480671 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-95a54b3c-5bfd-4fc0-b669-b80ab3d3c877 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:38.481873 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-95a54b3c-5bfd-4fc0-b669-b80ab3d3c877 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.253968 Dec 16 15:01:38.482496 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 412/836] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:01:38 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:01:39.504668 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-65d73e9b-d3ca-4a98-baf6-44ed1300ef45 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:01:39.506519 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-65d73e9b-d3ca-4a98-baf6-44ed1300ef45 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:01:39.514490 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-65d73e9b-d3ca-4a98-baf6-44ed1300ef45 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:39.514991 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-65d73e9b-d3ca-4a98-baf6-44ed1300ef45 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:39.515822 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-65d73e9b-d3ca-4a98-baf6-44ed1300ef45 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:39.516310 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-65d73e9b-d3ca-4a98-baf6-44ed1300ef45 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:39.729321 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-65d73e9b-d3ca-4a98-baf6-44ed1300ef45 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:39.742881 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-65d73e9b-d3ca-4a98-baf6-44ed1300ef45 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:39.747365 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-65d73e9b-d3ca-4a98-baf6-44ed1300ef45 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:39.748536 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-65d73e9b-d3ca-4a98-baf6-44ed1300ef45 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.251502 Dec 16 15:01:39.749121 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 425/837] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:01:39 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:01:40.772380 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-04de8971-5219-4aaa-8da0-8fb3d672f725 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:01:40.773048 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-04de8971-5219-4aaa-8da0-8fb3d672f725 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:01:40.781098 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-04de8971-5219-4aaa-8da0-8fb3d672f725 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:40.781613 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-04de8971-5219-4aaa-8da0-8fb3d672f725 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:40.782491 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-04de8971-5219-4aaa-8da0-8fb3d672f725 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:40.782991 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-04de8971-5219-4aaa-8da0-8fb3d672f725 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:41.062818 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-04de8971-5219-4aaa-8da0-8fb3d672f725 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:41.076483 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-04de8971-5219-4aaa-8da0-8fb3d672f725 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:41.080944 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-04de8971-5219-4aaa-8da0-8fb3d672f725 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:41.082153 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-04de8971-5219-4aaa-8da0-8fb3d672f725 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.318118 Dec 16 15:01:41.082734 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 413/838] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:01:40 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:01:42.106066 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-8ebeb90f-5d14-41dd-86a2-44fac058eb59 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:01:42.106739 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-8ebeb90f-5d14-41dd-86a2-44fac058eb59 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:01:42.114791 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8ebeb90f-5d14-41dd-86a2-44fac058eb59 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:42.116083 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8ebeb90f-5d14-41dd-86a2-44fac058eb59 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:42.116932 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8ebeb90f-5d14-41dd-86a2-44fac058eb59 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:42.117431 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8ebeb90f-5d14-41dd-86a2-44fac058eb59 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:42.337034 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-8ebeb90f-5d14-41dd-86a2-44fac058eb59 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:42.349812 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-8ebeb90f-5d14-41dd-86a2-44fac058eb59 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:42.354268 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-8ebeb90f-5d14-41dd-86a2-44fac058eb59 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:42.355445 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-8ebeb90f-5d14-41dd-86a2-44fac058eb59 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.257451 Dec 16 15:01:42.356089 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 426/839] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:01:42 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:01:43.379198 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-85ff9f6f-247f-4716-bef0-5a11a3b2dd2a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:01:43.380036 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-85ff9f6f-247f-4716-bef0-5a11a3b2dd2a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:01:43.388777 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-85ff9f6f-247f-4716-bef0-5a11a3b2dd2a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:43.389287 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-85ff9f6f-247f-4716-bef0-5a11a3b2dd2a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:43.390268 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-85ff9f6f-247f-4716-bef0-5a11a3b2dd2a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:43.390763 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-85ff9f6f-247f-4716-bef0-5a11a3b2dd2a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:43.602533 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-85ff9f6f-247f-4716-bef0-5a11a3b2dd2a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:43.615820 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-85ff9f6f-247f-4716-bef0-5a11a3b2dd2a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:43.620322 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-85ff9f6f-247f-4716-bef0-5a11a3b2dd2a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:43.621511 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-85ff9f6f-247f-4716-bef0-5a11a3b2dd2a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.250233 Dec 16 15:01:43.622121 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 414/840] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:01:43 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:01:44.644741 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-1c7f5718-5624-4e02-b981-e41d50520dd9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:01:44.645407 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-1c7f5718-5624-4e02-b981-e41d50520dd9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:01:44.653726 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1c7f5718-5624-4e02-b981-e41d50520dd9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:44.654267 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1c7f5718-5624-4e02-b981-e41d50520dd9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:44.655100 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1c7f5718-5624-4e02-b981-e41d50520dd9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:44.655593 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1c7f5718-5624-4e02-b981-e41d50520dd9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:44.872505 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-1c7f5718-5624-4e02-b981-e41d50520dd9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:44.885932 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-1c7f5718-5624-4e02-b981-e41d50520dd9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:44.890309 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-1c7f5718-5624-4e02-b981-e41d50520dd9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:44.891489 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-1c7f5718-5624-4e02-b981-e41d50520dd9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.254472 Dec 16 15:01:44.892095 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 427/841] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:01:44 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:01:45.915035 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-1c22937e-1adb-4f48-a69c-a7dd8cc0ef49 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:01:45.915691 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-1c22937e-1adb-4f48-a69c-a7dd8cc0ef49 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:01:45.923419 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1c22937e-1adb-4f48-a69c-a7dd8cc0ef49 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:45.923924 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1c22937e-1adb-4f48-a69c-a7dd8cc0ef49 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:45.924843 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1c22937e-1adb-4f48-a69c-a7dd8cc0ef49 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:45.925329 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1c22937e-1adb-4f48-a69c-a7dd8cc0ef49 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:46.141521 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-1c22937e-1adb-4f48-a69c-a7dd8cc0ef49 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:46.154862 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-1c22937e-1adb-4f48-a69c-a7dd8cc0ef49 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:46.159383 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-1c22937e-1adb-4f48-a69c-a7dd8cc0ef49 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:46.160568 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-1c22937e-1adb-4f48-a69c-a7dd8cc0ef49 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.253736 Dec 16 15:01:46.161160 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 415/842] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:01:45 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:01:47.184926 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-0560641f-2651-4393-bffe-9d77b5f2e04e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:01:47.185513 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-0560641f-2651-4393-bffe-9d77b5f2e04e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:01:47.194176 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0560641f-2651-4393-bffe-9d77b5f2e04e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:47.194681 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0560641f-2651-4393-bffe-9d77b5f2e04e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:47.195503 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0560641f-2651-4393-bffe-9d77b5f2e04e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:47.195985 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0560641f-2651-4393-bffe-9d77b5f2e04e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:47.411335 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-0560641f-2651-4393-bffe-9d77b5f2e04e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:47.424556 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-0560641f-2651-4393-bffe-9d77b5f2e04e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:47.429685 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-0560641f-2651-4393-bffe-9d77b5f2e04e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:47.430953 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-0560641f-2651-4393-bffe-9d77b5f2e04e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.254371 Dec 16 15:01:47.431539 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 428/843] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:01:47 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:01:48.454506 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-702b07d6-aa5b-49e2-8201-30f07b499a4d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:01:48.455181 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-702b07d6-aa5b-49e2-8201-30f07b499a4d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:01:48.463530 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-702b07d6-aa5b-49e2-8201-30f07b499a4d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:48.464046 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-702b07d6-aa5b-49e2-8201-30f07b499a4d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:48.464889 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-702b07d6-aa5b-49e2-8201-30f07b499a4d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:48.465387 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-702b07d6-aa5b-49e2-8201-30f07b499a4d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:48.689690 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-702b07d6-aa5b-49e2-8201-30f07b499a4d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:48.703562 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-702b07d6-aa5b-49e2-8201-30f07b499a4d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:48.708080 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-702b07d6-aa5b-49e2-8201-30f07b499a4d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:48.709325 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-702b07d6-aa5b-49e2-8201-30f07b499a4d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.262722 Dec 16 15:01:48.709918 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 416/844] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:01:48 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:01:49.435378 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-0e63a79b-9294-44a6-bae6-8d2e9b9bec5b tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:01:49.436035 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-0e63a79b-9294-44a6-bae6-8d2e9b9bec5b tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:01:49.444424 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0e63a79b-9294-44a6-bae6-8d2e9b9bec5b tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:49.444930 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0e63a79b-9294-44a6-bae6-8d2e9b9bec5b tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:49.445771 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0e63a79b-9294-44a6-bae6-8d2e9b9bec5b tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:49.446301 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0e63a79b-9294-44a6-bae6-8d2e9b9bec5b tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:49.511605 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.objects.instance [None req-0e63a79b-9294-44a6-bae6-8d2e9b9bec5b tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lazy-loading 'flavor' on Instance uuid 60bfc41e-721c-45aa-a6fb-93f9213cf050 {{(pid=101356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 16 15:01:49.725847 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-0e63a79b-9294-44a6-bae6-8d2e9b9bec5b tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "POST /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050/action" status: 202 len: 0 microversion: 2.1 time: 0.297801 Dec 16 15:01:49.726460 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 429/845] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 15:01:49 2021] POST /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050/action => generated 0 bytes in 300 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:01:49.732967 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-e9d9888f-1ba0-4292-83de-3da9a6a33e0e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:01:49.733646 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-e9d9888f-1ba0-4292-83de-3da9a6a33e0e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:01:49.739452 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-3d81eefb-916b-4880-909d-83bcf91d088b tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:01:49.740219 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-3d81eefb-916b-4880-909d-83bcf91d088b tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:01:49.742072 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e9d9888f-1ba0-4292-83de-3da9a6a33e0e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:49.742596 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e9d9888f-1ba0-4292-83de-3da9a6a33e0e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:49.743450 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e9d9888f-1ba0-4292-83de-3da9a6a33e0e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:49.743945 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e9d9888f-1ba0-4292-83de-3da9a6a33e0e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:49.748233 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3d81eefb-916b-4880-909d-83bcf91d088b tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:49.755926 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3d81eefb-916b-4880-909d-83bcf91d088b tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:49.755926 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3d81eefb-916b-4880-909d-83bcf91d088b tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:49.755926 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3d81eefb-916b-4880-909d-83bcf91d088b tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:49.965799 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-e9d9888f-1ba0-4292-83de-3da9a6a33e0e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:49.976550 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-3d81eefb-916b-4880-909d-83bcf91d088b tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:49.978904 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-e9d9888f-1ba0-4292-83de-3da9a6a33e0e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:49.983402 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-e9d9888f-1ba0-4292-83de-3da9a6a33e0e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:49.984598 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-e9d9888f-1ba0-4292-83de-3da9a6a33e0e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.259937 Dec 16 15:01:49.985187 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 417/846] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:01:49 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:01:49.985323 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-3d81eefb-916b-4880-909d-83bcf91d088b tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1569 microversion: 2.1 time: 0.253954 Dec 16 15:01:49.985801 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 430/847] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:01:49 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1569 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:01:51.008289 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-376b7ab9-a106-40c6-a431-4df6294c35a1 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:01:51.008829 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-9bab0344-4708-44fd-9cbb-a878f04d20a2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:01:51.008940 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-376b7ab9-a106-40c6-a431-4df6294c35a1 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:01:51.009043 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-9bab0344-4708-44fd-9cbb-a878f04d20a2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:01:51.016729 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-376b7ab9-a106-40c6-a431-4df6294c35a1 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:51.016896 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9bab0344-4708-44fd-9cbb-a878f04d20a2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:51.017228 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-376b7ab9-a106-40c6-a431-4df6294c35a1 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:51.017356 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9bab0344-4708-44fd-9cbb-a878f04d20a2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:51.018087 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9bab0344-4708-44fd-9cbb-a878f04d20a2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:51.018196 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-376b7ab9-a106-40c6-a431-4df6294c35a1 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:51.018592 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9bab0344-4708-44fd-9cbb-a878f04d20a2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:51.018695 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-376b7ab9-a106-40c6-a431-4df6294c35a1 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:51.245704 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-9bab0344-4708-44fd-9cbb-a878f04d20a2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:51.246151 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-376b7ab9-a106-40c6-a431-4df6294c35a1 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:51.255015 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-376b7ab9-a106-40c6-a431-4df6294c35a1 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1569 microversion: 2.1 time: 0.254769 Dec 16 15:01:51.256113 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 418/848] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:01:50 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1569 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:01:51.259344 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-9bab0344-4708-44fd-9cbb-a878f04d20a2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:51.263894 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-9bab0344-4708-44fd-9cbb-a878f04d20a2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:51.265082 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-9bab0344-4708-44fd-9cbb-a878f04d20a2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.264773 Dec 16 15:01:51.265656 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 431/849] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:01:50 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 15:01:52.277632 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-9aebfb91-55e6-4d7f-bcc2-98f8447e8189 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:01:52.279536 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-9aebfb91-55e6-4d7f-bcc2-98f8447e8189 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:01:52.288557 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9aebfb91-55e6-4d7f-bcc2-98f8447e8189 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:52.288857 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-3ef2848b-0782-41dc-a2ab-74b2bcfd0e41 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:01:52.289060 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9aebfb91-55e6-4d7f-bcc2-98f8447e8189 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:52.289528 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-3ef2848b-0782-41dc-a2ab-74b2bcfd0e41 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:01:52.289936 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9aebfb91-55e6-4d7f-bcc2-98f8447e8189 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:52.290455 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9aebfb91-55e6-4d7f-bcc2-98f8447e8189 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:52.297419 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3ef2848b-0782-41dc-a2ab-74b2bcfd0e41 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:52.297874 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3ef2848b-0782-41dc-a2ab-74b2bcfd0e41 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:52.298747 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3ef2848b-0782-41dc-a2ab-74b2bcfd0e41 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:52.299240 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3ef2848b-0782-41dc-a2ab-74b2bcfd0e41 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:52.508506 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-9aebfb91-55e6-4d7f-bcc2-98f8447e8189 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:52.515153 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-3ef2848b-0782-41dc-a2ab-74b2bcfd0e41 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:52.517531 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-9aebfb91-55e6-4d7f-bcc2-98f8447e8189 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1569 microversion: 2.1 time: 0.248214 Dec 16 15:01:52.518149 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 419/850] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:01:52 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1569 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:01:52.528594 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-3ef2848b-0782-41dc-a2ab-74b2bcfd0e41 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:52.533064 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-3ef2848b-0782-41dc-a2ab-74b2bcfd0e41 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:52.534283 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-3ef2848b-0782-41dc-a2ab-74b2bcfd0e41 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.253494 Dec 16 15:01:52.534856 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 432/851] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:01:52 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:01:53.540682 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-430f5b2f-a032-43e9-8427-7e36e9e991ed tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:01:53.541510 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-430f5b2f-a032-43e9-8427-7e36e9e991ed tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:01:53.549257 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-430f5b2f-a032-43e9-8427-7e36e9e991ed tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:53.549764 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-430f5b2f-a032-43e9-8427-7e36e9e991ed tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:53.550644 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-430f5b2f-a032-43e9-8427-7e36e9e991ed tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:53.551143 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-430f5b2f-a032-43e9-8427-7e36e9e991ed tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:53.560578 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-b6d0cca2-1fa8-448a-b38a-a00612435ef7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:01:53.561247 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-b6d0cca2-1fa8-448a-b38a-a00612435ef7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:01:53.569092 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b6d0cca2-1fa8-448a-b38a-a00612435ef7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:53.569595 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b6d0cca2-1fa8-448a-b38a-a00612435ef7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:53.570453 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b6d0cca2-1fa8-448a-b38a-a00612435ef7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:53.570941 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b6d0cca2-1fa8-448a-b38a-a00612435ef7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:53.777580 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-430f5b2f-a032-43e9-8427-7e36e9e991ed tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:53.787152 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-430f5b2f-a032-43e9-8427-7e36e9e991ed tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1569 microversion: 2.1 time: 0.254100 Dec 16 15:01:53.787726 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 420/852] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:01:53 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1569 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:01:53.796398 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-b6d0cca2-1fa8-448a-b38a-a00612435ef7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:53.809134 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-b6d0cca2-1fa8-448a-b38a-a00612435ef7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:53.813581 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-b6d0cca2-1fa8-448a-b38a-a00612435ef7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:53.814778 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-b6d0cca2-1fa8-448a-b38a-a00612435ef7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.262935 Dec 16 15:01:53.815352 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 433/853] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:01:53 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 15:01:54.809646 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-4ccbca46-6201-4631-9cad-d32a1b5e03d0 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:01:54.810343 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-4ccbca46-6201-4631-9cad-d32a1b5e03d0 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:01:54.818211 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4ccbca46-6201-4631-9cad-d32a1b5e03d0 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:54.818728 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4ccbca46-6201-4631-9cad-d32a1b5e03d0 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:54.819567 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4ccbca46-6201-4631-9cad-d32a1b5e03d0 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:54.820065 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4ccbca46-6201-4631-9cad-d32a1b5e03d0 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:54.839370 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-d70acb8b-7311-4468-b6db-c44b3ff19cdc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:01:54.840037 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-d70acb8b-7311-4468-b6db-c44b3ff19cdc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:01:54.848042 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d70acb8b-7311-4468-b6db-c44b3ff19cdc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:54.848553 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d70acb8b-7311-4468-b6db-c44b3ff19cdc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:54.849908 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d70acb8b-7311-4468-b6db-c44b3ff19cdc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:54.850460 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d70acb8b-7311-4468-b6db-c44b3ff19cdc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:55.031984 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-4ccbca46-6201-4631-9cad-d32a1b5e03d0 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:55.042683 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-4ccbca46-6201-4631-9cad-d32a1b5e03d0 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1569 microversion: 2.1 time: 0.241432 Dec 16 15:01:55.043287 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 421/854] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:01:54 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1569 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:01:55.070770 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-d70acb8b-7311-4468-b6db-c44b3ff19cdc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:55.084383 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-d70acb8b-7311-4468-b6db-c44b3ff19cdc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:55.088853 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-d70acb8b-7311-4468-b6db-c44b3ff19cdc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:55.090053 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-d70acb8b-7311-4468-b6db-c44b3ff19cdc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.258285 Dec 16 15:01:55.090758 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 434/855] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:01:54 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 15:01:56.065251 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-e654a15c-5c23-414f-bda6-bc23cf624a36 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:01:56.065927 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-e654a15c-5c23-414f-bda6-bc23cf624a36 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:01:56.074668 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e654a15c-5c23-414f-bda6-bc23cf624a36 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:56.075182 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e654a15c-5c23-414f-bda6-bc23cf624a36 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:56.076067 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e654a15c-5c23-414f-bda6-bc23cf624a36 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:56.076568 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e654a15c-5c23-414f-bda6-bc23cf624a36 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:56.116368 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-9ab08261-a9c1-417b-95ba-1904097cb2a1 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:01:56.117126 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-9ab08261-a9c1-417b-95ba-1904097cb2a1 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:01:56.125087 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9ab08261-a9c1-417b-95ba-1904097cb2a1 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:56.125595 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9ab08261-a9c1-417b-95ba-1904097cb2a1 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:56.126465 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9ab08261-a9c1-417b-95ba-1904097cb2a1 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:56.126961 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9ab08261-a9c1-417b-95ba-1904097cb2a1 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:56.305629 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-e654a15c-5c23-414f-bda6-bc23cf624a36 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:56.314688 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-e654a15c-5c23-414f-bda6-bc23cf624a36 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1569 microversion: 2.1 time: 0.256938 Dec 16 15:01:56.319104 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 422/856] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:01:56 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1569 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:01:56.346847 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-9ab08261-a9c1-417b-95ba-1904097cb2a1 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:56.360576 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-9ab08261-a9c1-417b-95ba-1904097cb2a1 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:56.365895 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-9ab08261-a9c1-417b-95ba-1904097cb2a1 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:56.367079 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-9ab08261-a9c1-417b-95ba-1904097cb2a1 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.259132 Dec 16 15:01:56.367846 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 435/857] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:01:56 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:01:57.337134 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-e3f40ae6-287c-4a87-adde-99a32a241fa4 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:01:57.337822 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-e3f40ae6-287c-4a87-adde-99a32a241fa4 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:01:57.345793 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e3f40ae6-287c-4a87-adde-99a32a241fa4 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:57.346341 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e3f40ae6-287c-4a87-adde-99a32a241fa4 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:57.347204 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e3f40ae6-287c-4a87-adde-99a32a241fa4 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:57.347707 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e3f40ae6-287c-4a87-adde-99a32a241fa4 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:57.390760 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-327ae917-e7b3-418f-ab16-cee511a67338 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:01:57.391701 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-327ae917-e7b3-418f-ab16-cee511a67338 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:01:57.399773 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-327ae917-e7b3-418f-ab16-cee511a67338 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:57.400592 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-327ae917-e7b3-418f-ab16-cee511a67338 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:57.401647 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-327ae917-e7b3-418f-ab16-cee511a67338 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:57.402394 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-327ae917-e7b3-418f-ab16-cee511a67338 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:57.638517 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-e3f40ae6-287c-4a87-adde-99a32a241fa4 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:57.647777 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-e3f40ae6-287c-4a87-adde-99a32a241fa4 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1569 microversion: 2.1 time: 0.319074 Dec 16 15:01:57.648380 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 423/858] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:01:57 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1569 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:01:57.651868 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-327ae917-e7b3-418f-ab16-cee511a67338 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:57.666686 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-327ae917-e7b3-418f-ab16-cee511a67338 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:57.671131 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-327ae917-e7b3-418f-ab16-cee511a67338 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:57.672365 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-327ae917-e7b3-418f-ab16-cee511a67338 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.289374 Dec 16 15:01:57.672944 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 436/859] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:01:57 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:01:58.668517 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-844029f1-9395-4a62-9fcf-26eeae75d35e tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:01:58.669192 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-844029f1-9395-4a62-9fcf-26eeae75d35e tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:01:58.677128 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-844029f1-9395-4a62-9fcf-26eeae75d35e tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:58.677630 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-844029f1-9395-4a62-9fcf-26eeae75d35e tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:58.678496 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-844029f1-9395-4a62-9fcf-26eeae75d35e tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:58.678988 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-844029f1-9395-4a62-9fcf-26eeae75d35e tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:58.697013 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-13e08cc8-376a-4400-ace7-686c38378fc8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:01:58.697685 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-13e08cc8-376a-4400-ace7-686c38378fc8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:01:58.705686 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-13e08cc8-376a-4400-ace7-686c38378fc8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:58.706245 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-13e08cc8-376a-4400-ace7-686c38378fc8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:58.707077 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-13e08cc8-376a-4400-ace7-686c38378fc8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:58.707569 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-13e08cc8-376a-4400-ace7-686c38378fc8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:58.899249 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-844029f1-9395-4a62-9fcf-26eeae75d35e tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:58.908115 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-844029f1-9395-4a62-9fcf-26eeae75d35e tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1569 microversion: 2.1 time: 0.247207 Dec 16 15:01:58.908799 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 424/860] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:01:58 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1569 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:01:58.932012 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-13e08cc8-376a-4400-ace7-686c38378fc8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:58.945594 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-13e08cc8-376a-4400-ace7-686c38378fc8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:58.950365 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-13e08cc8-376a-4400-ace7-686c38378fc8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:01:58.951546 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-13e08cc8-376a-4400-ace7-686c38378fc8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.262749 Dec 16 15:01:58.952132 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 437/861] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:01:58 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 15:01:59.929951 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-fb5f9ea4-aa13-4a66-beaa-4abe4e95673f tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:01:59.930537 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-fb5f9ea4-aa13-4a66-beaa-4abe4e95673f tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:01:59.938383 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fb5f9ea4-aa13-4a66-beaa-4abe4e95673f tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:59.938887 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fb5f9ea4-aa13-4a66-beaa-4abe4e95673f tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:59.939721 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fb5f9ea4-aa13-4a66-beaa-4abe4e95673f tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:59.940205 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fb5f9ea4-aa13-4a66-beaa-4abe4e95673f tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:59.973911 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-58702839-d1a2-407c-ab22-ec0ea49f429d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:01:59.974639 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-58702839-d1a2-407c-ab22-ec0ea49f429d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:01:59.982587 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-58702839-d1a2-407c-ab22-ec0ea49f429d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:59.983093 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-58702839-d1a2-407c-ab22-ec0ea49f429d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:01:59.983947 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-58702839-d1a2-407c-ab22-ec0ea49f429d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:01:59.984439 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-58702839-d1a2-407c-ab22-ec0ea49f429d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:00.209077 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-58702839-d1a2-407c-ab22-ec0ea49f429d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:00.222060 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-58702839-d1a2-407c-ab22-ec0ea49f429d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:00.226643 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-58702839-d1a2-407c-ab22-ec0ea49f429d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:00.227836 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-58702839-d1a2-407c-ab22-ec0ea49f429d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.261538 Dec 16 15:02:00.228436 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 438/862] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:01:59 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 15:02:00.257481 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-fb5f9ea4-aa13-4a66-beaa-4abe4e95673f tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:00.266960 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-fb5f9ea4-aa13-4a66-beaa-4abe4e95673f tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1569 microversion: 2.1 time: 0.345078 Dec 16 15:02:00.267567 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 425/863] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:01:59 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1569 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:02:01.250911 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-6647f0b8-81a0-42fa-bc02-306b9a68917a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:02:01.251583 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-6647f0b8-81a0-42fa-bc02-306b9a68917a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:02:01.259498 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6647f0b8-81a0-42fa-bc02-306b9a68917a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:01.260008 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6647f0b8-81a0-42fa-bc02-306b9a68917a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:01.260845 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6647f0b8-81a0-42fa-bc02-306b9a68917a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:01.261341 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6647f0b8-81a0-42fa-bc02-306b9a68917a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:01.289318 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-767f6daa-4328-421e-bc81-b733b230fc00 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:02:01.289985 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-767f6daa-4328-421e-bc81-b733b230fc00 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:02:01.297734 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-767f6daa-4328-421e-bc81-b733b230fc00 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:01.298271 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-767f6daa-4328-421e-bc81-b733b230fc00 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:01.299116 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-767f6daa-4328-421e-bc81-b733b230fc00 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:01.299606 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-767f6daa-4328-421e-bc81-b733b230fc00 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:01.483551 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-6647f0b8-81a0-42fa-bc02-306b9a68917a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:01.496390 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-6647f0b8-81a0-42fa-bc02-306b9a68917a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:01.500978 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-6647f0b8-81a0-42fa-bc02-306b9a68917a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:01.502179 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-6647f0b8-81a0-42fa-bc02-306b9a68917a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.258764 Dec 16 15:02:01.502762 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 439/864] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:02:01 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:02:01.520466 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-767f6daa-4328-421e-bc81-b733b230fc00 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:01.529967 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-767f6daa-4328-421e-bc81-b733b230fc00 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1569 microversion: 2.1 time: 0.249035 Dec 16 15:02:01.530589 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 426/865] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:02:01 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1569 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:02:02.527033 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-03cca02b-60b0-48e6-9a44-513da179ed86 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:02:02.527698 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-03cca02b-60b0-48e6-9a44-513da179ed86 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:02:02.535584 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-03cca02b-60b0-48e6-9a44-513da179ed86 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:02.536092 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-03cca02b-60b0-48e6-9a44-513da179ed86 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:02.536935 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-03cca02b-60b0-48e6-9a44-513da179ed86 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:02.537430 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-03cca02b-60b0-48e6-9a44-513da179ed86 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:02.551693 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-e6d53b91-47b3-4627-aec8-216a668884f4 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:02:02.552346 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-e6d53b91-47b3-4627-aec8-216a668884f4 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:02:02.560445 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e6d53b91-47b3-4627-aec8-216a668884f4 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:02.561013 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e6d53b91-47b3-4627-aec8-216a668884f4 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:02.561888 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e6d53b91-47b3-4627-aec8-216a668884f4 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:02.562429 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e6d53b91-47b3-4627-aec8-216a668884f4 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:02.763123 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-03cca02b-60b0-48e6-9a44-513da179ed86 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:02.776426 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-03cca02b-60b0-48e6-9a44-513da179ed86 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:02.780958 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-03cca02b-60b0-48e6-9a44-513da179ed86 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:02.781585 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-e6d53b91-47b3-4627-aec8-216a668884f4 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:02.782190 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-03cca02b-60b0-48e6-9a44-513da179ed86 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.263538 Dec 16 15:02:02.782966 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 440/866] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:02:02 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:02:02.791884 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-e6d53b91-47b3-4627-aec8-216a668884f4 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1569 microversion: 2.1 time: 0.247788 Dec 16 15:02:02.792760 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 427/867] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:02:02 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1569 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:02:03.805231 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-daceca03-f174-463e-aefd-dab3e21a9151 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:02:03.805901 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-daceca03-f174-463e-aefd-dab3e21a9151 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:02:03.813731 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-daceca03-f174-463e-aefd-dab3e21a9151 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:03.814276 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-daceca03-f174-463e-aefd-dab3e21a9151 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:03.814415 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-90417168-841f-4073-9ed3-e3b8f02aa7cf tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:02:03.814994 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-90417168-841f-4073-9ed3-e3b8f02aa7cf tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:02:03.815118 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-daceca03-f174-463e-aefd-dab3e21a9151 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:03.815581 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-daceca03-f174-463e-aefd-dab3e21a9151 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:03.822844 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-90417168-841f-4073-9ed3-e3b8f02aa7cf tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:03.823358 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-90417168-841f-4073-9ed3-e3b8f02aa7cf tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:03.824465 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-90417168-841f-4073-9ed3-e3b8f02aa7cf tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:03.824964 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-90417168-841f-4073-9ed3-e3b8f02aa7cf tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:04.039318 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-daceca03-f174-463e-aefd-dab3e21a9151 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:04.054984 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-daceca03-f174-463e-aefd-dab3e21a9151 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:04.059663 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-daceca03-f174-463e-aefd-dab3e21a9151 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:04.060908 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-daceca03-f174-463e-aefd-dab3e21a9151 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.263983 Dec 16 15:02:04.061725 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 441/868] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:02:03 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:02:04.231038 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-90417168-841f-4073-9ed3-e3b8f02aa7cf tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:04.239785 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-90417168-841f-4073-9ed3-e3b8f02aa7cf tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1569 microversion: 2.1 time: 0.433187 Dec 16 15:02:04.240368 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 428/869] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:02:03 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1569 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:02:05.085123 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-51ce794f-b3cb-416e-b91f-456a50f13f21 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:02:05.085794 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-51ce794f-b3cb-416e-b91f-456a50f13f21 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:02:05.093579 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-51ce794f-b3cb-416e-b91f-456a50f13f21 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:05.094121 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-51ce794f-b3cb-416e-b91f-456a50f13f21 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:05.094960 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-51ce794f-b3cb-416e-b91f-456a50f13f21 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:05.095454 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-51ce794f-b3cb-416e-b91f-456a50f13f21 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:05.262004 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-796dbdd0-9c8b-4fdc-844d-7f2be15d8395 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:02:05.262794 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-796dbdd0-9c8b-4fdc-844d-7f2be15d8395 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:02:05.266096 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 15:02:05.266279 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: Thu Dec 16 15:02:05 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 (ip 10.222.0.45) !!! Dec 16 15:02:05.282806 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-796dbdd0-9c8b-4fdc-844d-7f2be15d8395 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:05.283325 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-796dbdd0-9c8b-4fdc-844d-7f2be15d8395 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:05.284202 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-796dbdd0-9c8b-4fdc-844d-7f2be15d8395 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:05.284673 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-796dbdd0-9c8b-4fdc-844d-7f2be15d8395 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:05.315084 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-51ce794f-b3cb-416e-b91f-456a50f13f21 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:05.328228 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-51ce794f-b3cb-416e-b91f-456a50f13f21 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:05.332755 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-51ce794f-b3cb-416e-b91f-456a50f13f21 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:05.333948 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-51ce794f-b3cb-416e-b91f-456a50f13f21 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.256590 Dec 16 15:02:05.334555 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 442/870] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:02:05 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:02:05.498724 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-796dbdd0-9c8b-4fdc-844d-7f2be15d8395 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:05.507534 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-796dbdd0-9c8b-4fdc-844d-7f2be15d8395 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1569 microversion: 2.1 time: 0.253400 Dec 16 15:02:05.508126 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 429/871] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:02:05 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1569 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:02:06.357366 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-62dcfbc2-0fee-4eeb-bc35-f234cd69bebe tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:02:06.358026 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-62dcfbc2-0fee-4eeb-bc35-f234cd69bebe tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:02:06.366478 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-62dcfbc2-0fee-4eeb-bc35-f234cd69bebe tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:06.366974 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-62dcfbc2-0fee-4eeb-bc35-f234cd69bebe tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:06.368035 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-62dcfbc2-0fee-4eeb-bc35-f234cd69bebe tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:06.368523 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-62dcfbc2-0fee-4eeb-bc35-f234cd69bebe tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:06.530449 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-f371d48e-6e55-4b43-b3ff-6ac9a476cf70 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:02:06.531219 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-f371d48e-6e55-4b43-b3ff-6ac9a476cf70 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:02:06.540029 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f371d48e-6e55-4b43-b3ff-6ac9a476cf70 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:06.540534 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f371d48e-6e55-4b43-b3ff-6ac9a476cf70 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:06.541374 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f371d48e-6e55-4b43-b3ff-6ac9a476cf70 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:06.541867 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f371d48e-6e55-4b43-b3ff-6ac9a476cf70 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:06.583929 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-62dcfbc2-0fee-4eeb-bc35-f234cd69bebe tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:06.596701 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-62dcfbc2-0fee-4eeb-bc35-f234cd69bebe tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:06.601837 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-62dcfbc2-0fee-4eeb-bc35-f234cd69bebe tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:06.603077 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-62dcfbc2-0fee-4eeb-bc35-f234cd69bebe tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.254097 Dec 16 15:02:06.603668 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 443/872] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:02:06 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:02:06.764049 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-f371d48e-6e55-4b43-b3ff-6ac9a476cf70 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:06.773355 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-f371d48e-6e55-4b43-b3ff-6ac9a476cf70 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1569 microversion: 2.1 time: 0.251126 Dec 16 15:02:06.774156 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 430/873] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:02:06 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1569 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:02:06.999792 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [req-3f915d7a-fac2-459d-9a8a-dd8f343fc108 req-1ec758aa-882e-4c07-a1f2-cc5aef367708 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60bfc41e-721c-45aa-a6fb-93f9213cf050", "name": "network-vif-unplugged", "status": "completed", "tag": "2a20087b-09a5-411d-bbb0-eb5a2ee789c2"}]} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:02:07.004531 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:02:07.004531 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: warnings.warn(msg) Dec 16 15:02:07.013492 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-3f915d7a-fac2-459d-9a8a-dd8f343fc108 req-1ec758aa-882e-4c07-a1f2-cc5aef367708 service nova] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:07.013996 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-3f915d7a-fac2-459d-9a8a-dd8f343fc108 req-1ec758aa-882e-4c07-a1f2-cc5aef367708 service nova] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:07.031167 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.compute.server_external_events [req-3f915d7a-fac2-459d-9a8a-dd8f343fc108 req-1ec758aa-882e-4c07-a1f2-cc5aef367708 service nova] Creating event network-vif-unplugged:2a20087b-09a5-411d-bbb0-eb5a2ee789c2 for instance 60bfc41e-721c-45aa-a6fb-93f9213cf050 on hv-cinder-82189 Dec 16 15:02:07.036197 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [req-3f915d7a-fac2-459d-9a8a-dd8f343fc108 req-1ec758aa-882e-4c07-a1f2-cc5aef367708 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.130820 Dec 16 15:02:07.037402 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 444/874] 10.222.0.45 () {64 vars in 1308 bytes} [Thu Dec 16 15:02:06 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:02:07.626498 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-6db7b9c8-a052-46af-93c1-116a39e1d482 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:02:07.627169 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-6db7b9c8-a052-46af-93c1-116a39e1d482 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:02:07.635490 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6db7b9c8-a052-46af-93c1-116a39e1d482 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:07.636001 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6db7b9c8-a052-46af-93c1-116a39e1d482 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:07.636833 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6db7b9c8-a052-46af-93c1-116a39e1d482 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:07.637330 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6db7b9c8-a052-46af-93c1-116a39e1d482 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:07.795670 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-7cbfb9bb-c1fd-4720-8fdc-45152a7e103f tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:02:07.796444 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-7cbfb9bb-c1fd-4720-8fdc-45152a7e103f tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:02:07.804951 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7cbfb9bb-c1fd-4720-8fdc-45152a7e103f tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:07.805467 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7cbfb9bb-c1fd-4720-8fdc-45152a7e103f tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:07.806346 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7cbfb9bb-c1fd-4720-8fdc-45152a7e103f tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:07.806844 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7cbfb9bb-c1fd-4720-8fdc-45152a7e103f tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:07.858880 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-6db7b9c8-a052-46af-93c1-116a39e1d482 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:07.872266 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-6db7b9c8-a052-46af-93c1-116a39e1d482 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:07.876725 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-6db7b9c8-a052-46af-93c1-116a39e1d482 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:07.877916 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-6db7b9c8-a052-46af-93c1-116a39e1d482 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.259030 Dec 16 15:02:07.878529 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 431/875] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:02:07 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:02:08.029873 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-7cbfb9bb-c1fd-4720-8fdc-45152a7e103f tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:08.038888 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-7cbfb9bb-c1fd-4720-8fdc-45152a7e103f tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1569 microversion: 2.1 time: 0.251565 Dec 16 15:02:08.039429 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 445/876] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:02:07 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1569 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:02:08.902811 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-1bfec247-1dc6-4694-a7aa-836665d5fb31 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:02:08.903479 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-1bfec247-1dc6-4694-a7aa-836665d5fb31 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:02:08.911433 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1bfec247-1dc6-4694-a7aa-836665d5fb31 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:08.911877 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1bfec247-1dc6-4694-a7aa-836665d5fb31 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:08.912742 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1bfec247-1dc6-4694-a7aa-836665d5fb31 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:08.913213 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1bfec247-1dc6-4694-a7aa-836665d5fb31 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:09.061255 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-c95e2218-8b73-40ab-bd08-0cbec9d5e875 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:02:09.061939 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-c95e2218-8b73-40ab-bd08-0cbec9d5e875 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:02:09.070416 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c95e2218-8b73-40ab-bd08-0cbec9d5e875 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:09.070929 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c95e2218-8b73-40ab-bd08-0cbec9d5e875 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:09.071808 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c95e2218-8b73-40ab-bd08-0cbec9d5e875 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:09.072310 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c95e2218-8b73-40ab-bd08-0cbec9d5e875 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:09.134938 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-1bfec247-1dc6-4694-a7aa-836665d5fb31 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:09.147942 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-1bfec247-1dc6-4694-a7aa-836665d5fb31 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:09.152440 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-1bfec247-1dc6-4694-a7aa-836665d5fb31 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:09.153645 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-1bfec247-1dc6-4694-a7aa-836665d5fb31 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.259737 Dec 16 15:02:09.154280 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 432/877] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:02:08 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:02:09.287236 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-c95e2218-8b73-40ab-bd08-0cbec9d5e875 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:09.296033 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-c95e2218-8b73-40ab-bd08-0cbec9d5e875 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1569 microversion: 2.1 time: 0.243081 Dec 16 15:02:09.296632 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 446/878] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:02:09 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1569 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:02:10.177397 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-192a43c6-155c-4bb9-8f5b-5171dfcb22db tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:02:10.178008 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-192a43c6-155c-4bb9-8f5b-5171dfcb22db tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:02:10.185892 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-192a43c6-155c-4bb9-8f5b-5171dfcb22db tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:10.186455 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-192a43c6-155c-4bb9-8f5b-5171dfcb22db tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:10.187298 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-192a43c6-155c-4bb9-8f5b-5171dfcb22db tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:10.187788 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-192a43c6-155c-4bb9-8f5b-5171dfcb22db tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:10.191829 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-9a96d367-2509-4e31-9119-9082e7a88a04 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:02:10.192370 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-9a96d367-2509-4e31-9119-9082e7a88a04 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:02:10.200475 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9a96d367-2509-4e31-9119-9082e7a88a04 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:10.200973 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9a96d367-2509-4e31-9119-9082e7a88a04 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:10.201791 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9a96d367-2509-4e31-9119-9082e7a88a04 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:10.202327 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9a96d367-2509-4e31-9119-9082e7a88a04 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:10.408739 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-192a43c6-155c-4bb9-8f5b-5171dfcb22db tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:10.422029 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-192a43c6-155c-4bb9-8f5b-5171dfcb22db tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:10.426539 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-192a43c6-155c-4bb9-8f5b-5171dfcb22db tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:10.427873 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-192a43c6-155c-4bb9-8f5b-5171dfcb22db tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.258202 Dec 16 15:02:10.428410 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 433/879] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:02:10 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:02:10.436577 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-a5085fef-48ef-465f-98e1-485625cff17f tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:02:10.437245 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-a5085fef-48ef-465f-98e1-485625cff17f tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:02:10.445406 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a5085fef-48ef-465f-98e1-485625cff17f tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:10.445924 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a5085fef-48ef-465f-98e1-485625cff17f tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:10.446800 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a5085fef-48ef-465f-98e1-485625cff17f tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:10.447299 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a5085fef-48ef-465f-98e1-485625cff17f tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:10.540294 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-9a96d367-2509-4e31-9119-9082e7a88a04 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "DELETE /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments/dda26be8-4e33-4a32-a210-946feea43411" status: 202 len: 0 microversion: 2.1 time: 0.355926 Dec 16 15:02:10.541604 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 447/880] 10.222.0.45 () {58 vars in 1406 bytes} [Thu Dec 16 15:02:10 2021] DELETE /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments/dda26be8-4e33-4a32-a210-946feea43411 => generated 0 bytes in 358 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:02:10.671068 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-a5085fef-48ef-465f-98e1-485625cff17f tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:10.680353 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-a5085fef-48ef-465f-98e1-485625cff17f tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1569 microversion: 2.1 time: 0.250886 Dec 16 15:02:10.680922 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 434/881] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:02:10 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1569 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:02:11.451695 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-b60b58b0-c1d8-4e0f-afb0-647b581ef94b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:02:11.452457 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-b60b58b0-c1d8-4e0f-afb0-647b581ef94b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:02:11.460580 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b60b58b0-c1d8-4e0f-afb0-647b581ef94b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:11.461085 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b60b58b0-c1d8-4e0f-afb0-647b581ef94b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:11.461918 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b60b58b0-c1d8-4e0f-afb0-647b581ef94b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:11.462433 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b60b58b0-c1d8-4e0f-afb0-647b581ef94b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:11.678490 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-b60b58b0-c1d8-4e0f-afb0-647b581ef94b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:11.691857 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-b60b58b0-c1d8-4e0f-afb0-647b581ef94b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:11.696536 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-b60b58b0-c1d8-4e0f-afb0-647b581ef94b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:11.697752 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-b60b58b0-c1d8-4e0f-afb0-647b581ef94b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.254380 Dec 16 15:02:11.698365 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 448/882] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:02:11 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:02:11.702897 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-165a097f-084d-4f04-9e1c-25ce67e34654 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:02:11.703571 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-165a097f-084d-4f04-9e1c-25ce67e34654 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:02:11.712429 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-165a097f-084d-4f04-9e1c-25ce67e34654 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:11.712925 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-165a097f-084d-4f04-9e1c-25ce67e34654 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:11.713783 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-165a097f-084d-4f04-9e1c-25ce67e34654 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:11.714294 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-165a097f-084d-4f04-9e1c-25ce67e34654 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:11.927682 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-165a097f-084d-4f04-9e1c-25ce67e34654 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:11.936389 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-165a097f-084d-4f04-9e1c-25ce67e34654 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1569 microversion: 2.1 time: 0.242064 Dec 16 15:02:11.936972 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 435/883] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:02:11 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1569 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:02:12.725752 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-867b74dd-5f67-44b4-bc58-15759ac8119a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:02:12.726362 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-867b74dd-5f67-44b4-bc58-15759ac8119a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:02:12.734247 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-867b74dd-5f67-44b4-bc58-15759ac8119a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:12.734753 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-867b74dd-5f67-44b4-bc58-15759ac8119a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:12.735590 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-867b74dd-5f67-44b4-bc58-15759ac8119a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:12.736074 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-867b74dd-5f67-44b4-bc58-15759ac8119a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:12.952373 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-867b74dd-5f67-44b4-bc58-15759ac8119a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:12.958548 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-c0f5c8fd-9c40-4f7d-b1ea-607bf17ae477 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:02:12.959188 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-c0f5c8fd-9c40-4f7d-b1ea-607bf17ae477 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:02:12.965418 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-867b74dd-5f67-44b4-bc58-15759ac8119a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:12.966992 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c0f5c8fd-9c40-4f7d-b1ea-607bf17ae477 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:12.967500 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c0f5c8fd-9c40-4f7d-b1ea-607bf17ae477 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:12.968334 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c0f5c8fd-9c40-4f7d-b1ea-607bf17ae477 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:12.968845 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c0f5c8fd-9c40-4f7d-b1ea-607bf17ae477 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:12.969923 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-867b74dd-5f67-44b4-bc58-15759ac8119a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:12.971159 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-867b74dd-5f67-44b4-bc58-15759ac8119a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.253676 Dec 16 15:02:12.971739 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 449/884] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:02:12 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 15:02:13.183534 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-c0f5c8fd-9c40-4f7d-b1ea-607bf17ae477 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:13.192254 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-c0f5c8fd-9c40-4f7d-b1ea-607bf17ae477 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1569 microversion: 2.1 time: 0.241545 Dec 16 15:02:13.192877 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 436/885] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:02:12 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1569 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:02:13.995958 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-3f78b6e3-24f7-4f81-8656-9e127571cc2b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:02:13.996625 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-3f78b6e3-24f7-4f81-8656-9e127571cc2b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:02:14.004412 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3f78b6e3-24f7-4f81-8656-9e127571cc2b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:14.004920 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3f78b6e3-24f7-4f81-8656-9e127571cc2b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:14.006416 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3f78b6e3-24f7-4f81-8656-9e127571cc2b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:14.006918 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3f78b6e3-24f7-4f81-8656-9e127571cc2b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:14.214376 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-5a542ffd-0fcd-4a14-a836-9b656207e7b2 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:02:14.215188 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-5a542ffd-0fcd-4a14-a836-9b656207e7b2 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:02:14.223079 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5a542ffd-0fcd-4a14-a836-9b656207e7b2 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:14.223314 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-3f78b6e3-24f7-4f81-8656-9e127571cc2b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:14.223592 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5a542ffd-0fcd-4a14-a836-9b656207e7b2 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:14.224952 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5a542ffd-0fcd-4a14-a836-9b656207e7b2 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:14.225683 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5a542ffd-0fcd-4a14-a836-9b656207e7b2 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:14.236814 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-3f78b6e3-24f7-4f81-8656-9e127571cc2b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:14.241909 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-3f78b6e3-24f7-4f81-8656-9e127571cc2b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:14.243109 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-3f78b6e3-24f7-4f81-8656-9e127571cc2b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.255421 Dec 16 15:02:14.243690 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 450/886] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:02:13 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:02:14.440428 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-5a542ffd-0fcd-4a14-a836-9b656207e7b2 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:14.449439 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-5a542ffd-0fcd-4a14-a836-9b656207e7b2 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1569 microversion: 2.1 time: 0.242780 Dec 16 15:02:14.450029 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 437/887] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:02:14 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1569 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:02:15.266058 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-769c6bc4-fd89-4dac-866d-a98e53517bb7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:02:15.266745 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-769c6bc4-fd89-4dac-866d-a98e53517bb7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:02:15.274656 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-769c6bc4-fd89-4dac-866d-a98e53517bb7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:15.275166 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-769c6bc4-fd89-4dac-866d-a98e53517bb7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:15.276033 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-769c6bc4-fd89-4dac-866d-a98e53517bb7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:15.276502 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-769c6bc4-fd89-4dac-866d-a98e53517bb7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:15.471437 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-7be094b6-586e-4470-9933-a2380d913070 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:02:15.472115 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-7be094b6-586e-4470-9933-a2380d913070 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:02:15.480547 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7be094b6-586e-4470-9933-a2380d913070 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:15.481068 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7be094b6-586e-4470-9933-a2380d913070 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:15.481907 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7be094b6-586e-4470-9933-a2380d913070 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:15.482446 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7be094b6-586e-4470-9933-a2380d913070 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:15.498532 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-769c6bc4-fd89-4dac-866d-a98e53517bb7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:15.511412 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-769c6bc4-fd89-4dac-866d-a98e53517bb7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:15.515836 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-769c6bc4-fd89-4dac-866d-a98e53517bb7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:15.517056 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-769c6bc4-fd89-4dac-866d-a98e53517bb7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.258694 Dec 16 15:02:15.517689 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 451/888] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:02:15 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:02:15.698485 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-7be094b6-586e-4470-9933-a2380d913070 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:15.707562 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-7be094b6-586e-4470-9933-a2380d913070 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1569 microversion: 2.1 time: 0.243807 Dec 16 15:02:15.709337 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 438/889] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:02:15 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1569 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:02:16.540883 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-bae64a02-f1aa-4a0d-975d-a5f1551a2a4a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:02:16.541542 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-bae64a02-f1aa-4a0d-975d-a5f1551a2a4a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:02:16.549294 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-bae64a02-f1aa-4a0d-975d-a5f1551a2a4a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:16.549787 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-bae64a02-f1aa-4a0d-975d-a5f1551a2a4a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:16.550639 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-bae64a02-f1aa-4a0d-975d-a5f1551a2a4a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:16.551123 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-bae64a02-f1aa-4a0d-975d-a5f1551a2a4a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:16.731021 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-5241bcba-3a21-4a58-8e9d-6f1d12de918c tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:02:16.731703 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-5241bcba-3a21-4a58-8e9d-6f1d12de918c tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:02:16.740197 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5241bcba-3a21-4a58-8e9d-6f1d12de918c tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:16.740711 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5241bcba-3a21-4a58-8e9d-6f1d12de918c tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:16.741564 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5241bcba-3a21-4a58-8e9d-6f1d12de918c tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:16.742075 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5241bcba-3a21-4a58-8e9d-6f1d12de918c tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:16.761756 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-bae64a02-f1aa-4a0d-975d-a5f1551a2a4a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:16.774374 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-bae64a02-f1aa-4a0d-975d-a5f1551a2a4a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:16.778818 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-bae64a02-f1aa-4a0d-975d-a5f1551a2a4a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:16.779986 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-bae64a02-f1aa-4a0d-975d-a5f1551a2a4a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.247263 Dec 16 15:02:16.780809 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 452/890] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:02:16 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:02:16.953699 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-5241bcba-3a21-4a58-8e9d-6f1d12de918c tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:16.963147 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-5241bcba-3a21-4a58-8e9d-6f1d12de918c tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1569 microversion: 2.1 time: 0.240332 Dec 16 15:02:16.963683 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 439/891] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:02:16 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1569 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:02:17.804278 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-e9951643-daf0-4420-b737-db4a0123f43a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:02:17.804877 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-e9951643-daf0-4420-b737-db4a0123f43a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:02:17.812670 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e9951643-daf0-4420-b737-db4a0123f43a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:17.813180 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e9951643-daf0-4420-b737-db4a0123f43a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:17.814016 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e9951643-daf0-4420-b737-db4a0123f43a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:17.814532 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e9951643-daf0-4420-b737-db4a0123f43a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:17.985855 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-1f7d7737-1a2a-44e1-a170-c85e1ae72f26 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:02:17.986552 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-1f7d7737-1a2a-44e1-a170-c85e1ae72f26 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:02:17.995037 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1f7d7737-1a2a-44e1-a170-c85e1ae72f26 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:18.007686 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1f7d7737-1a2a-44e1-a170-c85e1ae72f26 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:18.007686 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1f7d7737-1a2a-44e1-a170-c85e1ae72f26 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:18.007686 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1f7d7737-1a2a-44e1-a170-c85e1ae72f26 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:18.032043 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-e9951643-daf0-4420-b737-db4a0123f43a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:18.045712 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-e9951643-daf0-4420-b737-db4a0123f43a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:18.050231 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-e9951643-daf0-4420-b737-db4a0123f43a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:18.051426 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-e9951643-daf0-4420-b737-db4a0123f43a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.255499 Dec 16 15:02:18.052584 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 453/892] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:02:17 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:02:18.214239 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-1f7d7737-1a2a-44e1-a170-c85e1ae72f26 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:18.223027 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-1f7d7737-1a2a-44e1-a170-c85e1ae72f26 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1569 microversion: 2.1 time: 0.244733 Dec 16 15:02:18.223615 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 440/893] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:02:17 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1569 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:02:19.074857 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-ac22217c-6f5b-4841-bff2-9ad4e87f3a47 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:02:19.075570 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-ac22217c-6f5b-4841-bff2-9ad4e87f3a47 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:02:19.083959 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ac22217c-6f5b-4841-bff2-9ad4e87f3a47 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:19.084468 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ac22217c-6f5b-4841-bff2-9ad4e87f3a47 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:19.085302 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ac22217c-6f5b-4841-bff2-9ad4e87f3a47 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:19.085800 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ac22217c-6f5b-4841-bff2-9ad4e87f3a47 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:19.296522 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-ac22217c-6f5b-4841-bff2-9ad4e87f3a47 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:19.309732 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-ac22217c-6f5b-4841-bff2-9ad4e87f3a47 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:19.314314 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-ac22217c-6f5b-4841-bff2-9ad4e87f3a47 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:19.315512 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-ac22217c-6f5b-4841-bff2-9ad4e87f3a47 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.248580 Dec 16 15:02:19.316104 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 454/894] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:02:19 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:02:19.389267 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-d4bd7908-1bc4-43b7-99a2-2233c54487ee tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:02:19.389951 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-d4bd7908-1bc4-43b7-99a2-2233c54487ee tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:02:19.398449 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d4bd7908-1bc4-43b7-99a2-2233c54487ee tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:19.398954 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d4bd7908-1bc4-43b7-99a2-2233c54487ee tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:19.399787 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d4bd7908-1bc4-43b7-99a2-2233c54487ee tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:19.400277 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d4bd7908-1bc4-43b7-99a2-2233c54487ee tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:19.615914 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-d4bd7908-1bc4-43b7-99a2-2233c54487ee tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:19.624652 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-d4bd7908-1bc4-43b7-99a2-2233c54487ee tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1569 microversion: 2.1 time: 0.387538 Dec 16 15:02:19.625248 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 441/895] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:02:19 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1569 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:02:20.339125 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-438530b4-3940-4701-bb55-1d5846089288 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:02:20.339794 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-438530b4-3940-4701-bb55-1d5846089288 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:02:20.347725 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-438530b4-3940-4701-bb55-1d5846089288 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:20.348181 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-438530b4-3940-4701-bb55-1d5846089288 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:20.349562 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-438530b4-3940-4701-bb55-1d5846089288 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:20.350277 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-438530b4-3940-4701-bb55-1d5846089288 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:20.647860 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-9d99454f-3920-4d07-b260-20bff82cb6ac tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:02:20.648997 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-9d99454f-3920-4d07-b260-20bff82cb6ac tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:02:20.657115 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9d99454f-3920-4d07-b260-20bff82cb6ac tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:20.657627 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9d99454f-3920-4d07-b260-20bff82cb6ac tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:20.658557 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9d99454f-3920-4d07-b260-20bff82cb6ac tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:20.659055 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9d99454f-3920-4d07-b260-20bff82cb6ac tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:20.762592 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-438530b4-3940-4701-bb55-1d5846089288 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:20.776185 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-438530b4-3940-4701-bb55-1d5846089288 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:20.780692 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-438530b4-3940-4701-bb55-1d5846089288 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:20.781890 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-438530b4-3940-4701-bb55-1d5846089288 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.450572 Dec 16 15:02:20.782534 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 455/896] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:02:20 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:02:20.871297 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-9d99454f-3920-4d07-b260-20bff82cb6ac tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:20.880162 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-9d99454f-3920-4d07-b260-20bff82cb6ac tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1569 microversion: 2.1 time: 0.240598 Dec 16 15:02:20.880759 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 442/897] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:02:20 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1569 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:02:21.808373 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-474649f6-9a4b-4939-9cc3-832971b903c6 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:02:21.809351 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-474649f6-9a4b-4939-9cc3-832971b903c6 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:02:21.821572 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-474649f6-9a4b-4939-9cc3-832971b903c6 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:21.822416 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-474649f6-9a4b-4939-9cc3-832971b903c6 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:21.823984 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-474649f6-9a4b-4939-9cc3-832971b903c6 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:21.824762 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-474649f6-9a4b-4939-9cc3-832971b903c6 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:21.902283 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-93401a7e-280e-4ef9-89e9-2314c11498ff tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:02:21.903134 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-93401a7e-280e-4ef9-89e9-2314c11498ff tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:02:21.910934 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-93401a7e-280e-4ef9-89e9-2314c11498ff tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:21.911962 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-93401a7e-280e-4ef9-89e9-2314c11498ff tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:21.912909 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-93401a7e-280e-4ef9-89e9-2314c11498ff tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:21.913405 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-93401a7e-280e-4ef9-89e9-2314c11498ff tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:22.060792 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-474649f6-9a4b-4939-9cc3-832971b903c6 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:22.073891 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-474649f6-9a4b-4939-9cc3-832971b903c6 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:22.078388 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-474649f6-9a4b-4939-9cc3-832971b903c6 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:22.079584 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-474649f6-9a4b-4939-9cc3-832971b903c6 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.281736 Dec 16 15:02:22.080169 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 456/898] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:02:21 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:02:22.133678 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-93401a7e-280e-4ef9-89e9-2314c11498ff tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:22.142511 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-93401a7e-280e-4ef9-89e9-2314c11498ff tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1569 microversion: 2.1 time: 0.247816 Dec 16 15:02:22.143100 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 443/899] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:02:21 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1569 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:02:23.102351 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-8debace0-5f6c-4177-88ca-1aabb266e945 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:02:23.103022 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-8debace0-5f6c-4177-88ca-1aabb266e945 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:02:23.110915 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8debace0-5f6c-4177-88ca-1aabb266e945 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:23.111425 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8debace0-5f6c-4177-88ca-1aabb266e945 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:23.112257 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8debace0-5f6c-4177-88ca-1aabb266e945 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:23.112748 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8debace0-5f6c-4177-88ca-1aabb266e945 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:23.171784 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-0a63f0cb-3c87-41e7-8bfc-5eb64dadadf7 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:02:23.172447 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-0a63f0cb-3c87-41e7-8bfc-5eb64dadadf7 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:02:23.180795 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0a63f0cb-3c87-41e7-8bfc-5eb64dadadf7 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:23.181298 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0a63f0cb-3c87-41e7-8bfc-5eb64dadadf7 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:23.182185 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0a63f0cb-3c87-41e7-8bfc-5eb64dadadf7 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:23.182680 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0a63f0cb-3c87-41e7-8bfc-5eb64dadadf7 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:23.334385 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-8debace0-5f6c-4177-88ca-1aabb266e945 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:23.348012 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-8debace0-5f6c-4177-88ca-1aabb266e945 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:23.352798 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-8debace0-5f6c-4177-88ca-1aabb266e945 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:23.353949 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-8debace0-5f6c-4177-88ca-1aabb266e945 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.259260 Dec 16 15:02:23.354790 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 457/900] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:02:23 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:02:23.530796 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-0a63f0cb-3c87-41e7-8bfc-5eb64dadadf7 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:23.541113 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-0a63f0cb-3c87-41e7-8bfc-5eb64dadadf7 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1569 microversion: 2.1 time: 0.377057 Dec 16 15:02:23.541720 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 444/901] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:02:23 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1569 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:02:24.381194 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-0efe6dc9-66c1-48bf-9880-30f2b296b921 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:02:24.381955 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-0efe6dc9-66c1-48bf-9880-30f2b296b921 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:02:24.392892 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0efe6dc9-66c1-48bf-9880-30f2b296b921 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:24.393830 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0efe6dc9-66c1-48bf-9880-30f2b296b921 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:24.395134 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0efe6dc9-66c1-48bf-9880-30f2b296b921 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:24.396550 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0efe6dc9-66c1-48bf-9880-30f2b296b921 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:24.563513 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-8f8f8336-32c8-4e12-aed6-2bd5e50ede56 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:02:24.563641 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-8f8f8336-32c8-4e12-aed6-2bd5e50ede56 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:02:24.571557 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8f8f8336-32c8-4e12-aed6-2bd5e50ede56 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:24.572064 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8f8f8336-32c8-4e12-aed6-2bd5e50ede56 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:24.572913 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8f8f8336-32c8-4e12-aed6-2bd5e50ede56 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:24.573719 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8f8f8336-32c8-4e12-aed6-2bd5e50ede56 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:24.619637 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-0efe6dc9-66c1-48bf-9880-30f2b296b921 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:24.632686 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-0efe6dc9-66c1-48bf-9880-30f2b296b921 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:24.637224 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-0efe6dc9-66c1-48bf-9880-30f2b296b921 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:24.638452 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-0efe6dc9-66c1-48bf-9880-30f2b296b921 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.268048 Dec 16 15:02:24.639046 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 458/902] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:02:24 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:02:24.792549 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-8f8f8336-32c8-4e12-aed6-2bd5e50ede56 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:24.801471 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-8f8f8336-32c8-4e12-aed6-2bd5e50ede56 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1569 microversion: 2.1 time: 0.246099 Dec 16 15:02:24.802699 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 445/903] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:02:24 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1569 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:02:25.663012 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-93581a5f-f89a-4489-a10e-de54b1d19701 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:02:25.663570 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-93581a5f-f89a-4489-a10e-de54b1d19701 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:02:25.671410 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-93581a5f-f89a-4489-a10e-de54b1d19701 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:25.671913 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-93581a5f-f89a-4489-a10e-de54b1d19701 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:25.672745 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-93581a5f-f89a-4489-a10e-de54b1d19701 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:25.673235 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-93581a5f-f89a-4489-a10e-de54b1d19701 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:25.824430 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-63bfd12f-340b-45f5-9e2e-11c91b64a10b tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:02:25.825102 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-63bfd12f-340b-45f5-9e2e-11c91b64a10b tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:02:25.833711 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-63bfd12f-340b-45f5-9e2e-11c91b64a10b tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:25.834252 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-63bfd12f-340b-45f5-9e2e-11c91b64a10b tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:25.835099 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-63bfd12f-340b-45f5-9e2e-11c91b64a10b tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:25.835631 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-63bfd12f-340b-45f5-9e2e-11c91b64a10b tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:25.886797 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-93581a5f-f89a-4489-a10e-de54b1d19701 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:25.901863 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-93581a5f-f89a-4489-a10e-de54b1d19701 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:25.906377 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-93581a5f-f89a-4489-a10e-de54b1d19701 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:25.907580 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-93581a5f-f89a-4489-a10e-de54b1d19701 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.252847 Dec 16 15:02:25.908172 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 459/904] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:02:25 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:02:26.056932 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-63bfd12f-340b-45f5-9e2e-11c91b64a10b tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:26.065798 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-63bfd12f-340b-45f5-9e2e-11c91b64a10b tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1569 microversion: 2.1 time: 0.249303 Dec 16 15:02:26.066429 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 446/905] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:02:25 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1569 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:02:26.932445 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-43cd2791-2a97-465f-9970-edf0351faa34 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:02:26.933104 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-43cd2791-2a97-465f-9970-edf0351faa34 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:02:26.940948 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-43cd2791-2a97-465f-9970-edf0351faa34 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:26.941451 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-43cd2791-2a97-465f-9970-edf0351faa34 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:26.942878 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-43cd2791-2a97-465f-9970-edf0351faa34 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:26.943368 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-43cd2791-2a97-465f-9970-edf0351faa34 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:27.089666 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-c29f4185-724b-4f65-aa11-44c545f89d69 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:02:27.090362 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-c29f4185-724b-4f65-aa11-44c545f89d69 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:02:27.099280 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c29f4185-724b-4f65-aa11-44c545f89d69 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:27.099798 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c29f4185-724b-4f65-aa11-44c545f89d69 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:27.100716 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c29f4185-724b-4f65-aa11-44c545f89d69 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:27.101214 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c29f4185-724b-4f65-aa11-44c545f89d69 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:27.179923 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-43cd2791-2a97-465f-9970-edf0351faa34 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:27.201760 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-43cd2791-2a97-465f-9970-edf0351faa34 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:27.210012 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-43cd2791-2a97-465f-9970-edf0351faa34 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:27.211964 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-43cd2791-2a97-465f-9970-edf0351faa34 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.287979 Dec 16 15:02:27.212933 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 460/906] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:02:26 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:02:27.329335 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-c29f4185-724b-4f65-aa11-44c545f89d69 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:27.339205 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-c29f4185-724b-4f65-aa11-44c545f89d69 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1569 microversion: 2.1 time: 0.258691 Dec 16 15:02:27.340015 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 447/907] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:02:27 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1569 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:02:28.235532 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-f9d583fd-504b-4e41-97be-838f9b6d9219 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:02:28.236193 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-f9d583fd-504b-4e41-97be-838f9b6d9219 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:02:28.244124 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f9d583fd-504b-4e41-97be-838f9b6d9219 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:28.244628 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f9d583fd-504b-4e41-97be-838f9b6d9219 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:28.245460 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f9d583fd-504b-4e41-97be-838f9b6d9219 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:28.245946 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f9d583fd-504b-4e41-97be-838f9b6d9219 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:28.362210 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-6fb77ed2-627f-4657-9aae-7000c9ce298b tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:02:28.362825 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-6fb77ed2-627f-4657-9aae-7000c9ce298b tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:02:28.370825 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6fb77ed2-627f-4657-9aae-7000c9ce298b tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:28.371375 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6fb77ed2-627f-4657-9aae-7000c9ce298b tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:28.372161 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6fb77ed2-627f-4657-9aae-7000c9ce298b tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:28.372651 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6fb77ed2-627f-4657-9aae-7000c9ce298b tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:28.470733 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-f9d583fd-504b-4e41-97be-838f9b6d9219 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:28.484436 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-f9d583fd-504b-4e41-97be-838f9b6d9219 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:28.492059 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-f9d583fd-504b-4e41-97be-838f9b6d9219 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:28.493469 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-f9d583fd-504b-4e41-97be-838f9b6d9219 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.265306 Dec 16 15:02:28.494233 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 461/908] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:02:28 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:02:28.606408 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-6fb77ed2-627f-4657-9aae-7000c9ce298b tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:28.615367 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-6fb77ed2-627f-4657-9aae-7000c9ce298b tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1569 microversion: 2.1 time: 0.261155 Dec 16 15:02:28.615901 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 448/909] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:02:28 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1569 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:02:29.524274 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-b8c2e6fa-9c62-4cfa-8372-5a76a4104a83 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:02:29.524930 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-b8c2e6fa-9c62-4cfa-8372-5a76a4104a83 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:02:29.532781 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b8c2e6fa-9c62-4cfa-8372-5a76a4104a83 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:29.533283 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b8c2e6fa-9c62-4cfa-8372-5a76a4104a83 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:29.534132 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b8c2e6fa-9c62-4cfa-8372-5a76a4104a83 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:29.534619 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b8c2e6fa-9c62-4cfa-8372-5a76a4104a83 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:29.636777 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-ca45db4b-2f64-4d20-a957-3c0af0761f37 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:02:29.637363 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-ca45db4b-2f64-4d20-a957-3c0af0761f37 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:02:29.645690 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ca45db4b-2f64-4d20-a957-3c0af0761f37 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:29.646220 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ca45db4b-2f64-4d20-a957-3c0af0761f37 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:29.647065 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ca45db4b-2f64-4d20-a957-3c0af0761f37 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:29.647559 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ca45db4b-2f64-4d20-a957-3c0af0761f37 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:29.757202 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-b8c2e6fa-9c62-4cfa-8372-5a76a4104a83 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:29.771113 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-b8c2e6fa-9c62-4cfa-8372-5a76a4104a83 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:29.775701 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-b8c2e6fa-9c62-4cfa-8372-5a76a4104a83 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:29.776900 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-b8c2e6fa-9c62-4cfa-8372-5a76a4104a83 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.260511 Dec 16 15:02:29.777500 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 462/910] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:02:29 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:02:29.864271 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-ca45db4b-2f64-4d20-a957-3c0af0761f37 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:29.873092 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-ca45db4b-2f64-4d20-a957-3c0af0761f37 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1569 microversion: 2.1 time: 0.244099 Dec 16 15:02:29.873673 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 449/911] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:02:29 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1569 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:02:30.801566 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-f9c18cc9-de75-4d76-bda1-c910fb53e5c5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:02:30.802192 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-f9c18cc9-de75-4d76-bda1-c910fb53e5c5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:02:30.809907 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f9c18cc9-de75-4d76-bda1-c910fb53e5c5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:30.810455 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f9c18cc9-de75-4d76-bda1-c910fb53e5c5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:30.811277 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f9c18cc9-de75-4d76-bda1-c910fb53e5c5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:30.811758 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f9c18cc9-de75-4d76-bda1-c910fb53e5c5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:30.894693 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-eac54da3-49c5-49aa-a436-b297526cc575 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:02:30.895373 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-eac54da3-49c5-49aa-a436-b297526cc575 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:02:30.903379 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-eac54da3-49c5-49aa-a436-b297526cc575 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:30.903899 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-eac54da3-49c5-49aa-a436-b297526cc575 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:30.904758 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-eac54da3-49c5-49aa-a436-b297526cc575 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:30.905618 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-eac54da3-49c5-49aa-a436-b297526cc575 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:31.032907 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-f9c18cc9-de75-4d76-bda1-c910fb53e5c5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:31.046253 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-f9c18cc9-de75-4d76-bda1-c910fb53e5c5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:31.050765 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-f9c18cc9-de75-4d76-bda1-c910fb53e5c5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:31.052595 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-f9c18cc9-de75-4d76-bda1-c910fb53e5c5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.258612 Dec 16 15:02:31.053278 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 463/912] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:02:30 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:02:31.130491 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-eac54da3-49c5-49aa-a436-b297526cc575 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:31.140997 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-eac54da3-49c5-49aa-a436-b297526cc575 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1569 microversion: 2.1 time: 0.252421 Dec 16 15:02:31.140997 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 450/913] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:02:30 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1569 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:02:32.076943 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-150dc77e-d717-40b8-acd4-9eaebb490783 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:02:32.077609 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-150dc77e-d717-40b8-acd4-9eaebb490783 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:02:32.085419 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-150dc77e-d717-40b8-acd4-9eaebb490783 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:32.085922 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-150dc77e-d717-40b8-acd4-9eaebb490783 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:32.086791 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-150dc77e-d717-40b8-acd4-9eaebb490783 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:32.087272 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-150dc77e-d717-40b8-acd4-9eaebb490783 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:32.162707 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-4867d683-8a85-4cbc-a1ab-c1ff31ff7497 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:02:32.163551 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-4867d683-8a85-4cbc-a1ab-c1ff31ff7497 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:02:32.171352 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4867d683-8a85-4cbc-a1ab-c1ff31ff7497 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:32.171864 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4867d683-8a85-4cbc-a1ab-c1ff31ff7497 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:32.172711 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4867d683-8a85-4cbc-a1ab-c1ff31ff7497 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:32.173237 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4867d683-8a85-4cbc-a1ab-c1ff31ff7497 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:32.299140 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-150dc77e-d717-40b8-acd4-9eaebb490783 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:32.312670 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-150dc77e-d717-40b8-acd4-9eaebb490783 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:32.317125 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-150dc77e-d717-40b8-acd4-9eaebb490783 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:32.318344 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-150dc77e-d717-40b8-acd4-9eaebb490783 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.249377 Dec 16 15:02:32.318941 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 464/914] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:02:32 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:02:32.386946 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-4867d683-8a85-4cbc-a1ab-c1ff31ff7497 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:32.395830 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-4867d683-8a85-4cbc-a1ab-c1ff31ff7497 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1569 microversion: 2.1 time: 0.240913 Dec 16 15:02:32.396422 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 451/915] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:02:32 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1569 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:02:33.341954 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-9ab68a03-e004-40ba-a70c-00713389557c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:02:33.342899 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-9ab68a03-e004-40ba-a70c-00713389557c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:02:33.350775 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9ab68a03-e004-40ba-a70c-00713389557c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:33.351287 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9ab68a03-e004-40ba-a70c-00713389557c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:33.352134 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9ab68a03-e004-40ba-a70c-00713389557c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:33.352792 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9ab68a03-e004-40ba-a70c-00713389557c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:33.416749 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-0babfc23-a492-462b-809d-4eecf1165622 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:02:33.417605 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-0babfc23-a492-462b-809d-4eecf1165622 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:02:33.425436 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0babfc23-a492-462b-809d-4eecf1165622 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:33.425942 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0babfc23-a492-462b-809d-4eecf1165622 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:33.427361 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0babfc23-a492-462b-809d-4eecf1165622 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:33.427855 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0babfc23-a492-462b-809d-4eecf1165622 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:33.573825 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-9ab68a03-e004-40ba-a70c-00713389557c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:33.586658 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-9ab68a03-e004-40ba-a70c-00713389557c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:33.591137 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-9ab68a03-e004-40ba-a70c-00713389557c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:33.592331 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-9ab68a03-e004-40ba-a70c-00713389557c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.258083 Dec 16 15:02:33.592873 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 465/916] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:02:33 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:02:33.648548 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-0babfc23-a492-462b-809d-4eecf1165622 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:33.657431 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-0babfc23-a492-462b-809d-4eecf1165622 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1569 microversion: 2.1 time: 0.248418 Dec 16 15:02:33.658020 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 452/917] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:02:33 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1569 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:02:34.615241 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-f982704b-deba-4923-8bd7-287cdcef2749 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:02:34.615916 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-f982704b-deba-4923-8bd7-287cdcef2749 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:02:34.623796 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f982704b-deba-4923-8bd7-287cdcef2749 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:34.624305 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f982704b-deba-4923-8bd7-287cdcef2749 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:34.625145 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f982704b-deba-4923-8bd7-287cdcef2749 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:34.625640 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f982704b-deba-4923-8bd7-287cdcef2749 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:34.679177 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-39f41bc9-5793-4810-a08b-cf22bfdb17d6 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:02:34.679782 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-39f41bc9-5793-4810-a08b-cf22bfdb17d6 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:02:34.687403 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-39f41bc9-5793-4810-a08b-cf22bfdb17d6 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:34.687910 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-39f41bc9-5793-4810-a08b-cf22bfdb17d6 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:34.688744 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-39f41bc9-5793-4810-a08b-cf22bfdb17d6 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:34.689229 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-39f41bc9-5793-4810-a08b-cf22bfdb17d6 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:34.838418 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-f982704b-deba-4923-8bd7-287cdcef2749 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:34.851620 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-f982704b-deba-4923-8bd7-287cdcef2749 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:34.856112 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-f982704b-deba-4923-8bd7-287cdcef2749 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:34.857296 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-f982704b-deba-4923-8bd7-287cdcef2749 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.249753 Dec 16 15:02:34.857880 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 466/918] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:02:34 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:02:34.904162 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-39f41bc9-5793-4810-a08b-cf22bfdb17d6 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:34.913030 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-39f41bc9-5793-4810-a08b-cf22bfdb17d6 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1569 microversion: 2.1 time: 0.241584 Dec 16 15:02:34.913607 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 453/919] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:02:34 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1569 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:02:35.881746 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-ac7ce382-abe9-4160-9c8e-7363e1634a66 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:02:35.882434 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-ac7ce382-abe9-4160-9c8e-7363e1634a66 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:02:35.890319 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ac7ce382-abe9-4160-9c8e-7363e1634a66 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:35.890829 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ac7ce382-abe9-4160-9c8e-7363e1634a66 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:35.891658 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ac7ce382-abe9-4160-9c8e-7363e1634a66 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:35.892149 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ac7ce382-abe9-4160-9c8e-7363e1634a66 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:35.935767 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-09c892c8-0636-4f63-97d2-f0bec4df78d0 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:02:35.936439 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-09c892c8-0636-4f63-97d2-f0bec4df78d0 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:02:35.944849 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-09c892c8-0636-4f63-97d2-f0bec4df78d0 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:35.945363 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-09c892c8-0636-4f63-97d2-f0bec4df78d0 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:35.946237 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-09c892c8-0636-4f63-97d2-f0bec4df78d0 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:35.946735 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-09c892c8-0636-4f63-97d2-f0bec4df78d0 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:36.109947 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-ac7ce382-abe9-4160-9c8e-7363e1634a66 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:36.123601 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-ac7ce382-abe9-4160-9c8e-7363e1634a66 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:36.128129 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-ac7ce382-abe9-4160-9c8e-7363e1634a66 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:36.129409 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-ac7ce382-abe9-4160-9c8e-7363e1634a66 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.255913 Dec 16 15:02:36.130006 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 467/920] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:02:35 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:02:36.166072 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-09c892c8-0636-4f63-97d2-f0bec4df78d0 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:36.175051 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-09c892c8-0636-4f63-97d2-f0bec4df78d0 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1569 microversion: 2.1 time: 0.247078 Dec 16 15:02:36.175634 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 454/921] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:02:35 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1569 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:02:37.152766 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-69648ed4-4091-439e-bb63-4d3c6d19b28e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:02:37.153435 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-69648ed4-4091-439e-bb63-4d3c6d19b28e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:02:37.162016 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-69648ed4-4091-439e-bb63-4d3c6d19b28e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:37.162886 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-69648ed4-4091-439e-bb63-4d3c6d19b28e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:37.164071 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-69648ed4-4091-439e-bb63-4d3c6d19b28e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:37.164574 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-69648ed4-4091-439e-bb63-4d3c6d19b28e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:37.198392 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-dc6e6310-3f27-423f-9883-eb8f25e38bdd tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:02:37.199083 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-dc6e6310-3f27-423f-9883-eb8f25e38bdd tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:02:37.206955 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-dc6e6310-3f27-423f-9883-eb8f25e38bdd tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:37.207508 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-dc6e6310-3f27-423f-9883-eb8f25e38bdd tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:37.208353 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-dc6e6310-3f27-423f-9883-eb8f25e38bdd tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:37.208845 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-dc6e6310-3f27-423f-9883-eb8f25e38bdd tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:37.388592 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-69648ed4-4091-439e-bb63-4d3c6d19b28e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:37.401956 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-69648ed4-4091-439e-bb63-4d3c6d19b28e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:37.406634 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-69648ed4-4091-439e-bb63-4d3c6d19b28e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:37.407811 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-69648ed4-4091-439e-bb63-4d3c6d19b28e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.262822 Dec 16 15:02:37.408406 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 468/922] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:02:37 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:02:37.437984 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-dc6e6310-3f27-423f-9883-eb8f25e38bdd tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:37.447559 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-dc6e6310-3f27-423f-9883-eb8f25e38bdd tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1569 microversion: 2.1 time: 0.257775 Dec 16 15:02:37.448395 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 455/923] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:02:37 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1569 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:02:38.431246 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-6135e5af-e236-46b4-a15c-96273c4581ac tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:02:38.431910 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-6135e5af-e236-46b4-a15c-96273c4581ac tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:02:38.439765 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6135e5af-e236-46b4-a15c-96273c4581ac tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:38.440266 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6135e5af-e236-46b4-a15c-96273c4581ac tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:38.441092 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6135e5af-e236-46b4-a15c-96273c4581ac tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:38.441581 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6135e5af-e236-46b4-a15c-96273c4581ac tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:38.469673 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-b7dc7aa8-1057-4540-9efa-3e364138590f tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:02:38.470363 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-b7dc7aa8-1057-4540-9efa-3e364138590f tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:02:38.478114 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b7dc7aa8-1057-4540-9efa-3e364138590f tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:38.478620 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b7dc7aa8-1057-4540-9efa-3e364138590f tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:38.479452 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b7dc7aa8-1057-4540-9efa-3e364138590f tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:38.479936 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b7dc7aa8-1057-4540-9efa-3e364138590f tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:38.656661 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-6135e5af-e236-46b4-a15c-96273c4581ac tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:38.669313 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-6135e5af-e236-46b4-a15c-96273c4581ac tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:38.673751 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-6135e5af-e236-46b4-a15c-96273c4581ac tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:38.674988 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-6135e5af-e236-46b4-a15c-96273c4581ac tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.251547 Dec 16 15:02:38.675568 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 469/924] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:02:38 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:02:38.693483 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-b7dc7aa8-1057-4540-9efa-3e364138590f tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:38.702564 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-b7dc7aa8-1057-4540-9efa-3e364138590f tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1569 microversion: 2.1 time: 0.240444 Dec 16 15:02:38.703148 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 456/925] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:02:38 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1569 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:02:39.699405 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-239bca67-9b66-4eae-9466-70120a2a72cc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:02:39.700030 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-239bca67-9b66-4eae-9466-70120a2a72cc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:02:39.707836 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-239bca67-9b66-4eae-9466-70120a2a72cc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:39.708341 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-239bca67-9b66-4eae-9466-70120a2a72cc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:39.709176 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-239bca67-9b66-4eae-9466-70120a2a72cc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:39.709663 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-239bca67-9b66-4eae-9466-70120a2a72cc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:39.724985 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-999413e6-d918-45db-bbd8-3af1a2e59da9 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:02:39.725653 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-999413e6-d918-45db-bbd8-3af1a2e59da9 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:02:39.733360 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-999413e6-d918-45db-bbd8-3af1a2e59da9 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:39.733866 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-999413e6-d918-45db-bbd8-3af1a2e59da9 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:39.734773 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-999413e6-d918-45db-bbd8-3af1a2e59da9 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:39.735520 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-999413e6-d918-45db-bbd8-3af1a2e59da9 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:39.928377 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-239bca67-9b66-4eae-9466-70120a2a72cc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:39.941650 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-239bca67-9b66-4eae-9466-70120a2a72cc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:39.946145 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-239bca67-9b66-4eae-9466-70120a2a72cc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:39.947330 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-239bca67-9b66-4eae-9466-70120a2a72cc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.256498 Dec 16 15:02:39.948383 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 470/926] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:02:39 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:02:39.957171 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-999413e6-d918-45db-bbd8-3af1a2e59da9 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:39.966139 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-999413e6-d918-45db-bbd8-3af1a2e59da9 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1569 microversion: 2.1 time: 0.249448 Dec 16 15:02:39.966726 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 457/927] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:02:39 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1569 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:02:40.971070 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-cf893243-5a33-4eac-a15d-c3cfe1a25e2a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:02:40.971731 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-cf893243-5a33-4eac-a15d-c3cfe1a25e2a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:02:40.979455 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cf893243-5a33-4eac-a15d-c3cfe1a25e2a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:40.979968 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cf893243-5a33-4eac-a15d-c3cfe1a25e2a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:40.980818 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cf893243-5a33-4eac-a15d-c3cfe1a25e2a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:40.981294 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cf893243-5a33-4eac-a15d-c3cfe1a25e2a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:40.987787 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-cd5237f8-45b2-4991-9f57-902e6add643c tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:02:40.989044 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-cd5237f8-45b2-4991-9f57-902e6add643c tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:02:40.996754 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cd5237f8-45b2-4991-9f57-902e6add643c tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:40.997254 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cd5237f8-45b2-4991-9f57-902e6add643c tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:40.998087 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cd5237f8-45b2-4991-9f57-902e6add643c tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:40.998575 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cd5237f8-45b2-4991-9f57-902e6add643c tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:41.199697 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-cf893243-5a33-4eac-a15d-c3cfe1a25e2a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:41.213579 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-cf893243-5a33-4eac-a15d-c3cfe1a25e2a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:41.217279 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-cd5237f8-45b2-4991-9f57-902e6add643c tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:41.222128 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-cf893243-5a33-4eac-a15d-c3cfe1a25e2a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:41.222128 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-cf893243-5a33-4eac-a15d-c3cfe1a25e2a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.256331 Dec 16 15:02:41.222128 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 471/928] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:02:40 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:02:41.226848 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-cd5237f8-45b2-4991-9f57-902e6add643c tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1569 microversion: 2.1 time: 0.246878 Dec 16 15:02:41.227448 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 458/929] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:02:40 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1569 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:02:42.244940 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-ae05de59-102d-40ce-9e8f-605297be226e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:02:42.245614 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-ae05de59-102d-40ce-9e8f-605297be226e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:02:42.249100 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-e29446f3-e78a-4096-8941-41a984fd085c tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:02:42.249783 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-e29446f3-e78a-4096-8941-41a984fd085c tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:02:42.253522 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ae05de59-102d-40ce-9e8f-605297be226e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:42.254029 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ae05de59-102d-40ce-9e8f-605297be226e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:42.254893 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ae05de59-102d-40ce-9e8f-605297be226e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:42.255391 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ae05de59-102d-40ce-9e8f-605297be226e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:42.257594 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e29446f3-e78a-4096-8941-41a984fd085c tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:42.258170 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e29446f3-e78a-4096-8941-41a984fd085c tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:42.259024 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e29446f3-e78a-4096-8941-41a984fd085c tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:42.259571 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e29446f3-e78a-4096-8941-41a984fd085c tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:42.482620 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-e29446f3-e78a-4096-8941-41a984fd085c tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:42.482845 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-ae05de59-102d-40ce-9e8f-605297be226e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:42.491633 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-e29446f3-e78a-4096-8941-41a984fd085c tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1569 microversion: 2.1 time: 0.250238 Dec 16 15:02:42.492229 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 459/930] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:02:42 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1569 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:02:42.495776 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-ae05de59-102d-40ce-9e8f-605297be226e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:42.500222 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-ae05de59-102d-40ce-9e8f-605297be226e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:42.501402 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-ae05de59-102d-40ce-9e8f-605297be226e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.264917 Dec 16 15:02:42.501998 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 472/931] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:02:42 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:02:43.514182 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-c5f6c03b-751c-4c5b-a9d5-0f9c19802e13 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:02:43.514862 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-c5f6c03b-751c-4c5b-a9d5-0f9c19802e13 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:02:43.523357 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c5f6c03b-751c-4c5b-a9d5-0f9c19802e13 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:43.523868 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c5f6c03b-751c-4c5b-a9d5-0f9c19802e13 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:43.524715 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c5f6c03b-751c-4c5b-a9d5-0f9c19802e13 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:43.524825 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-e7b4eab7-703a-4409-b510-f2436ec161d7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:02:43.525391 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-e7b4eab7-703a-4409-b510-f2436ec161d7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:02:43.525511 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c5f6c03b-751c-4c5b-a9d5-0f9c19802e13 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:43.533143 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e7b4eab7-703a-4409-b510-f2436ec161d7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:43.533662 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e7b4eab7-703a-4409-b510-f2436ec161d7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:43.534506 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e7b4eab7-703a-4409-b510-f2436ec161d7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:43.534989 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e7b4eab7-703a-4409-b510-f2436ec161d7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:43.761119 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-c5f6c03b-751c-4c5b-a9d5-0f9c19802e13 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:43.771271 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-c5f6c03b-751c-4c5b-a9d5-0f9c19802e13 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1569 microversion: 2.1 time: 0.264804 Dec 16 15:02:43.771872 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 460/932] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:02:43 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1569 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:02:43.774659 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-e7b4eab7-703a-4409-b510-f2436ec161d7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:43.787715 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-e7b4eab7-703a-4409-b510-f2436ec161d7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:43.792302 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-e7b4eab7-703a-4409-b510-f2436ec161d7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:43.793490 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-e7b4eab7-703a-4409-b510-f2436ec161d7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.277035 Dec 16 15:02:43.794101 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 473/933] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:02:43 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:02:44.793888 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-4d7ce24a-0bcf-4d0e-8b74-4770839e07ba tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:02:44.794577 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-4d7ce24a-0bcf-4d0e-8b74-4770839e07ba tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:02:44.802471 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4d7ce24a-0bcf-4d0e-8b74-4770839e07ba tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:44.802985 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4d7ce24a-0bcf-4d0e-8b74-4770839e07ba tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:44.803830 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4d7ce24a-0bcf-4d0e-8b74-4770839e07ba tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:44.804328 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4d7ce24a-0bcf-4d0e-8b74-4770839e07ba tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:44.816664 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-a60c1e49-da61-4baf-8902-472064d914a6 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:02:44.817375 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-a60c1e49-da61-4baf-8902-472064d914a6 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:02:44.825466 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a60c1e49-da61-4baf-8902-472064d914a6 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:44.825971 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a60c1e49-da61-4baf-8902-472064d914a6 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:44.826827 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a60c1e49-da61-4baf-8902-472064d914a6 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:44.827317 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a60c1e49-da61-4baf-8902-472064d914a6 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:45.024561 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-4d7ce24a-0bcf-4d0e-8b74-4770839e07ba tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:45.033267 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-4d7ce24a-0bcf-4d0e-8b74-4770839e07ba tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1569 microversion: 2.1 time: 0.247710 Dec 16 15:02:45.033873 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 461/934] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:02:44 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1569 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:02:45.044850 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-a60c1e49-da61-4baf-8902-472064d914a6 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:45.057591 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-a60c1e49-da61-4baf-8902-472064d914a6 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:45.062115 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-a60c1e49-da61-4baf-8902-472064d914a6 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:45.063296 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-a60c1e49-da61-4baf-8902-472064d914a6 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.254418 Dec 16 15:02:45.063879 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 474/935] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:02:44 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 15:02:46.056190 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-c5802e77-59a6-46d6-9d16-25e97009a3a4 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:02:46.056801 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-c5802e77-59a6-46d6-9d16-25e97009a3a4 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:02:46.064659 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c5802e77-59a6-46d6-9d16-25e97009a3a4 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:46.065171 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c5802e77-59a6-46d6-9d16-25e97009a3a4 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:46.066015 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c5802e77-59a6-46d6-9d16-25e97009a3a4 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:46.066538 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c5802e77-59a6-46d6-9d16-25e97009a3a4 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:46.087574 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-e96149f7-8253-4472-82a8-c9316e940ef5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:02:46.088235 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-e96149f7-8253-4472-82a8-c9316e940ef5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:02:46.096010 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e96149f7-8253-4472-82a8-c9316e940ef5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:46.096514 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e96149f7-8253-4472-82a8-c9316e940ef5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:46.097344 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e96149f7-8253-4472-82a8-c9316e940ef5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:46.098502 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e96149f7-8253-4472-82a8-c9316e940ef5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:46.283639 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-c5802e77-59a6-46d6-9d16-25e97009a3a4 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:46.293190 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-c5802e77-59a6-46d6-9d16-25e97009a3a4 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1569 microversion: 2.1 time: 0.245239 Dec 16 15:02:46.293901 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 462/936] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:02:46 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1569 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:02:46.315161 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-e96149f7-8253-4472-82a8-c9316e940ef5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:46.328058 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-e96149f7-8253-4472-82a8-c9316e940ef5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:46.333016 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-e96149f7-8253-4472-82a8-c9316e940ef5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:46.334211 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-e96149f7-8253-4472-82a8-c9316e940ef5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.254850 Dec 16 15:02:46.334795 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 475/937] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:02:46 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 15:02:47.314786 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-470534f7-280a-4653-bdb8-5ddf8f3ba8f8 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:02:47.315462 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-470534f7-280a-4653-bdb8-5ddf8f3ba8f8 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:02:47.323543 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-470534f7-280a-4653-bdb8-5ddf8f3ba8f8 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:47.324057 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-470534f7-280a-4653-bdb8-5ddf8f3ba8f8 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:47.324896 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-470534f7-280a-4653-bdb8-5ddf8f3ba8f8 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:47.325396 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-470534f7-280a-4653-bdb8-5ddf8f3ba8f8 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:47.358357 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-2893f3ad-c3d1-4619-a9d7-8c11dab60a21 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:02:47.359019 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-2893f3ad-c3d1-4619-a9d7-8c11dab60a21 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:02:47.368100 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2893f3ad-c3d1-4619-a9d7-8c11dab60a21 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:47.368678 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2893f3ad-c3d1-4619-a9d7-8c11dab60a21 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:47.369524 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2893f3ad-c3d1-4619-a9d7-8c11dab60a21 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:47.370022 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2893f3ad-c3d1-4619-a9d7-8c11dab60a21 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:47.564268 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-470534f7-280a-4653-bdb8-5ddf8f3ba8f8 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:47.573391 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-470534f7-280a-4653-bdb8-5ddf8f3ba8f8 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1569 microversion: 2.1 time: 0.265867 Dec 16 15:02:47.574167 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 463/938] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:02:47 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1569 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:02:47.591267 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-2893f3ad-c3d1-4619-a9d7-8c11dab60a21 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:47.604473 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-2893f3ad-c3d1-4619-a9d7-8c11dab60a21 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:47.608879 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-2893f3ad-c3d1-4619-a9d7-8c11dab60a21 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:47.610063 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-2893f3ad-c3d1-4619-a9d7-8c11dab60a21 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.259848 Dec 16 15:02:47.610631 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 476/939] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:02:47 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:02:48.595738 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-e936805a-1694-4bb3-8565-831616dcc029 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:02:48.596413 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-e936805a-1694-4bb3-8565-831616dcc029 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:02:48.604949 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e936805a-1694-4bb3-8565-831616dcc029 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:48.605464 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e936805a-1694-4bb3-8565-831616dcc029 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:48.606392 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e936805a-1694-4bb3-8565-831616dcc029 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:48.606889 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e936805a-1694-4bb3-8565-831616dcc029 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:48.633822 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-eb0b81cd-4358-42e7-9f78-8c6f86e2a485 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:02:48.634606 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-eb0b81cd-4358-42e7-9f78-8c6f86e2a485 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:02:48.642729 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-eb0b81cd-4358-42e7-9f78-8c6f86e2a485 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:48.643257 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-eb0b81cd-4358-42e7-9f78-8c6f86e2a485 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:48.644172 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-eb0b81cd-4358-42e7-9f78-8c6f86e2a485 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:48.645297 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-eb0b81cd-4358-42e7-9f78-8c6f86e2a485 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:48.850620 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-e936805a-1694-4bb3-8565-831616dcc029 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:48.860882 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-e936805a-1694-4bb3-8565-831616dcc029 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1569 microversion: 2.1 time: 0.272820 Dec 16 15:02:48.861497 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 464/940] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:02:48 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1569 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:02:48.886769 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-eb0b81cd-4358-42e7-9f78-8c6f86e2a485 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:48.901405 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-eb0b81cd-4358-42e7-9f78-8c6f86e2a485 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:48.905900 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-eb0b81cd-4358-42e7-9f78-8c6f86e2a485 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:48.907324 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-eb0b81cd-4358-42e7-9f78-8c6f86e2a485 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.281111 Dec 16 15:02:48.907972 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 477/941] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:02:48 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:02:49.882751 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-b2fadf3a-be15-404d-9e9b-cc200f64d720 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:02:49.883422 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-b2fadf3a-be15-404d-9e9b-cc200f64d720 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:02:49.891428 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b2fadf3a-be15-404d-9e9b-cc200f64d720 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:49.891911 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b2fadf3a-be15-404d-9e9b-cc200f64d720 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:49.892750 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b2fadf3a-be15-404d-9e9b-cc200f64d720 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:49.893243 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b2fadf3a-be15-404d-9e9b-cc200f64d720 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:49.932269 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-60c9f61c-5f9f-4472-9abc-5667f18a2fbc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:02:49.932982 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-60c9f61c-5f9f-4472-9abc-5667f18a2fbc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:02:49.940918 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-60c9f61c-5f9f-4472-9abc-5667f18a2fbc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:49.941425 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-60c9f61c-5f9f-4472-9abc-5667f18a2fbc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:49.942325 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-60c9f61c-5f9f-4472-9abc-5667f18a2fbc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:49.942824 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-60c9f61c-5f9f-4472-9abc-5667f18a2fbc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:50.113564 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-b2fadf3a-be15-404d-9e9b-cc200f64d720 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:50.123119 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-b2fadf3a-be15-404d-9e9b-cc200f64d720 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1569 microversion: 2.1 time: 0.248074 Dec 16 15:02:50.123710 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 465/942] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:02:49 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1569 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:02:50.155258 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-60c9f61c-5f9f-4472-9abc-5667f18a2fbc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:50.168597 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-60c9f61c-5f9f-4472-9abc-5667f18a2fbc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:50.173138 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-60c9f61c-5f9f-4472-9abc-5667f18a2fbc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:50.174316 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-60c9f61c-5f9f-4472-9abc-5667f18a2fbc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.250527 Dec 16 15:02:50.174890 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 478/943] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:02:49 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 15:02:51.145709 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-d9e8334c-c364-459a-9e64-c9a048f7331c tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:02:51.146385 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-d9e8334c-c364-459a-9e64-c9a048f7331c tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:02:51.154202 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d9e8334c-c364-459a-9e64-c9a048f7331c tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:51.154714 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d9e8334c-c364-459a-9e64-c9a048f7331c tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:51.155549 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d9e8334c-c364-459a-9e64-c9a048f7331c tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:51.156044 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d9e8334c-c364-459a-9e64-c9a048f7331c tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:51.197295 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-d9467ccf-51e0-4913-937a-949c039cf049 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:02:51.198252 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-d9467ccf-51e0-4913-937a-949c039cf049 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:02:51.205952 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d9467ccf-51e0-4913-937a-949c039cf049 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:51.206496 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d9467ccf-51e0-4913-937a-949c039cf049 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:51.207998 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d9467ccf-51e0-4913-937a-949c039cf049 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:51.208490 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d9467ccf-51e0-4913-937a-949c039cf049 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:51.383625 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-d9e8334c-c364-459a-9e64-c9a048f7331c tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:51.393056 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-d9e8334c-c364-459a-9e64-c9a048f7331c tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1569 microversion: 2.1 time: 0.255429 Dec 16 15:02:51.393893 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 466/944] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:02:51 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1569 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:02:51.491697 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-d9467ccf-51e0-4913-937a-949c039cf049 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:51.504976 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-d9467ccf-51e0-4913-937a-949c039cf049 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:51.509388 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-d9467ccf-51e0-4913-937a-949c039cf049 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:51.510586 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-d9467ccf-51e0-4913-937a-949c039cf049 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.321583 Dec 16 15:02:51.511164 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 479/945] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:02:51 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:02:52.415750 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-1af7445c-820a-4ff9-a800-29373fa2a2ff tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:02:52.416458 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-1af7445c-820a-4ff9-a800-29373fa2a2ff tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:02:52.424302 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1af7445c-820a-4ff9-a800-29373fa2a2ff tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:52.424808 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1af7445c-820a-4ff9-a800-29373fa2a2ff tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:52.425648 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1af7445c-820a-4ff9-a800-29373fa2a2ff tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:52.426189 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1af7445c-820a-4ff9-a800-29373fa2a2ff tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:52.533745 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-b837e0e5-8ccb-4a1e-829e-44998fd4c988 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:02:52.534606 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-b837e0e5-8ccb-4a1e-829e-44998fd4c988 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:02:52.542461 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b837e0e5-8ccb-4a1e-829e-44998fd4c988 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:52.542969 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b837e0e5-8ccb-4a1e-829e-44998fd4c988 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:52.543811 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b837e0e5-8ccb-4a1e-829e-44998fd4c988 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:52.544306 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b837e0e5-8ccb-4a1e-829e-44998fd4c988 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:52.643500 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-1af7445c-820a-4ff9-a800-29373fa2a2ff tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:52.653473 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-1af7445c-820a-4ff9-a800-29373fa2a2ff tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1569 microversion: 2.1 time: 0.245980 Dec 16 15:02:52.654398 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 467/946] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:02:52 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1569 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:02:52.770362 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-b837e0e5-8ccb-4a1e-829e-44998fd4c988 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:52.784090 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-b837e0e5-8ccb-4a1e-829e-44998fd4c988 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:52.788545 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-b837e0e5-8ccb-4a1e-829e-44998fd4c988 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:52.789723 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-b837e0e5-8ccb-4a1e-829e-44998fd4c988 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.263763 Dec 16 15:02:52.790361 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 480/947] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:02:52 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 15:02:53.676128 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-863ba591-55ae-4d2c-ab00-e5c99af700f5 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:02:53.676744 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-863ba591-55ae-4d2c-ab00-e5c99af700f5 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:02:53.684605 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-863ba591-55ae-4d2c-ab00-e5c99af700f5 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:53.685119 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-863ba591-55ae-4d2c-ab00-e5c99af700f5 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:53.685961 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-863ba591-55ae-4d2c-ab00-e5c99af700f5 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:53.686485 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-863ba591-55ae-4d2c-ab00-e5c99af700f5 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:53.812760 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-a2cb0b95-d323-4214-9608-2cbc2412686b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:02:53.813418 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-a2cb0b95-d323-4214-9608-2cbc2412686b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:02:53.821769 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a2cb0b95-d323-4214-9608-2cbc2412686b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:53.822322 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a2cb0b95-d323-4214-9608-2cbc2412686b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:53.823412 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a2cb0b95-d323-4214-9608-2cbc2412686b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:53.823894 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a2cb0b95-d323-4214-9608-2cbc2412686b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:54.046359 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-a2cb0b95-d323-4214-9608-2cbc2412686b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:54.060089 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-a2cb0b95-d323-4214-9608-2cbc2412686b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:54.064594 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-a2cb0b95-d323-4214-9608-2cbc2412686b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:54.065809 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-a2cb0b95-d323-4214-9608-2cbc2412686b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.260876 Dec 16 15:02:54.066445 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 481/948] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:02:53 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:02:54.234825 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-863ba591-55ae-4d2c-ab00-e5c99af700f5 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:54.244372 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-863ba591-55ae-4d2c-ab00-e5c99af700f5 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1569 microversion: 2.1 time: 0.576424 Dec 16 15:02:54.244975 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 468/949] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:02:53 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1569 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:02:55.091585 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-5781a788-bdbe-46fd-91fd-f1e1b92ca6d4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:02:55.092235 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-5781a788-bdbe-46fd-91fd-f1e1b92ca6d4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:02:55.100339 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5781a788-bdbe-46fd-91fd-f1e1b92ca6d4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:55.100852 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5781a788-bdbe-46fd-91fd-f1e1b92ca6d4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:55.101691 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5781a788-bdbe-46fd-91fd-f1e1b92ca6d4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:55.102261 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5781a788-bdbe-46fd-91fd-f1e1b92ca6d4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:55.266358 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-a706b4d2-760a-493a-a28c-24d0d6fd07e7 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:02:55.267038 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-a706b4d2-760a-493a-a28c-24d0d6fd07e7 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:02:55.275137 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a706b4d2-760a-493a-a28c-24d0d6fd07e7 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:55.275649 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a706b4d2-760a-493a-a28c-24d0d6fd07e7 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:55.276501 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a706b4d2-760a-493a-a28c-24d0d6fd07e7 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:55.277001 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a706b4d2-760a-493a-a28c-24d0d6fd07e7 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:55.318703 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-5781a788-bdbe-46fd-91fd-f1e1b92ca6d4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:55.331628 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-5781a788-bdbe-46fd-91fd-f1e1b92ca6d4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:55.336115 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-5781a788-bdbe-46fd-91fd-f1e1b92ca6d4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:55.337327 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-5781a788-bdbe-46fd-91fd-f1e1b92ca6d4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.254215 Dec 16 15:02:55.338726 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 482/950] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:02:55 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:02:55.499500 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-a706b4d2-760a-493a-a28c-24d0d6fd07e7 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:55.508337 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-a706b4d2-760a-493a-a28c-24d0d6fd07e7 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1569 microversion: 2.1 time: 0.249694 Dec 16 15:02:55.509082 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 469/951] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:02:55 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1569 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:02:56.360493 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-cacb4739-b79c-4f2f-95ad-bb0c5b2bcbf8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:02:56.361152 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-cacb4739-b79c-4f2f-95ad-bb0c5b2bcbf8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:02:56.369720 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cacb4739-b79c-4f2f-95ad-bb0c5b2bcbf8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:56.370201 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cacb4739-b79c-4f2f-95ad-bb0c5b2bcbf8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:56.371033 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cacb4739-b79c-4f2f-95ad-bb0c5b2bcbf8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:56.371525 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cacb4739-b79c-4f2f-95ad-bb0c5b2bcbf8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:56.529847 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-f7ed8611-0432-45db-bf60-916167ce0035 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:02:56.530563 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-f7ed8611-0432-45db-bf60-916167ce0035 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:02:56.538909 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f7ed8611-0432-45db-bf60-916167ce0035 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:56.539424 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f7ed8611-0432-45db-bf60-916167ce0035 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:56.540269 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f7ed8611-0432-45db-bf60-916167ce0035 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:56.540765 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f7ed8611-0432-45db-bf60-916167ce0035 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:56.586060 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-cacb4739-b79c-4f2f-95ad-bb0c5b2bcbf8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:56.599451 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-cacb4739-b79c-4f2f-95ad-bb0c5b2bcbf8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:56.603920 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-cacb4739-b79c-4f2f-95ad-bb0c5b2bcbf8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:56.605110 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-cacb4739-b79c-4f2f-95ad-bb0c5b2bcbf8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.252216 Dec 16 15:02:56.605702 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 483/952] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:02:56 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:02:56.762943 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-f7ed8611-0432-45db-bf60-916167ce0035 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:56.771887 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-f7ed8611-0432-45db-bf60-916167ce0035 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1569 microversion: 2.1 time: 0.249721 Dec 16 15:02:56.772475 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 470/953] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:02:56 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1569 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:02:57.628287 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-4df43038-df99-49ba-9d79-d26341aceae9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:02:57.628959 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-4df43038-df99-49ba-9d79-d26341aceae9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:02:57.637146 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4df43038-df99-49ba-9d79-d26341aceae9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:57.637623 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4df43038-df99-49ba-9d79-d26341aceae9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:57.638483 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4df43038-df99-49ba-9d79-d26341aceae9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:57.638997 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4df43038-df99-49ba-9d79-d26341aceae9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:57.798010 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-e9fd4533-6e24-4578-8577-2fa2d4834ed3 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:02:57.798704 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-e9fd4533-6e24-4578-8577-2fa2d4834ed3 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:02:57.806566 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e9fd4533-6e24-4578-8577-2fa2d4834ed3 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:57.807068 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e9fd4533-6e24-4578-8577-2fa2d4834ed3 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:57.807910 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e9fd4533-6e24-4578-8577-2fa2d4834ed3 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:57.808761 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e9fd4533-6e24-4578-8577-2fa2d4834ed3 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:57.861502 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-4df43038-df99-49ba-9d79-d26341aceae9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:57.874630 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-4df43038-df99-49ba-9d79-d26341aceae9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:57.883239 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-4df43038-df99-49ba-9d79-d26341aceae9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:57.884532 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-4df43038-df99-49ba-9d79-d26341aceae9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.263863 Dec 16 15:02:57.885107 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 484/954] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:02:57 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:02:58.024214 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-e9fd4533-6e24-4578-8577-2fa2d4834ed3 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:58.033087 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-e9fd4533-6e24-4578-8577-2fa2d4834ed3 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1569 microversion: 2.1 time: 0.246969 Dec 16 15:02:58.033675 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 471/955] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:02:57 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1569 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:02:58.908442 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-aa158ef8-4921-4f05-90e2-5e6235b0e3ae tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:02:58.909626 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-aa158ef8-4921-4f05-90e2-5e6235b0e3ae tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:02:58.922151 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-aa158ef8-4921-4f05-90e2-5e6235b0e3ae tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:58.922566 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-aa158ef8-4921-4f05-90e2-5e6235b0e3ae tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:58.923413 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-aa158ef8-4921-4f05-90e2-5e6235b0e3ae tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:58.923907 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-aa158ef8-4921-4f05-90e2-5e6235b0e3ae tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:59.055474 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-8bcbffcf-85f5-4286-964f-83c70028fa38 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:02:59.056288 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-8bcbffcf-85f5-4286-964f-83c70028fa38 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:02:59.064442 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8bcbffcf-85f5-4286-964f-83c70028fa38 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:59.064968 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8bcbffcf-85f5-4286-964f-83c70028fa38 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:59.065832 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8bcbffcf-85f5-4286-964f-83c70028fa38 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:02:59.066839 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8bcbffcf-85f5-4286-964f-83c70028fa38 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:02:59.173502 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-aa158ef8-4921-4f05-90e2-5e6235b0e3ae tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:59.187493 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-aa158ef8-4921-4f05-90e2-5e6235b0e3ae tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:59.192791 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-aa158ef8-4921-4f05-90e2-5e6235b0e3ae tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:59.194138 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-aa158ef8-4921-4f05-90e2-5e6235b0e3ae tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.293608 Dec 16 15:02:59.195038 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 485/956] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:02:58 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:02:59.301059 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-8bcbffcf-85f5-4286-964f-83c70028fa38 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:02:59.310845 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-8bcbffcf-85f5-4286-964f-83c70028fa38 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1569 microversion: 2.1 time: 0.263472 Dec 16 15:02:59.311439 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 472/957] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:02:59 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1569 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:03:00.216948 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-9d8b6856-647a-424f-814e-d49007384831 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:03:00.217599 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-9d8b6856-647a-424f-814e-d49007384831 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:03:00.225360 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9d8b6856-647a-424f-814e-d49007384831 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:00.225857 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9d8b6856-647a-424f-814e-d49007384831 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:00.226703 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9d8b6856-647a-424f-814e-d49007384831 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:00.227183 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9d8b6856-647a-424f-814e-d49007384831 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:00.334134 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-3589fa8e-0da9-4ebc-98d3-8ada57d0d3c0 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:03:00.335141 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-3589fa8e-0da9-4ebc-98d3-8ada57d0d3c0 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:03:00.343187 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3589fa8e-0da9-4ebc-98d3-8ada57d0d3c0 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:00.344011 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3589fa8e-0da9-4ebc-98d3-8ada57d0d3c0 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:00.344686 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3589fa8e-0da9-4ebc-98d3-8ada57d0d3c0 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:00.344985 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3589fa8e-0da9-4ebc-98d3-8ada57d0d3c0 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:00.443721 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-9d8b6856-647a-424f-814e-d49007384831 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:00.456705 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-9d8b6856-647a-424f-814e-d49007384831 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:00.461201 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-9d8b6856-647a-424f-814e-d49007384831 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:00.462419 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-9d8b6856-647a-424f-814e-d49007384831 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.253046 Dec 16 15:03:00.463006 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 486/958] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:03:00 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:03:00.560215 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-3589fa8e-0da9-4ebc-98d3-8ada57d0d3c0 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:00.569759 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-3589fa8e-0da9-4ebc-98d3-8ada57d0d3c0 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1569 microversion: 2.1 time: 0.243278 Dec 16 15:03:00.570403 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 473/959] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:03:00 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1569 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:03:01.485507 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-403db954-7874-4a2a-b1d1-855f04ec01bc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:03:01.486231 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-403db954-7874-4a2a-b1d1-855f04ec01bc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:03:01.494103 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-403db954-7874-4a2a-b1d1-855f04ec01bc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:01.494614 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-403db954-7874-4a2a-b1d1-855f04ec01bc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:01.495451 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-403db954-7874-4a2a-b1d1-855f04ec01bc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:01.495988 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-403db954-7874-4a2a-b1d1-855f04ec01bc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:01.591780 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-821f9b48-88d4-4343-a270-d8031d105411 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:03:01.592499 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-821f9b48-88d4-4343-a270-d8031d105411 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:03:01.601011 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-821f9b48-88d4-4343-a270-d8031d105411 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:01.601527 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-821f9b48-88d4-4343-a270-d8031d105411 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:01.602405 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-821f9b48-88d4-4343-a270-d8031d105411 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:01.602906 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-821f9b48-88d4-4343-a270-d8031d105411 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:01.714119 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-403db954-7874-4a2a-b1d1-855f04ec01bc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:01.728102 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-403db954-7874-4a2a-b1d1-855f04ec01bc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:01.732614 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-403db954-7874-4a2a-b1d1-855f04ec01bc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:01.733805 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-403db954-7874-4a2a-b1d1-855f04ec01bc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.256000 Dec 16 15:03:01.734479 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 487/960] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:03:01 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 15:03:01.819816 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-821f9b48-88d4-4343-a270-d8031d105411 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:01.828857 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-821f9b48-88d4-4343-a270-d8031d105411 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1569 microversion: 2.1 time: 0.244698 Dec 16 15:03:01.829454 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 474/961] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:03:01 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1569 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:03:02.757358 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-4643bd38-4444-4d30-bf60-1f94410b1bcb tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:03:02.757942 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-4643bd38-4444-4d30-bf60-1f94410b1bcb tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:03:02.765662 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4643bd38-4444-4d30-bf60-1f94410b1bcb tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:02.766187 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4643bd38-4444-4d30-bf60-1f94410b1bcb tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:02.767010 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4643bd38-4444-4d30-bf60-1f94410b1bcb tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:02.767492 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4643bd38-4444-4d30-bf60-1f94410b1bcb tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:02.850562 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-99f0ae2c-26f3-4cf7-bdae-e5e884abe180 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:03:02.851339 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-99f0ae2c-26f3-4cf7-bdae-e5e884abe180 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:03:02.859721 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-99f0ae2c-26f3-4cf7-bdae-e5e884abe180 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:02.860239 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-99f0ae2c-26f3-4cf7-bdae-e5e884abe180 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:02.861122 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-99f0ae2c-26f3-4cf7-bdae-e5e884abe180 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:02.861620 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-99f0ae2c-26f3-4cf7-bdae-e5e884abe180 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:02.985749 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-4643bd38-4444-4d30-bf60-1f94410b1bcb tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:02.999040 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-4643bd38-4444-4d30-bf60-1f94410b1bcb tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:03.003572 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-4643bd38-4444-4d30-bf60-1f94410b1bcb tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:03.004818 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-4643bd38-4444-4d30-bf60-1f94410b1bcb tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.255126 Dec 16 15:03:03.005401 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 488/962] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:03:02 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:03:03.076322 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-99f0ae2c-26f3-4cf7-bdae-e5e884abe180 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:03.085191 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-99f0ae2c-26f3-4cf7-bdae-e5e884abe180 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1569 microversion: 2.1 time: 0.242319 Dec 16 15:03:03.085780 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 475/963] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:03:02 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1569 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:03:04.028693 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-7ed2166c-3686-4b7b-9dc4-4239aa75785b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:03:04.029379 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-7ed2166c-3686-4b7b-9dc4-4239aa75785b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:03:04.037651 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7ed2166c-3686-4b7b-9dc4-4239aa75785b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:04.038164 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7ed2166c-3686-4b7b-9dc4-4239aa75785b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:04.039003 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7ed2166c-3686-4b7b-9dc4-4239aa75785b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:04.039496 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7ed2166c-3686-4b7b-9dc4-4239aa75785b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:04.107491 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-bdcb8792-ca50-411e-b006-d5182e37de16 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:03:04.108154 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-bdcb8792-ca50-411e-b006-d5182e37de16 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:03:04.116157 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-bdcb8792-ca50-411e-b006-d5182e37de16 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:04.116661 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-bdcb8792-ca50-411e-b006-d5182e37de16 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:04.117496 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-bdcb8792-ca50-411e-b006-d5182e37de16 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:04.117983 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-bdcb8792-ca50-411e-b006-d5182e37de16 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:04.264267 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-7ed2166c-3686-4b7b-9dc4-4239aa75785b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:04.278428 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-7ed2166c-3686-4b7b-9dc4-4239aa75785b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:04.283896 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-7ed2166c-3686-4b7b-9dc4-4239aa75785b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:04.285680 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-7ed2166c-3686-4b7b-9dc4-4239aa75785b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.264131 Dec 16 15:03:04.286522 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 489/964] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:03:04 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:03:04.339884 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-bdcb8792-ca50-411e-b006-d5182e37de16 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:04.349646 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-bdcb8792-ca50-411e-b006-d5182e37de16 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.249802 Dec 16 15:03:04.350361 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 476/965] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:03:04 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:03:05.308943 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-2dd140c7-2049-4b3f-9183-617e20262b5b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:03:05.309610 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-2dd140c7-2049-4b3f-9183-617e20262b5b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:03:05.318384 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2dd140c7-2049-4b3f-9183-617e20262b5b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:05.318895 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2dd140c7-2049-4b3f-9183-617e20262b5b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:05.319730 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2dd140c7-2049-4b3f-9183-617e20262b5b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:05.320224 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2dd140c7-2049-4b3f-9183-617e20262b5b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:05.372937 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-56a945f8-e46b-49d2-8b65-98383f340562 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:03:05.373819 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-56a945f8-e46b-49d2-8b65-98383f340562 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:03:05.382620 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-56a945f8-e46b-49d2-8b65-98383f340562 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:05.383379 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-56a945f8-e46b-49d2-8b65-98383f340562 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:05.384413 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-56a945f8-e46b-49d2-8b65-98383f340562 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:05.385129 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-56a945f8-e46b-49d2-8b65-98383f340562 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:05.551926 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-2dd140c7-2049-4b3f-9183-617e20262b5b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:05.565704 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-2dd140c7-2049-4b3f-9183-617e20262b5b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:05.570760 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-2dd140c7-2049-4b3f-9183-617e20262b5b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:05.571974 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-2dd140c7-2049-4b3f-9183-617e20262b5b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.270749 Dec 16 15:03:05.572991 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 490/966] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:03:05 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:03:05.612128 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-56a945f8-e46b-49d2-8b65-98383f340562 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:05.621575 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-56a945f8-e46b-49d2-8b65-98383f340562 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.256870 Dec 16 15:03:05.622199 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 477/967] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:03:05 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:03:06.594707 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-ed6cfba4-7213-4362-a925-5b61c6d07519 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:03:06.595380 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-ed6cfba4-7213-4362-a925-5b61c6d07519 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:03:06.603433 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ed6cfba4-7213-4362-a925-5b61c6d07519 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:06.603914 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ed6cfba4-7213-4362-a925-5b61c6d07519 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:06.604761 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ed6cfba4-7213-4362-a925-5b61c6d07519 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:06.605259 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ed6cfba4-7213-4362-a925-5b61c6d07519 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:06.644167 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-2c9638a2-4841-49a7-bd60-b887bcff8183 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:03:06.644853 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-2c9638a2-4841-49a7-bd60-b887bcff8183 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:03:06.653000 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2c9638a2-4841-49a7-bd60-b887bcff8183 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:06.653515 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2c9638a2-4841-49a7-bd60-b887bcff8183 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:06.656009 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2c9638a2-4841-49a7-bd60-b887bcff8183 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:06.656638 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2c9638a2-4841-49a7-bd60-b887bcff8183 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:06.832619 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-ed6cfba4-7213-4362-a925-5b61c6d07519 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:06.845508 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-ed6cfba4-7213-4362-a925-5b61c6d07519 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:06.850673 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-ed6cfba4-7213-4362-a925-5b61c6d07519 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:06.851958 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-ed6cfba4-7213-4362-a925-5b61c6d07519 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.264668 Dec 16 15:03:06.852630 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 491/968] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:03:06 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:03:06.877042 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-2c9638a2-4841-49a7-bd60-b887bcff8183 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:06.885977 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-2c9638a2-4841-49a7-bd60-b887bcff8183 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.250652 Dec 16 15:03:06.886604 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 478/969] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:03:06 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:03:07.875716 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-f5ff2ef2-3008-4442-b664-a309a6e4809b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:03:07.876385 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-f5ff2ef2-3008-4442-b664-a309a6e4809b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:03:07.884207 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f5ff2ef2-3008-4442-b664-a309a6e4809b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:07.884719 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f5ff2ef2-3008-4442-b664-a309a6e4809b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:07.885559 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f5ff2ef2-3008-4442-b664-a309a6e4809b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:07.886075 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f5ff2ef2-3008-4442-b664-a309a6e4809b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:07.907951 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-b697f5d0-e016-4ba8-9ce1-08f28160ed05 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:03:07.908733 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-b697f5d0-e016-4ba8-9ce1-08f28160ed05 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:03:07.917280 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b697f5d0-e016-4ba8-9ce1-08f28160ed05 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:07.917786 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b697f5d0-e016-4ba8-9ce1-08f28160ed05 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:07.918696 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b697f5d0-e016-4ba8-9ce1-08f28160ed05 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:07.919191 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b697f5d0-e016-4ba8-9ce1-08f28160ed05 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:08.121722 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-f5ff2ef2-3008-4442-b664-a309a6e4809b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:08.135510 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-f5ff2ef2-3008-4442-b664-a309a6e4809b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:08.140087 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-f5ff2ef2-3008-4442-b664-a309a6e4809b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:08.141367 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-f5ff2ef2-3008-4442-b664-a309a6e4809b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.273384 Dec 16 15:03:08.141990 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 492/970] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:03:07 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:03:08.158370 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-b697f5d0-e016-4ba8-9ce1-08f28160ed05 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:08.167735 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-b697f5d0-e016-4ba8-9ce1-08f28160ed05 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.267697 Dec 16 15:03:08.168328 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 479/971] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:03:07 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:03:09.165706 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-6222bbff-4a87-47b8-b281-37819e0c005f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:03:09.166317 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-6222bbff-4a87-47b8-b281-37819e0c005f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:03:09.174108 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6222bbff-4a87-47b8-b281-37819e0c005f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:09.174619 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6222bbff-4a87-47b8-b281-37819e0c005f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:09.175445 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6222bbff-4a87-47b8-b281-37819e0c005f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:09.176519 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6222bbff-4a87-47b8-b281-37819e0c005f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:09.190210 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-99a70b1e-13bb-4d6d-afe5-84f9879baaa5 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:03:09.190898 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-99a70b1e-13bb-4d6d-afe5-84f9879baaa5 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:03:09.198959 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-99a70b1e-13bb-4d6d-afe5-84f9879baaa5 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:09.199464 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-99a70b1e-13bb-4d6d-afe5-84f9879baaa5 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:09.200296 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-99a70b1e-13bb-4d6d-afe5-84f9879baaa5 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:09.200808 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-99a70b1e-13bb-4d6d-afe5-84f9879baaa5 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:09.394871 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-6222bbff-4a87-47b8-b281-37819e0c005f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:09.408047 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-6222bbff-4a87-47b8-b281-37819e0c005f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:09.413357 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-6222bbff-4a87-47b8-b281-37819e0c005f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:09.414668 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-6222bbff-4a87-47b8-b281-37819e0c005f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.257000 Dec 16 15:03:09.415264 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 493/972] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:03:09 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:03:09.416258 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-99a70b1e-13bb-4d6d-afe5-84f9879baaa5 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:09.424921 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-99a70b1e-13bb-4d6d-afe5-84f9879baaa5 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.242450 Dec 16 15:03:09.425561 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 480/973] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:03:09 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:03:10.438027 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-cc914d1f-486f-4f5d-9ede-9f7436b798c4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:03:10.438710 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-cc914d1f-486f-4f5d-9ede-9f7436b798c4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:03:10.446796 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cc914d1f-486f-4f5d-9ede-9f7436b798c4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:10.446977 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-c64c6f16-5259-4147-b521-17e063d65303 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:03:10.447297 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cc914d1f-486f-4f5d-9ede-9f7436b798c4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:10.447838 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-c64c6f16-5259-4147-b521-17e063d65303 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:03:10.448398 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cc914d1f-486f-4f5d-9ede-9f7436b798c4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:10.448881 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cc914d1f-486f-4f5d-9ede-9f7436b798c4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:10.455824 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c64c6f16-5259-4147-b521-17e063d65303 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:10.456341 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c64c6f16-5259-4147-b521-17e063d65303 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:10.457191 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c64c6f16-5259-4147-b521-17e063d65303 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:10.457689 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c64c6f16-5259-4147-b521-17e063d65303 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:10.666080 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-cc914d1f-486f-4f5d-9ede-9f7436b798c4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:10.673381 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-c64c6f16-5259-4147-b521-17e063d65303 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:10.679882 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-cc914d1f-486f-4f5d-9ede-9f7436b798c4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:10.682886 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-c64c6f16-5259-4147-b521-17e063d65303 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.244024 Dec 16 15:03:10.683611 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 481/974] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:03:10 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:03:10.684419 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-cc914d1f-486f-4f5d-9ede-9f7436b798c4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:10.685824 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-cc914d1f-486f-4f5d-9ede-9f7436b798c4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.255567 Dec 16 15:03:10.686455 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 494/975] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:03:10 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:03:11.705131 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-52a5d347-5e32-487f-afe9-770e72a950ab tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:03:11.705798 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-52a5d347-5e32-487f-afe9-770e72a950ab tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:03:11.708579 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-53a0ed0a-d62a-4021-a263-24aafd976b3d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:03:11.709248 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-53a0ed0a-d62a-4021-a263-24aafd976b3d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:03:11.713672 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-52a5d347-5e32-487f-afe9-770e72a950ab tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:11.714234 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-52a5d347-5e32-487f-afe9-770e72a950ab tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:11.715083 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-52a5d347-5e32-487f-afe9-770e72a950ab tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:11.715579 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-52a5d347-5e32-487f-afe9-770e72a950ab tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:11.717259 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-53a0ed0a-d62a-4021-a263-24aafd976b3d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:11.717760 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-53a0ed0a-d62a-4021-a263-24aafd976b3d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:11.718662 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-53a0ed0a-d62a-4021-a263-24aafd976b3d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:11.719145 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-53a0ed0a-d62a-4021-a263-24aafd976b3d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:11.935511 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-53a0ed0a-d62a-4021-a263-24aafd976b3d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:11.935679 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-52a5d347-5e32-487f-afe9-770e72a950ab tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:11.945942 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-52a5d347-5e32-487f-afe9-770e72a950ab tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.248730 Dec 16 15:03:11.946763 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 482/976] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:03:11 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:03:11.948965 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-53a0ed0a-d62a-4021-a263-24aafd976b3d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:11.953700 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-53a0ed0a-d62a-4021-a263-24aafd976b3d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:11.954915 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-53a0ed0a-d62a-4021-a263-24aafd976b3d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.253882 Dec 16 15:03:11.955638 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 495/977] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:03:11 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 15:03:12.968184 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-9b824cc0-09ac-4e71-87ca-d6214729df57 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:03:12.968865 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-9b824cc0-09ac-4e71-87ca-d6214729df57 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:03:12.976794 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9b824cc0-09ac-4e71-87ca-d6214729df57 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:12.977313 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9b824cc0-09ac-4e71-87ca-d6214729df57 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:12.977703 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-de5ec1eb-466b-4ba0-b10c-9b6300d5b579 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:03:12.978190 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9b824cc0-09ac-4e71-87ca-d6214729df57 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:12.978444 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-de5ec1eb-466b-4ba0-b10c-9b6300d5b579 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:03:12.978693 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9b824cc0-09ac-4e71-87ca-d6214729df57 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:12.986292 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-de5ec1eb-466b-4ba0-b10c-9b6300d5b579 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:12.986800 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-de5ec1eb-466b-4ba0-b10c-9b6300d5b579 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:12.987641 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-de5ec1eb-466b-4ba0-b10c-9b6300d5b579 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:12.988191 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-de5ec1eb-466b-4ba0-b10c-9b6300d5b579 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:13.198090 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-9b824cc0-09ac-4e71-87ca-d6214729df57 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:13.207273 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-de5ec1eb-466b-4ba0-b10c-9b6300d5b579 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:13.207459 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-9b824cc0-09ac-4e71-87ca-d6214729df57 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.246959 Dec 16 15:03:13.208077 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 483/978] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:03:12 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:03:13.225298 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-de5ec1eb-466b-4ba0-b10c-9b6300d5b579 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:13.237468 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-de5ec1eb-466b-4ba0-b10c-9b6300d5b579 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:13.239794 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-de5ec1eb-466b-4ba0-b10c-9b6300d5b579 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.269851 Dec 16 15:03:13.240916 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 496/979] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:03:12 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:03:14.231799 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-8d5cc2d3-25c9-40a9-85ca-41b2f464b10e tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:03:14.232509 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-8d5cc2d3-25c9-40a9-85ca-41b2f464b10e tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:03:14.240487 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8d5cc2d3-25c9-40a9-85ca-41b2f464b10e tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:14.240994 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8d5cc2d3-25c9-40a9-85ca-41b2f464b10e tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:14.241835 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8d5cc2d3-25c9-40a9-85ca-41b2f464b10e tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:14.242355 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8d5cc2d3-25c9-40a9-85ca-41b2f464b10e tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:14.263818 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-41db82dd-8581-4d3f-95ef-c11e5108c448 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:03:14.264595 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-41db82dd-8581-4d3f-95ef-c11e5108c448 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:03:14.273726 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-41db82dd-8581-4d3f-95ef-c11e5108c448 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:14.274363 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-41db82dd-8581-4d3f-95ef-c11e5108c448 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:14.275286 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-41db82dd-8581-4d3f-95ef-c11e5108c448 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:14.276037 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-41db82dd-8581-4d3f-95ef-c11e5108c448 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:14.501628 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-8d5cc2d3-25c9-40a9-85ca-41b2f464b10e tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:14.510922 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-8d5cc2d3-25c9-40a9-85ca-41b2f464b10e tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.286942 Dec 16 15:03:14.511527 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 484/980] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:03:14 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:03:14.527765 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-41db82dd-8581-4d3f-95ef-c11e5108c448 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:14.542447 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-41db82dd-8581-4d3f-95ef-c11e5108c448 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:14.546871 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-41db82dd-8581-4d3f-95ef-c11e5108c448 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:14.548040 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-41db82dd-8581-4d3f-95ef-c11e5108c448 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.292199 Dec 16 15:03:14.548627 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 497/981] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:03:14 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 15:03:15.536454 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-d2b2af17-b53d-44b0-a51b-2eb19df30249 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:03:15.537128 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-d2b2af17-b53d-44b0-a51b-2eb19df30249 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:03:15.544909 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d2b2af17-b53d-44b0-a51b-2eb19df30249 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:15.545421 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d2b2af17-b53d-44b0-a51b-2eb19df30249 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:15.546294 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d2b2af17-b53d-44b0-a51b-2eb19df30249 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:15.546790 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d2b2af17-b53d-44b0-a51b-2eb19df30249 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:15.573294 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-884150fa-a2ee-46a2-9733-dd6c1175d685 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:03:15.573960 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-884150fa-a2ee-46a2-9733-dd6c1175d685 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:03:15.585065 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-884150fa-a2ee-46a2-9733-dd6c1175d685 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:15.585584 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-884150fa-a2ee-46a2-9733-dd6c1175d685 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:15.586466 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-884150fa-a2ee-46a2-9733-dd6c1175d685 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:15.586966 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-884150fa-a2ee-46a2-9733-dd6c1175d685 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:15.766933 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-d2b2af17-b53d-44b0-a51b-2eb19df30249 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:15.776012 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-d2b2af17-b53d-44b0-a51b-2eb19df30249 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.247087 Dec 16 15:03:15.776573 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 485/982] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:03:15 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:03:15.810696 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-884150fa-a2ee-46a2-9733-dd6c1175d685 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:15.823719 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-884150fa-a2ee-46a2-9733-dd6c1175d685 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:15.828166 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-884150fa-a2ee-46a2-9733-dd6c1175d685 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:15.829345 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-884150fa-a2ee-46a2-9733-dd6c1175d685 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.264640 Dec 16 15:03:15.829938 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 498/983] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:03:15 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 15:03:16.798557 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-a38f1439-ed84-4cf8-a36c-e4e10bcd92df tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:03:16.799278 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-a38f1439-ed84-4cf8-a36c-e4e10bcd92df tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:03:16.807666 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a38f1439-ed84-4cf8-a36c-e4e10bcd92df tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:16.808181 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a38f1439-ed84-4cf8-a36c-e4e10bcd92df tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:16.809028 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a38f1439-ed84-4cf8-a36c-e4e10bcd92df tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:16.809566 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a38f1439-ed84-4cf8-a36c-e4e10bcd92df tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:16.852225 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-07081fad-19e4-4e78-9f3c-a37313d9e013 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:03:16.852889 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-07081fad-19e4-4e78-9f3c-a37313d9e013 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:03:16.860746 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-07081fad-19e4-4e78-9f3c-a37313d9e013 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:16.861253 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-07081fad-19e4-4e78-9f3c-a37313d9e013 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:16.862204 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-07081fad-19e4-4e78-9f3c-a37313d9e013 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:16.862603 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-07081fad-19e4-4e78-9f3c-a37313d9e013 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:17.025995 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-a38f1439-ed84-4cf8-a36c-e4e10bcd92df tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:17.035122 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-a38f1439-ed84-4cf8-a36c-e4e10bcd92df tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.244077 Dec 16 15:03:17.035732 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 486/984] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:03:16 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:03:17.080490 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-07081fad-19e4-4e78-9f3c-a37313d9e013 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:17.093114 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-07081fad-19e4-4e78-9f3c-a37313d9e013 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:17.097564 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-07081fad-19e4-4e78-9f3c-a37313d9e013 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:17.098760 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-07081fad-19e4-4e78-9f3c-a37313d9e013 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.254237 Dec 16 15:03:17.099338 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 499/985] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:03:16 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:03:18.057599 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-28984d3d-efa6-4b41-92b3-e1c53cae00b7 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:03:18.058239 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-28984d3d-efa6-4b41-92b3-e1c53cae00b7 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:03:18.066098 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-28984d3d-efa6-4b41-92b3-e1c53cae00b7 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:18.066618 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-28984d3d-efa6-4b41-92b3-e1c53cae00b7 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:18.067468 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-28984d3d-efa6-4b41-92b3-e1c53cae00b7 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:18.067962 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-28984d3d-efa6-4b41-92b3-e1c53cae00b7 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:18.122513 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-6780c436-1a61-4183-a961-e0265b79a3ac tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:03:18.123173 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-6780c436-1a61-4183-a961-e0265b79a3ac tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:03:18.126943 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c006f2bf-d7e6-4bb8-aace-c3797b4b538d] AMQP server on 10.222.0.45:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 15:03:18.132073 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6780c436-1a61-4183-a961-e0265b79a3ac tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:18.132580 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6780c436-1a61-4183-a961-e0265b79a3ac tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:18.133420 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6780c436-1a61-4183-a961-e0265b79a3ac tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:18.133912 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6780c436-1a61-4183-a961-e0265b79a3ac tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:18.279664 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-28984d3d-efa6-4b41-92b3-e1c53cae00b7 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:18.292508 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-28984d3d-efa6-4b41-92b3-e1c53cae00b7 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.243366 Dec 16 15:03:18.293126 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 487/986] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:03:18 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:03:18.355035 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-6780c436-1a61-4183-a961-e0265b79a3ac tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:18.368140 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-6780c436-1a61-4183-a961-e0265b79a3ac tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:18.372669 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-6780c436-1a61-4183-a961-e0265b79a3ac tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:18.373849 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-6780c436-1a61-4183-a961-e0265b79a3ac tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.259076 Dec 16 15:03:18.374465 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 500/987] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:03:18 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 15:03:19.315057 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-8fd7fbab-ece6-475b-93b3-42518bbe4c16 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:03:19.315732 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-8fd7fbab-ece6-475b-93b3-42518bbe4c16 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:03:19.323864 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8fd7fbab-ece6-475b-93b3-42518bbe4c16 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:19.324374 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8fd7fbab-ece6-475b-93b3-42518bbe4c16 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:19.325209 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8fd7fbab-ece6-475b-93b3-42518bbe4c16 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:19.325704 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8fd7fbab-ece6-475b-93b3-42518bbe4c16 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:19.397460 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-8327323e-22de-4ac6-b631-9d64b7a8bc28 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:03:19.398161 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-8327323e-22de-4ac6-b631-9d64b7a8bc28 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:03:19.417282 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8327323e-22de-4ac6-b631-9d64b7a8bc28 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:19.417792 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8327323e-22de-4ac6-b631-9d64b7a8bc28 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:19.418692 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8327323e-22de-4ac6-b631-9d64b7a8bc28 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:19.419190 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8327323e-22de-4ac6-b631-9d64b7a8bc28 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:19.483677 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO oslo.messaging._drivers.impl_rabbit [-] [c006f2bf-d7e6-4bb8-aace-c3797b4b538d] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 41788. Dec 16 15:03:19.554764 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-8fd7fbab-ece6-475b-93b3-42518bbe4c16 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:19.570655 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-8fd7fbab-ece6-475b-93b3-42518bbe4c16 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.263129 Dec 16 15:03:19.571379 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 488/988] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:03:19 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:03:19.642024 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-8327323e-22de-4ac6-b631-9d64b7a8bc28 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:19.658085 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-8327323e-22de-4ac6-b631-9d64b7a8bc28 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:19.662500 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-8327323e-22de-4ac6-b631-9d64b7a8bc28 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:19.663688 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-8327323e-22de-4ac6-b631-9d64b7a8bc28 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.274694 Dec 16 15:03:19.664274 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 501/989] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:03:19 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:03:20.592450 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-2bc5c286-c6d7-4a8c-aa8e-d7812a1a609b tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:03:20.593162 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-2bc5c286-c6d7-4a8c-aa8e-d7812a1a609b tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:03:20.600981 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2bc5c286-c6d7-4a8c-aa8e-d7812a1a609b tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:20.601480 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2bc5c286-c6d7-4a8c-aa8e-d7812a1a609b tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:20.602334 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2bc5c286-c6d7-4a8c-aa8e-d7812a1a609b tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:20.602822 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2bc5c286-c6d7-4a8c-aa8e-d7812a1a609b tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:20.687933 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-3300db61-ba4f-4fab-a84a-3407284d21c4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:03:20.688546 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-3300db61-ba4f-4fab-a84a-3407284d21c4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:03:20.697175 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3300db61-ba4f-4fab-a84a-3407284d21c4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:20.697935 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3300db61-ba4f-4fab-a84a-3407284d21c4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:20.698799 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3300db61-ba4f-4fab-a84a-3407284d21c4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:20.699289 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3300db61-ba4f-4fab-a84a-3407284d21c4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:20.826353 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-2bc5c286-c6d7-4a8c-aa8e-d7812a1a609b tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:20.838717 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-2bc5c286-c6d7-4a8c-aa8e-d7812a1a609b tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.250830 Dec 16 15:03:20.838717 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 489/990] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:03:20 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:03:20.917072 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-3300db61-ba4f-4fab-a84a-3407284d21c4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:20.931165 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-3300db61-ba4f-4fab-a84a-3407284d21c4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:20.935594 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-3300db61-ba4f-4fab-a84a-3407284d21c4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:20.936772 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-3300db61-ba4f-4fab-a84a-3407284d21c4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.256789 Dec 16 15:03:20.938518 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 502/991] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:03:20 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:03:21.857431 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-819842d0-0da8-4f73-8d28-2484940baf75 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:03:21.858187 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-819842d0-0da8-4f73-8d28-2484940baf75 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:03:21.868862 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-819842d0-0da8-4f73-8d28-2484940baf75 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:21.869375 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-819842d0-0da8-4f73-8d28-2484940baf75 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:21.870284 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-819842d0-0da8-4f73-8d28-2484940baf75 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:21.870786 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-819842d0-0da8-4f73-8d28-2484940baf75 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:21.959560 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-ce6fb5d5-7c1f-4bfd-afdf-fc8a24a882a1 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:03:21.960235 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-ce6fb5d5-7c1f-4bfd-afdf-fc8a24a882a1 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:03:21.968135 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ce6fb5d5-7c1f-4bfd-afdf-fc8a24a882a1 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:21.968641 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ce6fb5d5-7c1f-4bfd-afdf-fc8a24a882a1 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:21.969482 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ce6fb5d5-7c1f-4bfd-afdf-fc8a24a882a1 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:21.969973 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ce6fb5d5-7c1f-4bfd-afdf-fc8a24a882a1 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:22.087013 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-819842d0-0da8-4f73-8d28-2484940baf75 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:22.096696 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-819842d0-0da8-4f73-8d28-2484940baf75 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.246852 Dec 16 15:03:22.107940 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 490/992] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:03:21 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:03:22.399528 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-ce6fb5d5-7c1f-4bfd-afdf-fc8a24a882a1 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:22.412194 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-ce6fb5d5-7c1f-4bfd-afdf-fc8a24a882a1 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:22.416707 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-ce6fb5d5-7c1f-4bfd-afdf-fc8a24a882a1 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:22.417887 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-ce6fb5d5-7c1f-4bfd-afdf-fc8a24a882a1 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.465989 Dec 16 15:03:22.418513 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 503/993] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:03:21 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 15:03:23.118495 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-c79fc5f9-bf1f-4321-99ef-e69b158a6cf0 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:03:23.119205 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-c79fc5f9-bf1f-4321-99ef-e69b158a6cf0 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:03:23.126989 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c79fc5f9-bf1f-4321-99ef-e69b158a6cf0 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:23.127503 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c79fc5f9-bf1f-4321-99ef-e69b158a6cf0 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:23.128340 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c79fc5f9-bf1f-4321-99ef-e69b158a6cf0 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:23.128846 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c79fc5f9-bf1f-4321-99ef-e69b158a6cf0 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:23.364966 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-c79fc5f9-bf1f-4321-99ef-e69b158a6cf0 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:23.374282 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-c79fc5f9-bf1f-4321-99ef-e69b158a6cf0 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.263947 Dec 16 15:03:23.375096 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 491/994] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:03:23 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:03:23.441244 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-5f58af6b-b25b-41d3-bec7-83dbb872036a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:03:23.441903 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-5f58af6b-b25b-41d3-bec7-83dbb872036a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:03:23.449842 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5f58af6b-b25b-41d3-bec7-83dbb872036a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:23.450394 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5f58af6b-b25b-41d3-bec7-83dbb872036a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:23.451210 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5f58af6b-b25b-41d3-bec7-83dbb872036a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:23.451689 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5f58af6b-b25b-41d3-bec7-83dbb872036a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:23.667259 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-5f58af6b-b25b-41d3-bec7-83dbb872036a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:23.684270 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-5f58af6b-b25b-41d3-bec7-83dbb872036a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:23.688822 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-5f58af6b-b25b-41d3-bec7-83dbb872036a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:23.690031 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-5f58af6b-b25b-41d3-bec7-83dbb872036a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.256450 Dec 16 15:03:23.690632 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 504/995] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:03:23 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:03:24.395725 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-ffa3e1d2-856c-4bad-b82e-8e61b84e2104 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:03:24.396390 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-ffa3e1d2-856c-4bad-b82e-8e61b84e2104 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:03:24.404241 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ffa3e1d2-856c-4bad-b82e-8e61b84e2104 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:24.404744 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ffa3e1d2-856c-4bad-b82e-8e61b84e2104 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:24.405581 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ffa3e1d2-856c-4bad-b82e-8e61b84e2104 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:24.406106 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ffa3e1d2-856c-4bad-b82e-8e61b84e2104 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:24.619088 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-ffa3e1d2-856c-4bad-b82e-8e61b84e2104 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:24.627850 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-ffa3e1d2-856c-4bad-b82e-8e61b84e2104 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.239758 Dec 16 15:03:24.628445 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 492/996] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:03:24 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:03:24.720287 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-4bcd7230-4d52-4354-9a0a-6f1c37b83300 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:03:24.720964 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-4bcd7230-4d52-4354-9a0a-6f1c37b83300 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:03:24.729332 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4bcd7230-4d52-4354-9a0a-6f1c37b83300 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:24.729843 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4bcd7230-4d52-4354-9a0a-6f1c37b83300 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:24.730718 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4bcd7230-4d52-4354-9a0a-6f1c37b83300 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:24.731214 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4bcd7230-4d52-4354-9a0a-6f1c37b83300 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:24.941529 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-4bcd7230-4d52-4354-9a0a-6f1c37b83300 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:24.954584 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-4bcd7230-4d52-4354-9a0a-6f1c37b83300 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:24.959093 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-4bcd7230-4d52-4354-9a0a-6f1c37b83300 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:24.960281 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-4bcd7230-4d52-4354-9a0a-6f1c37b83300 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.247747 Dec 16 15:03:24.960865 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 505/997] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:03:24 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:03:25.644399 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c89047bd-5046-4dc5-81a4-5f3a093a9e0b] AMQP server on 10.222.0.45:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 15:03:25.651611 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-7e4a7de4-168e-4408-b2da-8e7342ef8e29 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:03:25.652274 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-7e4a7de4-168e-4408-b2da-8e7342ef8e29 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:03:25.660084 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7e4a7de4-168e-4408-b2da-8e7342ef8e29 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:25.660589 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7e4a7de4-168e-4408-b2da-8e7342ef8e29 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:25.662241 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7e4a7de4-168e-4408-b2da-8e7342ef8e29 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:25.662736 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7e4a7de4-168e-4408-b2da-8e7342ef8e29 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:25.882798 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-7e4a7de4-168e-4408-b2da-8e7342ef8e29 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:25.891585 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-7e4a7de4-168e-4408-b2da-8e7342ef8e29 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.248748 Dec 16 15:03:25.892180 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 493/998] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:03:25 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:03:25.983919 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-0fc2f262-7ac1-418a-b6a3-e6078e647ebf tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:03:25.984512 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-0fc2f262-7ac1-418a-b6a3-e6078e647ebf tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:03:25.992887 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0fc2f262-7ac1-418a-b6a3-e6078e647ebf tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:25.993413 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0fc2f262-7ac1-418a-b6a3-e6078e647ebf tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:25.994313 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0fc2f262-7ac1-418a-b6a3-e6078e647ebf tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:25.994810 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0fc2f262-7ac1-418a-b6a3-e6078e647ebf tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:26.207769 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-0fc2f262-7ac1-418a-b6a3-e6078e647ebf tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:26.220329 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-0fc2f262-7ac1-418a-b6a3-e6078e647ebf tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:26.225417 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-0fc2f262-7ac1-418a-b6a3-e6078e647ebf tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:26.226622 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-0fc2f262-7ac1-418a-b6a3-e6078e647ebf tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.250468 Dec 16 15:03:26.227199 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 506/999] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:03:25 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:03:26.915618 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-923e2c77-ff76-4a13-8f8c-febdf3f06f97 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:03:26.916283 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-923e2c77-ff76-4a13-8f8c-febdf3f06f97 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:03:26.937262 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-923e2c77-ff76-4a13-8f8c-febdf3f06f97 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:26.937774 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-923e2c77-ff76-4a13-8f8c-febdf3f06f97 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:26.938715 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-923e2c77-ff76-4a13-8f8c-febdf3f06f97 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:26.939210 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-923e2c77-ff76-4a13-8f8c-febdf3f06f97 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:27.001686 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO oslo.messaging._drivers.impl_rabbit [-] [c89047bd-5046-4dc5-81a4-5f3a093a9e0b] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 41870. Dec 16 15:03:27.156518 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-923e2c77-ff76-4a13-8f8c-febdf3f06f97 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:27.165862 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-923e2c77-ff76-4a13-8f8c-febdf3f06f97 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.259563 Dec 16 15:03:27.166480 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 494/1000] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:03:26 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:03:27.250055 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-7219f3d5-ee6a-4409-9f73-4668f70b1b69 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:03:27.250746 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-7219f3d5-ee6a-4409-9f73-4668f70b1b69 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:03:27.258602 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7219f3d5-ee6a-4409-9f73-4668f70b1b69 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:27.259109 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7219f3d5-ee6a-4409-9f73-4668f70b1b69 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:27.259943 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7219f3d5-ee6a-4409-9f73-4668f70b1b69 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:27.260432 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7219f3d5-ee6a-4409-9f73-4668f70b1b69 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:27.475814 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-7219f3d5-ee6a-4409-9f73-4668f70b1b69 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:27.488522 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-7219f3d5-ee6a-4409-9f73-4668f70b1b69 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:27.492963 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-7219f3d5-ee6a-4409-9f73-4668f70b1b69 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:27.494187 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-7219f3d5-ee6a-4409-9f73-4668f70b1b69 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.251802 Dec 16 15:03:27.494770 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 507/1001] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:03:27 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:03:28.191873 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-8a9271dc-b67b-4430-8c7e-0d6397af67cd tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:03:28.193203 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-8a9271dc-b67b-4430-8c7e-0d6397af67cd tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:03:28.201625 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8a9271dc-b67b-4430-8c7e-0d6397af67cd tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:28.202167 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8a9271dc-b67b-4430-8c7e-0d6397af67cd tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:28.203021 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8a9271dc-b67b-4430-8c7e-0d6397af67cd tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:28.203519 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8a9271dc-b67b-4430-8c7e-0d6397af67cd tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:28.416681 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-8a9271dc-b67b-4430-8c7e-0d6397af67cd tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:28.425546 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-8a9271dc-b67b-4430-8c7e-0d6397af67cd tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.241508 Dec 16 15:03:28.426161 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 495/1002] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:03:28 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:03:28.516802 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-60e468bc-74a8-4ec0-ad3b-a0aaa39b54f8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:03:28.517474 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-60e468bc-74a8-4ec0-ad3b-a0aaa39b54f8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:03:28.525340 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-60e468bc-74a8-4ec0-ad3b-a0aaa39b54f8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:28.525851 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-60e468bc-74a8-4ec0-ad3b-a0aaa39b54f8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:28.526719 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-60e468bc-74a8-4ec0-ad3b-a0aaa39b54f8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:28.527213 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-60e468bc-74a8-4ec0-ad3b-a0aaa39b54f8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:28.757509 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-60e468bc-74a8-4ec0-ad3b-a0aaa39b54f8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:28.774185 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-60e468bc-74a8-4ec0-ad3b-a0aaa39b54f8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:28.778771 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-60e468bc-74a8-4ec0-ad3b-a0aaa39b54f8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:28.780049 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-60e468bc-74a8-4ec0-ad3b-a0aaa39b54f8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.271116 Dec 16 15:03:28.780744 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 508/1003] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:03:28 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:03:29.448430 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-522fb498-33f9-4f4a-a191-40155e2081ad tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:03:29.449105 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-522fb498-33f9-4f4a-a191-40155e2081ad tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:03:29.457229 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-522fb498-33f9-4f4a-a191-40155e2081ad tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:29.457738 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-522fb498-33f9-4f4a-a191-40155e2081ad tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:29.458610 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-522fb498-33f9-4f4a-a191-40155e2081ad tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:29.459106 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-522fb498-33f9-4f4a-a191-40155e2081ad tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:29.676653 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-522fb498-33f9-4f4a-a191-40155e2081ad tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:29.685554 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-522fb498-33f9-4f4a-a191-40155e2081ad tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.245126 Dec 16 15:03:29.686173 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 496/1004] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:03:29 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:03:29.804133 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-fce727b5-4138-43ff-8902-8dbaf2b2a88e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:03:29.804823 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-fce727b5-4138-43ff-8902-8dbaf2b2a88e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:03:29.812953 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fce727b5-4138-43ff-8902-8dbaf2b2a88e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:29.813471 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fce727b5-4138-43ff-8902-8dbaf2b2a88e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:29.814342 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fce727b5-4138-43ff-8902-8dbaf2b2a88e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:29.814838 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fce727b5-4138-43ff-8902-8dbaf2b2a88e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:30.039183 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-fce727b5-4138-43ff-8902-8dbaf2b2a88e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:30.052550 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-fce727b5-4138-43ff-8902-8dbaf2b2a88e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:30.057026 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-fce727b5-4138-43ff-8902-8dbaf2b2a88e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:30.058217 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-fce727b5-4138-43ff-8902-8dbaf2b2a88e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.261790 Dec 16 15:03:30.058805 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 509/1005] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:03:29 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:03:30.709101 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-bd742d46-c02a-42a1-a0b0-fed44f101b1e tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:03:30.709988 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-bd742d46-c02a-42a1-a0b0-fed44f101b1e tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:03:30.718728 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-bd742d46-c02a-42a1-a0b0-fed44f101b1e tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:30.719244 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-bd742d46-c02a-42a1-a0b0-fed44f101b1e tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:30.720152 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-bd742d46-c02a-42a1-a0b0-fed44f101b1e tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:30.720647 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-bd742d46-c02a-42a1-a0b0-fed44f101b1e tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:30.938449 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-bd742d46-c02a-42a1-a0b0-fed44f101b1e tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:30.948094 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-bd742d46-c02a-42a1-a0b0-fed44f101b1e tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.246678 Dec 16 15:03:30.948980 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 497/1006] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:03:30 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:03:31.080722 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-c74ee626-b2c6-412f-b321-5a1239f5f682 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:03:31.081381 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-c74ee626-b2c6-412f-b321-5a1239f5f682 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:03:31.089157 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c74ee626-b2c6-412f-b321-5a1239f5f682 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:31.089658 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c74ee626-b2c6-412f-b321-5a1239f5f682 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:31.090516 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c74ee626-b2c6-412f-b321-5a1239f5f682 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:31.091005 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c74ee626-b2c6-412f-b321-5a1239f5f682 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:31.307671 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-c74ee626-b2c6-412f-b321-5a1239f5f682 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:31.321061 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-c74ee626-b2c6-412f-b321-5a1239f5f682 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:31.325763 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-c74ee626-b2c6-412f-b321-5a1239f5f682 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:31.327039 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-c74ee626-b2c6-412f-b321-5a1239f5f682 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.253818 Dec 16 15:03:31.327624 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 510/1007] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:03:31 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:03:31.980439 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-5ae10e30-3d9e-421a-a22f-143210d60ce4 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:03:31.981061 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-5ae10e30-3d9e-421a-a22f-143210d60ce4 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:03:31.989824 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5ae10e30-3d9e-421a-a22f-143210d60ce4 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:31.990008 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5ae10e30-3d9e-421a-a22f-143210d60ce4 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:31.990866 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5ae10e30-3d9e-421a-a22f-143210d60ce4 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:31.991370 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5ae10e30-3d9e-421a-a22f-143210d60ce4 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:32.214851 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-5ae10e30-3d9e-421a-a22f-143210d60ce4 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:32.224278 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-5ae10e30-3d9e-421a-a22f-143210d60ce4 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.251586 Dec 16 15:03:32.224864 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 498/1008] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:03:31 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:03:32.350076 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-c06d2d1c-c55d-4715-94f1-48b89bd11821 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:03:32.350746 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-c06d2d1c-c55d-4715-94f1-48b89bd11821 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:03:32.358594 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c06d2d1c-c55d-4715-94f1-48b89bd11821 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:32.359062 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c06d2d1c-c55d-4715-94f1-48b89bd11821 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:32.359893 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c06d2d1c-c55d-4715-94f1-48b89bd11821 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:32.360373 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c06d2d1c-c55d-4715-94f1-48b89bd11821 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:32.574849 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-c06d2d1c-c55d-4715-94f1-48b89bd11821 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:32.587364 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-c06d2d1c-c55d-4715-94f1-48b89bd11821 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:32.591827 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-c06d2d1c-c55d-4715-94f1-48b89bd11821 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:32.593003 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-c06d2d1c-c55d-4715-94f1-48b89bd11821 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.250676 Dec 16 15:03:32.593604 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 511/1009] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:03:32 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:03:33.249796 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-ba76da30-a6c9-4d4a-bf89-6099f0bdab87 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:03:33.250499 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-ba76da30-a6c9-4d4a-bf89-6099f0bdab87 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:03:33.258365 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ba76da30-a6c9-4d4a-bf89-6099f0bdab87 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:33.258878 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ba76da30-a6c9-4d4a-bf89-6099f0bdab87 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:33.259716 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ba76da30-a6c9-4d4a-bf89-6099f0bdab87 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:33.260215 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ba76da30-a6c9-4d4a-bf89-6099f0bdab87 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:33.477825 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-ba76da30-a6c9-4d4a-bf89-6099f0bdab87 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:33.487071 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-ba76da30-a6c9-4d4a-bf89-6099f0bdab87 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.244864 Dec 16 15:03:33.487661 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 499/1010] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:03:33 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:03:33.615432 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-5c3536d4-14d0-46ab-b308-03b426f55ddc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:03:33.616096 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-5c3536d4-14d0-46ab-b308-03b426f55ddc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:03:33.623895 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5c3536d4-14d0-46ab-b308-03b426f55ddc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:33.624394 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5c3536d4-14d0-46ab-b308-03b426f55ddc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:33.625226 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5c3536d4-14d0-46ab-b308-03b426f55ddc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:33.625713 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5c3536d4-14d0-46ab-b308-03b426f55ddc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:33.840627 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-5c3536d4-14d0-46ab-b308-03b426f55ddc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:33.853381 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-5c3536d4-14d0-46ab-b308-03b426f55ddc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:33.857837 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-5c3536d4-14d0-46ab-b308-03b426f55ddc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:33.859044 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-5c3536d4-14d0-46ab-b308-03b426f55ddc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.251189 Dec 16 15:03:33.859635 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 512/1011] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:03:33 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:03:34.509135 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-1b1f4766-d77e-4cf7-b1b1-a49d2faf6dae tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:03:34.509806 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-1b1f4766-d77e-4cf7-b1b1-a49d2faf6dae tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:03:34.517598 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1b1f4766-d77e-4cf7-b1b1-a49d2faf6dae tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:34.518152 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1b1f4766-d77e-4cf7-b1b1-a49d2faf6dae tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:34.518996 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1b1f4766-d77e-4cf7-b1b1-a49d2faf6dae tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:34.519488 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1b1f4766-d77e-4cf7-b1b1-a49d2faf6dae tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:34.737777 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-1b1f4766-d77e-4cf7-b1b1-a49d2faf6dae tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:34.746665 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-1b1f4766-d77e-4cf7-b1b1-a49d2faf6dae tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.245651 Dec 16 15:03:34.747325 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 500/1012] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:03:34 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:03:34.882550 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-c65593fc-cea9-4a97-9fe4-4f5bd5d09658 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:03:34.883207 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-c65593fc-cea9-4a97-9fe4-4f5bd5d09658 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:03:34.891009 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c65593fc-cea9-4a97-9fe4-4f5bd5d09658 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:34.891512 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c65593fc-cea9-4a97-9fe4-4f5bd5d09658 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:34.892345 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c65593fc-cea9-4a97-9fe4-4f5bd5d09658 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:34.892842 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c65593fc-cea9-4a97-9fe4-4f5bd5d09658 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:35.112554 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-c65593fc-cea9-4a97-9fe4-4f5bd5d09658 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:35.125822 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-c65593fc-cea9-4a97-9fe4-4f5bd5d09658 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:35.130964 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-c65593fc-cea9-4a97-9fe4-4f5bd5d09658 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:35.132156 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-c65593fc-cea9-4a97-9fe4-4f5bd5d09658 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.257842 Dec 16 15:03:35.132743 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 513/1013] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:03:34 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:03:35.768835 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-d43b8ea3-c9b9-4adc-8474-00f7a7a5b54b tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:03:35.769551 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-d43b8ea3-c9b9-4adc-8474-00f7a7a5b54b tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:03:35.777951 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d43b8ea3-c9b9-4adc-8474-00f7a7a5b54b tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:35.778490 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d43b8ea3-c9b9-4adc-8474-00f7a7a5b54b tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:35.779338 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d43b8ea3-c9b9-4adc-8474-00f7a7a5b54b tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:35.779835 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d43b8ea3-c9b9-4adc-8474-00f7a7a5b54b tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:36.003986 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-d43b8ea3-c9b9-4adc-8474-00f7a7a5b54b tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:36.013339 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-d43b8ea3-c9b9-4adc-8474-00f7a7a5b54b tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.252318 Dec 16 15:03:36.013928 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 501/1014] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:03:35 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:03:36.155002 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-6be158ae-24f5-4f39-b96f-eff59d56d5f6 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:03:36.155760 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-6be158ae-24f5-4f39-b96f-eff59d56d5f6 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:03:36.164087 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6be158ae-24f5-4f39-b96f-eff59d56d5f6 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:36.164589 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6be158ae-24f5-4f39-b96f-eff59d56d5f6 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:36.165418 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6be158ae-24f5-4f39-b96f-eff59d56d5f6 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:36.165908 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6be158ae-24f5-4f39-b96f-eff59d56d5f6 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:36.382527 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-6be158ae-24f5-4f39-b96f-eff59d56d5f6 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:36.395912 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-6be158ae-24f5-4f39-b96f-eff59d56d5f6 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:36.400336 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-6be158ae-24f5-4f39-b96f-eff59d56d5f6 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:36.401522 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-6be158ae-24f5-4f39-b96f-eff59d56d5f6 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.254188 Dec 16 15:03:36.402127 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 514/1015] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:03:36 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:03:37.036272 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-16eac738-7661-4bec-baf5-444c3b94a35b tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:03:37.036939 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-16eac738-7661-4bec-baf5-444c3b94a35b tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:03:37.045979 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-16eac738-7661-4bec-baf5-444c3b94a35b tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:37.046515 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-16eac738-7661-4bec-baf5-444c3b94a35b tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:37.047357 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-16eac738-7661-4bec-baf5-444c3b94a35b tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:37.047850 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-16eac738-7661-4bec-baf5-444c3b94a35b tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:37.260183 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-16eac738-7661-4bec-baf5-444c3b94a35b tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:37.268915 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-16eac738-7661-4bec-baf5-444c3b94a35b tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.240837 Dec 16 15:03:37.269522 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 502/1016] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:03:37 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:03:37.425529 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-51292710-aa0a-4946-9e44-91527e046e05 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:03:37.426223 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-51292710-aa0a-4946-9e44-91527e046e05 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:03:37.433971 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-51292710-aa0a-4946-9e44-91527e046e05 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:37.434526 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-51292710-aa0a-4946-9e44-91527e046e05 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:37.435352 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-51292710-aa0a-4946-9e44-91527e046e05 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:37.435844 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-51292710-aa0a-4946-9e44-91527e046e05 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:37.650804 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-51292710-aa0a-4946-9e44-91527e046e05 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:37.664430 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-51292710-aa0a-4946-9e44-91527e046e05 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:37.669172 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-51292710-aa0a-4946-9e44-91527e046e05 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:37.670509 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-51292710-aa0a-4946-9e44-91527e046e05 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.252495 Dec 16 15:03:37.671103 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 515/1017] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:03:37 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:03:38.291223 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-5938d4a8-deca-4ab8-9fa3-518598ea80e1 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:03:38.291838 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-5938d4a8-deca-4ab8-9fa3-518598ea80e1 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:03:38.299650 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5938d4a8-deca-4ab8-9fa3-518598ea80e1 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:38.300158 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5938d4a8-deca-4ab8-9fa3-518598ea80e1 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:38.301001 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5938d4a8-deca-4ab8-9fa3-518598ea80e1 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:38.301776 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5938d4a8-deca-4ab8-9fa3-518598ea80e1 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:38.695328 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-bc7869a1-1f1e-490c-a28e-e43255aed183 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:03:38.696180 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-bc7869a1-1f1e-490c-a28e-e43255aed183 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:03:38.704580 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-bc7869a1-1f1e-490c-a28e-e43255aed183 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:38.705187 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-bc7869a1-1f1e-490c-a28e-e43255aed183 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:38.706155 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-bc7869a1-1f1e-490c-a28e-e43255aed183 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:38.706767 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-bc7869a1-1f1e-490c-a28e-e43255aed183 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:38.709602 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-5938d4a8-deca-4ab8-9fa3-518598ea80e1 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:38.719758 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-5938d4a8-deca-4ab8-9fa3-518598ea80e1 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.436293 Dec 16 15:03:38.720556 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 503/1018] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:03:38 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:03:38.926747 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-bc7869a1-1f1e-490c-a28e-e43255aed183 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:38.939844 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-bc7869a1-1f1e-490c-a28e-e43255aed183 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:38.944295 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-bc7869a1-1f1e-490c-a28e-e43255aed183 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:38.945473 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-bc7869a1-1f1e-490c-a28e-e43255aed183 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.259001 Dec 16 15:03:38.946097 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 516/1019] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:03:38 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:03:39.741700 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-6d122e44-d476-4f34-9ec8-2d54701ff4dc tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:03:39.742396 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-6d122e44-d476-4f34-9ec8-2d54701ff4dc tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:03:39.750241 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6d122e44-d476-4f34-9ec8-2d54701ff4dc tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:39.750751 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6d122e44-d476-4f34-9ec8-2d54701ff4dc tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:39.751602 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6d122e44-d476-4f34-9ec8-2d54701ff4dc tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:39.752095 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6d122e44-d476-4f34-9ec8-2d54701ff4dc tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:39.969228 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-4e92bad0-5a05-4d68-b5c2-af3250ac02dc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:03:39.969391 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-6d122e44-d476-4f34-9ec8-2d54701ff4dc tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:39.969891 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-4e92bad0-5a05-4d68-b5c2-af3250ac02dc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:03:39.978341 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4e92bad0-5a05-4d68-b5c2-af3250ac02dc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:39.978844 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4e92bad0-5a05-4d68-b5c2-af3250ac02dc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:39.979255 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-6d122e44-d476-4f34-9ec8-2d54701ff4dc tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.245164 Dec 16 15:03:39.979683 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4e92bad0-5a05-4d68-b5c2-af3250ac02dc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:39.979867 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 504/1020] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:03:39 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:03:39.980190 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4e92bad0-5a05-4d68-b5c2-af3250ac02dc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:40.192103 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-4e92bad0-5a05-4d68-b5c2-af3250ac02dc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:40.204977 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-4e92bad0-5a05-4d68-b5c2-af3250ac02dc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:40.209989 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-4e92bad0-5a05-4d68-b5c2-af3250ac02dc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:40.211186 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-4e92bad0-5a05-4d68-b5c2-af3250ac02dc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.249985 Dec 16 15:03:40.211770 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 517/1021] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:03:39 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:03:41.001794 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-856cbfd6-8fb5-4e16-83e0-0dc428bba63e tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:03:41.002491 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-856cbfd6-8fb5-4e16-83e0-0dc428bba63e tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:03:41.010301 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-856cbfd6-8fb5-4e16-83e0-0dc428bba63e tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:41.010809 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-856cbfd6-8fb5-4e16-83e0-0dc428bba63e tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:41.011644 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-856cbfd6-8fb5-4e16-83e0-0dc428bba63e tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:41.012147 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-856cbfd6-8fb5-4e16-83e0-0dc428bba63e tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:41.231162 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-856cbfd6-8fb5-4e16-83e0-0dc428bba63e tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:41.234059 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-8372f02f-2715-4023-bce1-0bc1b00f1485 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:03:41.234744 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-8372f02f-2715-4023-bce1-0bc1b00f1485 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:03:41.240692 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-856cbfd6-8fb5-4e16-83e0-0dc428bba63e tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.246623 Dec 16 15:03:41.241268 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 505/1022] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:03:40 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:03:41.243361 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8372f02f-2715-4023-bce1-0bc1b00f1485 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:41.243873 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8372f02f-2715-4023-bce1-0bc1b00f1485 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:41.244720 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8372f02f-2715-4023-bce1-0bc1b00f1485 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:41.245245 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8372f02f-2715-4023-bce1-0bc1b00f1485 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:41.467670 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-8372f02f-2715-4023-bce1-0bc1b00f1485 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:41.484080 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-8372f02f-2715-4023-bce1-0bc1b00f1485 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:41.488882 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-8372f02f-2715-4023-bce1-0bc1b00f1485 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:41.490103 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-8372f02f-2715-4023-bce1-0bc1b00f1485 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.263514 Dec 16 15:03:41.490703 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 518/1023] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:03:41 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:03:42.263133 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-e4090e43-7a47-4139-abb7-d93a87f705d9 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:03:42.263810 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-e4090e43-7a47-4139-abb7-d93a87f705d9 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:03:42.272139 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e4090e43-7a47-4139-abb7-d93a87f705d9 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:42.272654 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e4090e43-7a47-4139-abb7-d93a87f705d9 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:42.273493 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e4090e43-7a47-4139-abb7-d93a87f705d9 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:42.273989 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e4090e43-7a47-4139-abb7-d93a87f705d9 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:42.496246 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-e4090e43-7a47-4139-abb7-d93a87f705d9 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:42.505060 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-e4090e43-7a47-4139-abb7-d93a87f705d9 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.249700 Dec 16 15:03:42.505652 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 506/1024] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:03:42 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:03:42.513481 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-45bdd2d2-c8d5-4d47-b16a-4955cd113c7f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:03:42.514234 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-45bdd2d2-c8d5-4d47-b16a-4955cd113c7f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:03:42.522483 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-45bdd2d2-c8d5-4d47-b16a-4955cd113c7f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:42.522993 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-45bdd2d2-c8d5-4d47-b16a-4955cd113c7f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:42.523828 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-45bdd2d2-c8d5-4d47-b16a-4955cd113c7f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:42.524324 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-45bdd2d2-c8d5-4d47-b16a-4955cd113c7f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:42.742354 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-45bdd2d2-c8d5-4d47-b16a-4955cd113c7f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:42.755660 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-45bdd2d2-c8d5-4d47-b16a-4955cd113c7f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:42.760189 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-45bdd2d2-c8d5-4d47-b16a-4955cd113c7f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:42.761391 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-45bdd2d2-c8d5-4d47-b16a-4955cd113c7f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.255847 Dec 16 15:03:42.761973 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 519/1025] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:03:42 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 15:03:43.527191 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-eb57c511-ee94-4f5a-a2c1-599bafb9a919 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:03:43.527800 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-eb57c511-ee94-4f5a-a2c1-599bafb9a919 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:03:43.536338 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-eb57c511-ee94-4f5a-a2c1-599bafb9a919 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:43.536854 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-eb57c511-ee94-4f5a-a2c1-599bafb9a919 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:43.537706 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-eb57c511-ee94-4f5a-a2c1-599bafb9a919 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:43.538233 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-eb57c511-ee94-4f5a-a2c1-599bafb9a919 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:43.758892 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-eb57c511-ee94-4f5a-a2c1-599bafb9a919 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:43.768066 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-eb57c511-ee94-4f5a-a2c1-599bafb9a919 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.249355 Dec 16 15:03:43.768668 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 507/1026] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:03:43 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:03:43.785002 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-31d8d4fa-1f14-40ba-a5c2-244fde3be421 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:03:43.786236 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-31d8d4fa-1f14-40ba-a5c2-244fde3be421 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:03:43.794032 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-31d8d4fa-1f14-40ba-a5c2-244fde3be421 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:43.794572 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-31d8d4fa-1f14-40ba-a5c2-244fde3be421 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:43.795414 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-31d8d4fa-1f14-40ba-a5c2-244fde3be421 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:43.795903 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-31d8d4fa-1f14-40ba-a5c2-244fde3be421 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:43.905141 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 15:03:43.905305 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: Thu Dec 16 15:03:43 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac (ip 10.222.0.45) !!! Dec 16 15:03:44.024214 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-31d8d4fa-1f14-40ba-a5c2-244fde3be421 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:44.037772 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-31d8d4fa-1f14-40ba-a5c2-244fde3be421 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:44.042887 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-31d8d4fa-1f14-40ba-a5c2-244fde3be421 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:44.044087 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-31d8d4fa-1f14-40ba-a5c2-244fde3be421 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.267112 Dec 16 15:03:44.044684 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 520/1027] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:03:43 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:03:44.791476 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-8f4d0fd5-629a-4526-b2a9-7e19f193e4ed tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:03:44.792154 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-8f4d0fd5-629a-4526-b2a9-7e19f193e4ed tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:03:44.800080 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8f4d0fd5-629a-4526-b2a9-7e19f193e4ed tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:44.800592 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8f4d0fd5-629a-4526-b2a9-7e19f193e4ed tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:44.801444 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8f4d0fd5-629a-4526-b2a9-7e19f193e4ed tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:44.801940 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8f4d0fd5-629a-4526-b2a9-7e19f193e4ed tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:45.062339 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-8f4d0fd5-629a-4526-b2a9-7e19f193e4ed tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:45.068430 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-1c274f35-834b-4bef-8c60-679e81fef900 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:03:45.069108 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-1c274f35-834b-4bef-8c60-679e81fef900 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:03:45.074270 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-8f4d0fd5-629a-4526-b2a9-7e19f193e4ed tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.291245 Dec 16 15:03:45.074883 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 508/1028] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:03:44 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:03:45.079922 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1c274f35-834b-4bef-8c60-679e81fef900 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:45.079922 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1c274f35-834b-4bef-8c60-679e81fef900 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:45.081134 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1c274f35-834b-4bef-8c60-679e81fef900 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:45.081695 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1c274f35-834b-4bef-8c60-679e81fef900 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:45.329378 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-1c274f35-834b-4bef-8c60-679e81fef900 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:45.351587 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-1c274f35-834b-4bef-8c60-679e81fef900 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:45.360159 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-1c274f35-834b-4bef-8c60-679e81fef900 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:45.361406 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-1c274f35-834b-4bef-8c60-679e81fef900 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.301338 Dec 16 15:03:45.362329 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 521/1029] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:03:45 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 15:03:46.096884 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-ebc62c42-f43b-4d97-9dc7-fc67342167b9 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:03:46.097560 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-ebc62c42-f43b-4d97-9dc7-fc67342167b9 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:03:46.106266 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ebc62c42-f43b-4d97-9dc7-fc67342167b9 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:46.106804 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ebc62c42-f43b-4d97-9dc7-fc67342167b9 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:46.107623 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ebc62c42-f43b-4d97-9dc7-fc67342167b9 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:46.108113 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ebc62c42-f43b-4d97-9dc7-fc67342167b9 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:46.341620 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-ebc62c42-f43b-4d97-9dc7-fc67342167b9 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:46.351624 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-ebc62c42-f43b-4d97-9dc7-fc67342167b9 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.262610 Dec 16 15:03:46.352216 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 509/1030] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:03:46 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:03:46.388228 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-5bd26b62-3ba1-43d4-8363-93baa71c6787 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:03:46.389000 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-5bd26b62-3ba1-43d4-8363-93baa71c6787 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:03:46.397626 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5bd26b62-3ba1-43d4-8363-93baa71c6787 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:46.398261 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5bd26b62-3ba1-43d4-8363-93baa71c6787 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:46.399191 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5bd26b62-3ba1-43d4-8363-93baa71c6787 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:46.399782 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5bd26b62-3ba1-43d4-8363-93baa71c6787 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:46.623888 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-5bd26b62-3ba1-43d4-8363-93baa71c6787 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:46.637090 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-5bd26b62-3ba1-43d4-8363-93baa71c6787 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:46.641546 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-5bd26b62-3ba1-43d4-8363-93baa71c6787 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:46.642741 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-5bd26b62-3ba1-43d4-8363-93baa71c6787 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.262610 Dec 16 15:03:46.643326 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 522/1031] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:03:46 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:03:47.375163 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-580b8b9e-3036-4d60-9447-39159551d97d tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:03:47.375830 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-580b8b9e-3036-4d60-9447-39159551d97d tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:03:47.383698 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-580b8b9e-3036-4d60-9447-39159551d97d tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:47.384201 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-580b8b9e-3036-4d60-9447-39159551d97d tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:47.385038 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-580b8b9e-3036-4d60-9447-39159551d97d tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:47.385525 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-580b8b9e-3036-4d60-9447-39159551d97d tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:47.600375 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-580b8b9e-3036-4d60-9447-39159551d97d tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:47.609868 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-580b8b9e-3036-4d60-9447-39159551d97d tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.242266 Dec 16 15:03:47.610694 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 510/1032] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:03:47 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:03:47.666747 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-af8d6690-d5eb-4780-a54d-fc042e9e3e11 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:03:47.667409 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-af8d6690-d5eb-4780-a54d-fc042e9e3e11 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:03:47.675224 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-af8d6690-d5eb-4780-a54d-fc042e9e3e11 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:47.676309 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-af8d6690-d5eb-4780-a54d-fc042e9e3e11 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:47.677150 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-af8d6690-d5eb-4780-a54d-fc042e9e3e11 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:47.677621 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-af8d6690-d5eb-4780-a54d-fc042e9e3e11 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:47.893542 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-af8d6690-d5eb-4780-a54d-fc042e9e3e11 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:47.906579 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-af8d6690-d5eb-4780-a54d-fc042e9e3e11 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:47.911551 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-af8d6690-d5eb-4780-a54d-fc042e9e3e11 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:47.912731 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-af8d6690-d5eb-4780-a54d-fc042e9e3e11 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.254238 Dec 16 15:03:47.913309 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 523/1033] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:03:47 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:03:48.632592 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-4fdc1342-881e-4238-b210-1fdb656d4135 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:03:48.633304 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-4fdc1342-881e-4238-b210-1fdb656d4135 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:03:48.641704 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4fdc1342-881e-4238-b210-1fdb656d4135 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:48.642248 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4fdc1342-881e-4238-b210-1fdb656d4135 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:48.643105 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4fdc1342-881e-4238-b210-1fdb656d4135 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:48.643604 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4fdc1342-881e-4238-b210-1fdb656d4135 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:48.866235 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-4fdc1342-881e-4238-b210-1fdb656d4135 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:48.875573 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-4fdc1342-881e-4238-b210-1fdb656d4135 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.251366 Dec 16 15:03:48.876170 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 511/1034] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:03:48 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:03:48.936192 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-e855ac4c-6d22-428c-9ae4-2aeb7e8bc338 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:03:48.936839 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-e855ac4c-6d22-428c-9ae4-2aeb7e8bc338 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:03:48.945790 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e855ac4c-6d22-428c-9ae4-2aeb7e8bc338 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:48.946602 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e855ac4c-6d22-428c-9ae4-2aeb7e8bc338 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:48.948167 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e855ac4c-6d22-428c-9ae4-2aeb7e8bc338 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:48.948934 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e855ac4c-6d22-428c-9ae4-2aeb7e8bc338 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:49.204073 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-e855ac4c-6d22-428c-9ae4-2aeb7e8bc338 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:49.217273 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-e855ac4c-6d22-428c-9ae4-2aeb7e8bc338 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:49.221747 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-e855ac4c-6d22-428c-9ae4-2aeb7e8bc338 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:49.223559 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-e855ac4c-6d22-428c-9ae4-2aeb7e8bc338 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.294388 Dec 16 15:03:49.224146 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 524/1035] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:03:48 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:03:49.897786 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-11ecb678-147b-40b6-85aa-8458e02ffd4a tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:03:49.898496 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-11ecb678-147b-40b6-85aa-8458e02ffd4a tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:03:49.909836 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-11ecb678-147b-40b6-85aa-8458e02ffd4a tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:49.910999 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-11ecb678-147b-40b6-85aa-8458e02ffd4a tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:49.912397 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-11ecb678-147b-40b6-85aa-8458e02ffd4a tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:49.912952 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-11ecb678-147b-40b6-85aa-8458e02ffd4a tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:50.248058 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-25f753e0-7f4a-4bbb-af35-77b428c9802e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:03:50.248805 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-25f753e0-7f4a-4bbb-af35-77b428c9802e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:03:50.258773 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-25f753e0-7f4a-4bbb-af35-77b428c9802e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:50.259319 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-25f753e0-7f4a-4bbb-af35-77b428c9802e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:50.260170 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-25f753e0-7f4a-4bbb-af35-77b428c9802e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:50.260666 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-25f753e0-7f4a-4bbb-af35-77b428c9802e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:50.301844 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-11ecb678-147b-40b6-85aa-8458e02ffd4a tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:50.310835 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-11ecb678-147b-40b6-85aa-8458e02ffd4a tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.421312 Dec 16 15:03:50.311432 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 512/1036] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:03:49 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:03:50.505004 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-25f753e0-7f4a-4bbb-af35-77b428c9802e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:50.517676 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-25f753e0-7f4a-4bbb-af35-77b428c9802e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:50.522771 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-25f753e0-7f4a-4bbb-af35-77b428c9802e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:50.523945 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-25f753e0-7f4a-4bbb-af35-77b428c9802e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.283666 Dec 16 15:03:50.524529 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 525/1037] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:03:50 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 15:03:51.335652 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-9eac1ca9-572a-464d-8e99-94d438bf55e5 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:03:51.336375 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-9eac1ca9-572a-464d-8e99-94d438bf55e5 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:03:51.344360 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9eac1ca9-572a-464d-8e99-94d438bf55e5 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:51.344877 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9eac1ca9-572a-464d-8e99-94d438bf55e5 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:51.345770 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9eac1ca9-572a-464d-8e99-94d438bf55e5 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:51.346294 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9eac1ca9-572a-464d-8e99-94d438bf55e5 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:51.547965 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-27fbca34-581b-45dd-81a3-8e6c1f35eab6 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:03:51.548748 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-27fbca34-581b-45dd-81a3-8e6c1f35eab6 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:03:51.557893 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-27fbca34-581b-45dd-81a3-8e6c1f35eab6 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:51.558535 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-27fbca34-581b-45dd-81a3-8e6c1f35eab6 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:51.559482 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-27fbca34-581b-45dd-81a3-8e6c1f35eab6 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:51.560076 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-27fbca34-581b-45dd-81a3-8e6c1f35eab6 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:51.562302 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-9eac1ca9-572a-464d-8e99-94d438bf55e5 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:51.573213 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-9eac1ca9-572a-464d-8e99-94d438bf55e5 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.245375 Dec 16 15:03:51.575369 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 513/1038] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:03:51 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:03:51.774753 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-27fbca34-581b-45dd-81a3-8e6c1f35eab6 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:51.789792 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-27fbca34-581b-45dd-81a3-8e6c1f35eab6 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:51.794320 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-27fbca34-581b-45dd-81a3-8e6c1f35eab6 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:51.795500 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-27fbca34-581b-45dd-81a3-8e6c1f35eab6 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.255733 Dec 16 15:03:51.796089 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 526/1039] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:03:51 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:03:52.595394 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-769346d8-4400-4b41-80d1-215921e33288 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:03:52.596064 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-769346d8-4400-4b41-80d1-215921e33288 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:03:52.603947 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-769346d8-4400-4b41-80d1-215921e33288 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:52.604452 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-769346d8-4400-4b41-80d1-215921e33288 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:52.605289 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-769346d8-4400-4b41-80d1-215921e33288 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:52.605780 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-769346d8-4400-4b41-80d1-215921e33288 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:52.819637 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-a55572a2-6805-4d5f-85cd-6c9d1e86013b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:03:52.820330 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-a55572a2-6805-4d5f-85cd-6c9d1e86013b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:03:52.820657 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-769346d8-4400-4b41-80d1-215921e33288 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:52.828419 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a55572a2-6805-4d5f-85cd-6c9d1e86013b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:52.828934 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a55572a2-6805-4d5f-85cd-6c9d1e86013b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:52.829782 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a55572a2-6805-4d5f-85cd-6c9d1e86013b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:52.829879 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-769346d8-4400-4b41-80d1-215921e33288 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.242183 Dec 16 15:03:52.830309 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a55572a2-6805-4d5f-85cd-6c9d1e86013b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:52.830434 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 514/1040] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:03:52 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:03:53.040578 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-a55572a2-6805-4d5f-85cd-6c9d1e86013b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:53.053873 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-a55572a2-6805-4d5f-85cd-6c9d1e86013b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:53.058383 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-a55572a2-6805-4d5f-85cd-6c9d1e86013b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:53.059555 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-a55572a2-6805-4d5f-85cd-6c9d1e86013b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.248152 Dec 16 15:03:53.060129 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 527/1041] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:03:52 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 15:03:53.852310 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-6b300987-54d3-4bf2-84b3-c43bce55193a tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:03:53.852975 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-6b300987-54d3-4bf2-84b3-c43bce55193a tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:03:53.860733 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6b300987-54d3-4bf2-84b3-c43bce55193a tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:53.861236 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6b300987-54d3-4bf2-84b3-c43bce55193a tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:53.862080 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6b300987-54d3-4bf2-84b3-c43bce55193a tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:53.862573 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6b300987-54d3-4bf2-84b3-c43bce55193a tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:54.079690 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-6b300987-54d3-4bf2-84b3-c43bce55193a tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:54.083030 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-c8f01e28-25a3-46e6-8bf2-d18f42332339 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:03:54.083702 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-c8f01e28-25a3-46e6-8bf2-d18f42332339 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:03:54.089491 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-6b300987-54d3-4bf2-84b3-c43bce55193a tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.245459 Dec 16 15:03:54.090341 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 515/1042] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:03:53 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:03:54.091625 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c8f01e28-25a3-46e6-8bf2-d18f42332339 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:54.092139 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c8f01e28-25a3-46e6-8bf2-d18f42332339 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:54.092983 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c8f01e28-25a3-46e6-8bf2-d18f42332339 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:54.093474 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c8f01e28-25a3-46e6-8bf2-d18f42332339 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:54.445014 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-c8f01e28-25a3-46e6-8bf2-d18f42332339 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:54.458014 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-c8f01e28-25a3-46e6-8bf2-d18f42332339 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:54.462409 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-c8f01e28-25a3-46e6-8bf2-d18f42332339 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:54.463575 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-c8f01e28-25a3-46e6-8bf2-d18f42332339 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.388664 Dec 16 15:03:54.464154 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 528/1043] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:03:54 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:03:55.111576 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-2b653b80-564f-4c99-a908-f275946bccf2 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:03:55.112163 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-2b653b80-564f-4c99-a908-f275946bccf2 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:03:55.120388 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2b653b80-564f-4c99-a908-f275946bccf2 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:55.120889 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2b653b80-564f-4c99-a908-f275946bccf2 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:55.121714 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2b653b80-564f-4c99-a908-f275946bccf2 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:55.122251 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2b653b80-564f-4c99-a908-f275946bccf2 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:55.334749 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-2b653b80-564f-4c99-a908-f275946bccf2 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:55.344537 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-2b653b80-564f-4c99-a908-f275946bccf2 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.240547 Dec 16 15:03:55.352474 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 516/1044] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:03:55 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:03:55.486780 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-4b6d8de8-26cc-4a0c-9f67-9e1a6ec64ef7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:03:55.487531 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-4b6d8de8-26cc-4a0c-9f67-9e1a6ec64ef7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:03:55.495983 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4b6d8de8-26cc-4a0c-9f67-9e1a6ec64ef7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:55.496521 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4b6d8de8-26cc-4a0c-9f67-9e1a6ec64ef7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:55.497365 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4b6d8de8-26cc-4a0c-9f67-9e1a6ec64ef7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:55.497860 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4b6d8de8-26cc-4a0c-9f67-9e1a6ec64ef7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:55.706128 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-4b6d8de8-26cc-4a0c-9f67-9e1a6ec64ef7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:55.718714 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-4b6d8de8-26cc-4a0c-9f67-9e1a6ec64ef7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:55.723668 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-4b6d8de8-26cc-4a0c-9f67-9e1a6ec64ef7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:55.724838 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-4b6d8de8-26cc-4a0c-9f67-9e1a6ec64ef7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.245744 Dec 16 15:03:55.725423 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 529/1045] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:03:55 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:03:56.372737 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-93a82ba6-6b88-460e-8b48-62d4d0e89a39 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:03:56.374809 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-93a82ba6-6b88-460e-8b48-62d4d0e89a39 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:03:56.389467 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-93a82ba6-6b88-460e-8b48-62d4d0e89a39 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:56.391066 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-93a82ba6-6b88-460e-8b48-62d4d0e89a39 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:56.392117 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-93a82ba6-6b88-460e-8b48-62d4d0e89a39 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:56.392989 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-93a82ba6-6b88-460e-8b48-62d4d0e89a39 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:56.748679 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-e76f70b1-270e-4de0-b2a5-aad017c1ba01 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:03:56.749288 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-e76f70b1-270e-4de0-b2a5-aad017c1ba01 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:03:56.751778 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-93a82ba6-6b88-460e-8b48-62d4d0e89a39 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:56.757985 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e76f70b1-270e-4de0-b2a5-aad017c1ba01 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:56.758524 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e76f70b1-270e-4de0-b2a5-aad017c1ba01 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:56.759376 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e76f70b1-270e-4de0-b2a5-aad017c1ba01 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:56.759865 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e76f70b1-270e-4de0-b2a5-aad017c1ba01 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:56.761280 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-93a82ba6-6b88-460e-8b48-62d4d0e89a39 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.398968 Dec 16 15:03:56.762122 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 517/1046] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:03:56 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:03:56.982835 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-e76f70b1-270e-4de0-b2a5-aad017c1ba01 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:56.995917 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-e76f70b1-270e-4de0-b2a5-aad017c1ba01 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:57.000482 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-e76f70b1-270e-4de0-b2a5-aad017c1ba01 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:57.001605 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-e76f70b1-270e-4de0-b2a5-aad017c1ba01 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.260829 Dec 16 15:03:57.002213 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 530/1047] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:03:56 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:03:57.781926 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-5da432ec-8c74-4c08-8ade-c5ac4fcbdf40 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:03:57.782632 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-5da432ec-8c74-4c08-8ade-c5ac4fcbdf40 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:03:57.791027 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5da432ec-8c74-4c08-8ade-c5ac4fcbdf40 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:57.791538 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5da432ec-8c74-4c08-8ade-c5ac4fcbdf40 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:57.792386 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5da432ec-8c74-4c08-8ade-c5ac4fcbdf40 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:57.792886 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5da432ec-8c74-4c08-8ade-c5ac4fcbdf40 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:58.008289 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-5da432ec-8c74-4c08-8ade-c5ac4fcbdf40 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:58.017264 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-5da432ec-8c74-4c08-8ade-c5ac4fcbdf40 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.242815 Dec 16 15:03:58.018015 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 518/1048] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:03:57 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:03:58.025052 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-eda339d2-368a-4584-b15c-f776f7475242 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:03:58.034208 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-eda339d2-368a-4584-b15c-f776f7475242 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:03:58.034208 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-eda339d2-368a-4584-b15c-f776f7475242 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:58.034208 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-eda339d2-368a-4584-b15c-f776f7475242 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:58.034959 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-eda339d2-368a-4584-b15c-f776f7475242 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:58.035957 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-eda339d2-368a-4584-b15c-f776f7475242 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:58.247778 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-eda339d2-368a-4584-b15c-f776f7475242 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:58.260346 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-eda339d2-368a-4584-b15c-f776f7475242 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:58.264793 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-eda339d2-368a-4584-b15c-f776f7475242 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:58.265959 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-eda339d2-368a-4584-b15c-f776f7475242 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.249005 Dec 16 15:03:58.266571 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 531/1049] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:03:58 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:03:59.039322 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-f6a023fe-41a7-44e7-ba2a-805a8609a33a tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:03:59.039976 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-f6a023fe-41a7-44e7-ba2a-805a8609a33a tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:03:59.047724 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f6a023fe-41a7-44e7-ba2a-805a8609a33a tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:59.048222 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f6a023fe-41a7-44e7-ba2a-805a8609a33a tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:59.049050 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f6a023fe-41a7-44e7-ba2a-805a8609a33a tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:59.049540 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f6a023fe-41a7-44e7-ba2a-805a8609a33a tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:59.260823 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-f6a023fe-41a7-44e7-ba2a-805a8609a33a tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:59.269713 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-f6a023fe-41a7-44e7-ba2a-805a8609a33a tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.237886 Dec 16 15:03:59.270347 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 519/1050] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:03:59 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:03:59.289528 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-80191c3b-7f4b-4063-9990-da485b1a555d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:03:59.290229 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-80191c3b-7f4b-4063-9990-da485b1a555d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:03:59.293291 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 15:03:59.293437 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: Thu Dec 16 15:03:59 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac (ip 10.222.0.45) !!! Dec 16 15:03:59.313050 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-80191c3b-7f4b-4063-9990-da485b1a555d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:59.313558 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-80191c3b-7f4b-4063-9990-da485b1a555d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:59.314432 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-80191c3b-7f4b-4063-9990-da485b1a555d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:03:59.314930 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-80191c3b-7f4b-4063-9990-da485b1a555d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:03:59.534914 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-80191c3b-7f4b-4063-9990-da485b1a555d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:59.547503 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-80191c3b-7f4b-4063-9990-da485b1a555d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:59.552676 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-80191c3b-7f4b-4063-9990-da485b1a555d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:03:59.553858 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-80191c3b-7f4b-4063-9990-da485b1a555d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.272838 Dec 16 15:03:59.554473 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 532/1051] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:03:59 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:04:00.292438 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-84458cca-236d-4dd2-b40e-e338e84c665b tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:04:00.293109 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-84458cca-236d-4dd2-b40e-e338e84c665b tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:04:00.301010 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-84458cca-236d-4dd2-b40e-e338e84c665b tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:00.301519 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-84458cca-236d-4dd2-b40e-e338e84c665b tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:00.302382 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-84458cca-236d-4dd2-b40e-e338e84c665b tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:00.302879 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-84458cca-236d-4dd2-b40e-e338e84c665b tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:00.524167 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-84458cca-236d-4dd2-b40e-e338e84c665b tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:00.532977 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-84458cca-236d-4dd2-b40e-e338e84c665b tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.248992 Dec 16 15:04:00.533571 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 520/1052] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:04:00 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:04:00.577430 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-7a6e2d86-f23c-4bf2-b53b-e3f9013a6fc3 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:04:00.578127 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-7a6e2d86-f23c-4bf2-b53b-e3f9013a6fc3 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:04:00.585950 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7a6e2d86-f23c-4bf2-b53b-e3f9013a6fc3 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:00.586490 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7a6e2d86-f23c-4bf2-b53b-e3f9013a6fc3 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:00.587332 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7a6e2d86-f23c-4bf2-b53b-e3f9013a6fc3 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:00.587827 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7a6e2d86-f23c-4bf2-b53b-e3f9013a6fc3 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:00.812235 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-7a6e2d86-f23c-4bf2-b53b-e3f9013a6fc3 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:00.825131 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-7a6e2d86-f23c-4bf2-b53b-e3f9013a6fc3 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:00.829612 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-7a6e2d86-f23c-4bf2-b53b-e3f9013a6fc3 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:00.830818 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-7a6e2d86-f23c-4bf2-b53b-e3f9013a6fc3 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.261292 Dec 16 15:04:00.831406 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 533/1053] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:04:00 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:04:01.555055 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-369beacc-38ab-4117-a7e4-00d20e28e504 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:04:01.555742 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-369beacc-38ab-4117-a7e4-00d20e28e504 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:04:01.564142 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-369beacc-38ab-4117-a7e4-00d20e28e504 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:01.564661 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-369beacc-38ab-4117-a7e4-00d20e28e504 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:01.565516 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-369beacc-38ab-4117-a7e4-00d20e28e504 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:01.566061 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-369beacc-38ab-4117-a7e4-00d20e28e504 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:01.784385 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-369beacc-38ab-4117-a7e4-00d20e28e504 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:01.793897 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-369beacc-38ab-4117-a7e4-00d20e28e504 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.247170 Dec 16 15:04:01.794555 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 521/1054] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:04:01 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:04:01.854419 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-1e37933a-5f10-48ea-946a-0bf314da07c5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:04:01.855128 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-1e37933a-5f10-48ea-946a-0bf314da07c5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:04:01.863466 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1e37933a-5f10-48ea-946a-0bf314da07c5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:01.863971 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1e37933a-5f10-48ea-946a-0bf314da07c5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:01.864797 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1e37933a-5f10-48ea-946a-0bf314da07c5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:01.865280 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1e37933a-5f10-48ea-946a-0bf314da07c5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:02.077168 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-1e37933a-5f10-48ea-946a-0bf314da07c5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:02.090219 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-1e37933a-5f10-48ea-946a-0bf314da07c5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:02.094712 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-1e37933a-5f10-48ea-946a-0bf314da07c5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:02.095886 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-1e37933a-5f10-48ea-946a-0bf314da07c5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.250000 Dec 16 15:04:02.096458 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 534/1055] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:04:01 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:04:02.815427 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-5e6bea7c-80d0-4133-98b5-1801c7fca65c tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:04:02.816634 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-5e6bea7c-80d0-4133-98b5-1801c7fca65c tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:04:02.824710 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5e6bea7c-80d0-4133-98b5-1801c7fca65c tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:02.825224 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5e6bea7c-80d0-4133-98b5-1801c7fca65c tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:02.826105 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5e6bea7c-80d0-4133-98b5-1801c7fca65c tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:02.826605 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5e6bea7c-80d0-4133-98b5-1801c7fca65c tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:03.038481 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-5e6bea7c-80d0-4133-98b5-1801c7fca65c tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:03.047267 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-5e6bea7c-80d0-4133-98b5-1801c7fca65c tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.239669 Dec 16 15:04:03.047861 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 522/1056] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:04:02 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:04:03.119783 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-82cef24f-421e-426d-9522-6d9d61e4f228 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:04:03.120457 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-82cef24f-421e-426d-9522-6d9d61e4f228 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:04:03.128191 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-82cef24f-421e-426d-9522-6d9d61e4f228 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:03.128704 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-82cef24f-421e-426d-9522-6d9d61e4f228 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:03.129538 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-82cef24f-421e-426d-9522-6d9d61e4f228 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:03.130065 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-82cef24f-421e-426d-9522-6d9d61e4f228 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:03.346231 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-82cef24f-421e-426d-9522-6d9d61e4f228 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:03.360195 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-82cef24f-421e-426d-9522-6d9d61e4f228 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:03.365179 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-82cef24f-421e-426d-9522-6d9d61e4f228 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:03.366392 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-82cef24f-421e-426d-9522-6d9d61e4f228 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.254757 Dec 16 15:04:03.366980 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 535/1057] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:04:03 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:04:04.068861 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-91e0c089-7997-4ef7-8f95-444a88c0f2c4 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:04:04.069542 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-91e0c089-7997-4ef7-8f95-444a88c0f2c4 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:04:04.077496 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-91e0c089-7997-4ef7-8f95-444a88c0f2c4 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:04.078011 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-91e0c089-7997-4ef7-8f95-444a88c0f2c4 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:04.078891 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-91e0c089-7997-4ef7-8f95-444a88c0f2c4 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:04.079388 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-91e0c089-7997-4ef7-8f95-444a88c0f2c4 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:04.299979 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-91e0c089-7997-4ef7-8f95-444a88c0f2c4 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:04.308908 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-91e0c089-7997-4ef7-8f95-444a88c0f2c4 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.247793 Dec 16 15:04:04.309498 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 523/1058] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:04:04 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:04:04.389694 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-43b2de51-2ef2-4a58-bdba-c31f9e72e520 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:04:04.390390 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-43b2de51-2ef2-4a58-bdba-c31f9e72e520 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:04:04.399062 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-43b2de51-2ef2-4a58-bdba-c31f9e72e520 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:04.399570 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-43b2de51-2ef2-4a58-bdba-c31f9e72e520 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:04.400409 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-43b2de51-2ef2-4a58-bdba-c31f9e72e520 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:04.400936 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-43b2de51-2ef2-4a58-bdba-c31f9e72e520 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:04.639196 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-43b2de51-2ef2-4a58-bdba-c31f9e72e520 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:04.652814 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-43b2de51-2ef2-4a58-bdba-c31f9e72e520 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:04.657207 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-43b2de51-2ef2-4a58-bdba-c31f9e72e520 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:04.658389 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-43b2de51-2ef2-4a58-bdba-c31f9e72e520 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.276387 Dec 16 15:04:04.658957 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 536/1059] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:04:04 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:04:05.330963 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-57084bf7-5b66-477d-8924-94c1c0b54e8d tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:04:05.331675 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-57084bf7-5b66-477d-8924-94c1c0b54e8d tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:04:05.339579 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-57084bf7-5b66-477d-8924-94c1c0b54e8d tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:05.340092 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-57084bf7-5b66-477d-8924-94c1c0b54e8d tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:05.340926 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-57084bf7-5b66-477d-8924-94c1c0b54e8d tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:05.341418 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-57084bf7-5b66-477d-8924-94c1c0b54e8d tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:05.556563 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-57084bf7-5b66-477d-8924-94c1c0b54e8d tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:05.565322 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-57084bf7-5b66-477d-8924-94c1c0b54e8d tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.241921 Dec 16 15:04:05.566011 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 524/1060] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:04:05 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:04:05.682981 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-6b1fa475-aa4d-458e-882b-4ae34754628d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:04:05.683642 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-6b1fa475-aa4d-458e-882b-4ae34754628d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:04:05.691898 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6b1fa475-aa4d-458e-882b-4ae34754628d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:05.692392 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6b1fa475-aa4d-458e-882b-4ae34754628d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:05.693212 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6b1fa475-aa4d-458e-882b-4ae34754628d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:05.693696 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6b1fa475-aa4d-458e-882b-4ae34754628d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:05.913320 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-6b1fa475-aa4d-458e-882b-4ae34754628d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:05.926929 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-6b1fa475-aa4d-458e-882b-4ae34754628d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:05.931893 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-6b1fa475-aa4d-458e-882b-4ae34754628d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:05.933067 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-6b1fa475-aa4d-458e-882b-4ae34754628d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.258171 Dec 16 15:04:05.933645 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 537/1061] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:04:05 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:04:06.587975 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-78f50b11-e45b-4acd-8d3f-4e9204824115 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:04:06.588780 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-78f50b11-e45b-4acd-8d3f-4e9204824115 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:04:06.596883 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-78f50b11-e45b-4acd-8d3f-4e9204824115 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:06.597389 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-78f50b11-e45b-4acd-8d3f-4e9204824115 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:06.598271 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-78f50b11-e45b-4acd-8d3f-4e9204824115 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:06.598821 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-78f50b11-e45b-4acd-8d3f-4e9204824115 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:06.821159 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-78f50b11-e45b-4acd-8d3f-4e9204824115 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:06.830336 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-78f50b11-e45b-4acd-8d3f-4e9204824115 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.250001 Dec 16 15:04:06.830931 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 525/1062] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:04:06 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:04:06.956667 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-742551e1-5ba8-4b2a-96f6-43c4e1390e80 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:04:06.957341 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-742551e1-5ba8-4b2a-96f6-43c4e1390e80 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:04:06.965720 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-742551e1-5ba8-4b2a-96f6-43c4e1390e80 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:06.966285 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-742551e1-5ba8-4b2a-96f6-43c4e1390e80 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:06.967157 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-742551e1-5ba8-4b2a-96f6-43c4e1390e80 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:06.967652 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-742551e1-5ba8-4b2a-96f6-43c4e1390e80 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:07.187389 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-742551e1-5ba8-4b2a-96f6-43c4e1390e80 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:07.201076 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-742551e1-5ba8-4b2a-96f6-43c4e1390e80 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:07.205491 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-742551e1-5ba8-4b2a-96f6-43c4e1390e80 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:07.206711 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-742551e1-5ba8-4b2a-96f6-43c4e1390e80 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.258080 Dec 16 15:04:07.207286 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 538/1063] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:04:06 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:04:07.851796 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-39e0b61d-76de-426b-b522-e6edffd44e40 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:04:07.852468 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-39e0b61d-76de-426b-b522-e6edffd44e40 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:04:07.860264 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-39e0b61d-76de-426b-b522-e6edffd44e40 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:07.860774 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-39e0b61d-76de-426b-b522-e6edffd44e40 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:07.861614 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-39e0b61d-76de-426b-b522-e6edffd44e40 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:07.862134 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-39e0b61d-76de-426b-b522-e6edffd44e40 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:08.086146 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-39e0b61d-76de-426b-b522-e6edffd44e40 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:08.094969 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-39e0b61d-76de-426b-b522-e6edffd44e40 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.250843 Dec 16 15:04:08.095567 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 526/1064] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:04:07 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:04:08.229717 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-c959eebe-e7e2-4cd2-94c5-3af9047904c5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:04:08.230422 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-c959eebe-e7e2-4cd2-94c5-3af9047904c5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:04:08.238868 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c959eebe-e7e2-4cd2-94c5-3af9047904c5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:08.239379 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c959eebe-e7e2-4cd2-94c5-3af9047904c5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:08.240224 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c959eebe-e7e2-4cd2-94c5-3af9047904c5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:08.240760 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c959eebe-e7e2-4cd2-94c5-3af9047904c5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:08.456521 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-c959eebe-e7e2-4cd2-94c5-3af9047904c5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:08.471492 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-c959eebe-e7e2-4cd2-94c5-3af9047904c5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:08.476603 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-c959eebe-e7e2-4cd2-94c5-3af9047904c5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:08.477572 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-c959eebe-e7e2-4cd2-94c5-3af9047904c5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.256212 Dec 16 15:04:08.478180 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 539/1065] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:04:08 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:04:09.117484 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-dc1c9f3c-4e3d-4dca-ac43-581844f03494 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:04:09.118198 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-dc1c9f3c-4e3d-4dca-ac43-581844f03494 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:04:09.126220 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-dc1c9f3c-4e3d-4dca-ac43-581844f03494 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:09.126717 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-dc1c9f3c-4e3d-4dca-ac43-581844f03494 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:09.127546 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-dc1c9f3c-4e3d-4dca-ac43-581844f03494 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:09.128033 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-dc1c9f3c-4e3d-4dca-ac43-581844f03494 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:09.344727 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-dc1c9f3c-4e3d-4dca-ac43-581844f03494 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:09.354158 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-dc1c9f3c-4e3d-4dca-ac43-581844f03494 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.245031 Dec 16 15:04:09.354755 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 527/1066] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:04:09 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:04:09.501419 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-1965ff89-affd-4f80-8325-cfb588bdafdb tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:04:09.502169 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-1965ff89-affd-4f80-8325-cfb588bdafdb tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:04:09.509919 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1965ff89-affd-4f80-8325-cfb588bdafdb tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:09.510461 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1965ff89-affd-4f80-8325-cfb588bdafdb tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:09.511342 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1965ff89-affd-4f80-8325-cfb588bdafdb tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:09.511839 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1965ff89-affd-4f80-8325-cfb588bdafdb tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:09.733955 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-1965ff89-affd-4f80-8325-cfb588bdafdb tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:09.746552 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-1965ff89-affd-4f80-8325-cfb588bdafdb tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:09.751007 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-1965ff89-affd-4f80-8325-cfb588bdafdb tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:09.752170 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-1965ff89-affd-4f80-8325-cfb588bdafdb tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.258551 Dec 16 15:04:09.752756 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 540/1067] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:04:09 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:04:10.376310 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-a6ed7f28-15a6-4ff4-8990-7d00f4279d54 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:04:10.376983 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-a6ed7f28-15a6-4ff4-8990-7d00f4279d54 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:04:10.385515 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a6ed7f28-15a6-4ff4-8990-7d00f4279d54 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:10.386033 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a6ed7f28-15a6-4ff4-8990-7d00f4279d54 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:10.386926 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a6ed7f28-15a6-4ff4-8990-7d00f4279d54 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:10.387727 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a6ed7f28-15a6-4ff4-8990-7d00f4279d54 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:10.611812 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-a6ed7f28-15a6-4ff4-8990-7d00f4279d54 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:10.621651 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-a6ed7f28-15a6-4ff4-8990-7d00f4279d54 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.252997 Dec 16 15:04:10.622310 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 528/1068] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:04:10 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:04:10.776451 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-7d629a41-6e43-4ef3-85c3-6e96eb844c37 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:04:10.777120 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-7d629a41-6e43-4ef3-85c3-6e96eb844c37 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:04:10.785632 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7d629a41-6e43-4ef3-85c3-6e96eb844c37 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:10.786163 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7d629a41-6e43-4ef3-85c3-6e96eb844c37 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:10.786994 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7d629a41-6e43-4ef3-85c3-6e96eb844c37 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:10.787492 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7d629a41-6e43-4ef3-85c3-6e96eb844c37 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:11.005299 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-7d629a41-6e43-4ef3-85c3-6e96eb844c37 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:11.018169 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-7d629a41-6e43-4ef3-85c3-6e96eb844c37 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:11.023137 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-7d629a41-6e43-4ef3-85c3-6e96eb844c37 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:11.024304 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-7d629a41-6e43-4ef3-85c3-6e96eb844c37 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.256239 Dec 16 15:04:11.024884 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 541/1069] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:04:10 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:04:11.643264 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-34edabb8-3a32-4c7c-9599-54dcdf4c555a tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:04:11.644072 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-34edabb8-3a32-4c7c-9599-54dcdf4c555a tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:04:11.651903 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-34edabb8-3a32-4c7c-9599-54dcdf4c555a tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:11.652433 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-34edabb8-3a32-4c7c-9599-54dcdf4c555a tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:11.653263 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-34edabb8-3a32-4c7c-9599-54dcdf4c555a tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:11.653761 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-34edabb8-3a32-4c7c-9599-54dcdf4c555a tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:11.872567 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-34edabb8-3a32-4c7c-9599-54dcdf4c555a tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:11.883379 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-34edabb8-3a32-4c7c-9599-54dcdf4c555a tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.247768 Dec 16 15:04:11.884435 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 529/1070] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:04:11 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:04:12.048078 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-b0e9ae52-81ce-4b19-ba78-d9068bed7b0b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:04:12.048789 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-b0e9ae52-81ce-4b19-ba78-d9068bed7b0b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:04:12.057105 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b0e9ae52-81ce-4b19-ba78-d9068bed7b0b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:12.057614 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b0e9ae52-81ce-4b19-ba78-d9068bed7b0b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:12.058513 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b0e9ae52-81ce-4b19-ba78-d9068bed7b0b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:12.059011 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b0e9ae52-81ce-4b19-ba78-d9068bed7b0b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:12.282686 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-b0e9ae52-81ce-4b19-ba78-d9068bed7b0b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:12.296019 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-b0e9ae52-81ce-4b19-ba78-d9068bed7b0b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:12.300576 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-b0e9ae52-81ce-4b19-ba78-d9068bed7b0b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:12.301758 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-b0e9ae52-81ce-4b19-ba78-d9068bed7b0b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.261491 Dec 16 15:04:12.302376 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 542/1071] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:04:12 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:04:12.904955 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-91f23966-618c-46ba-b17c-cbea1ec046d6 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:04:12.905648 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-91f23966-618c-46ba-b17c-cbea1ec046d6 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:04:12.913927 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-91f23966-618c-46ba-b17c-cbea1ec046d6 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:12.914457 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-91f23966-618c-46ba-b17c-cbea1ec046d6 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:12.915292 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-91f23966-618c-46ba-b17c-cbea1ec046d6 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:12.915781 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-91f23966-618c-46ba-b17c-cbea1ec046d6 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:13.132290 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-91f23966-618c-46ba-b17c-cbea1ec046d6 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:13.141110 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-91f23966-618c-46ba-b17c-cbea1ec046d6 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.243639 Dec 16 15:04:13.141704 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 530/1072] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:04:12 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:04:13.324754 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-6d947daf-1b80-4186-b3e2-5edfcd770ae9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:04:13.325425 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-6d947daf-1b80-4186-b3e2-5edfcd770ae9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:04:13.333794 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6d947daf-1b80-4186-b3e2-5edfcd770ae9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:13.334326 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6d947daf-1b80-4186-b3e2-5edfcd770ae9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:13.335159 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6d947daf-1b80-4186-b3e2-5edfcd770ae9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:13.335652 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6d947daf-1b80-4186-b3e2-5edfcd770ae9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:13.547076 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-6d947daf-1b80-4186-b3e2-5edfcd770ae9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:13.560477 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-6d947daf-1b80-4186-b3e2-5edfcd770ae9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:13.564995 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-6d947daf-1b80-4186-b3e2-5edfcd770ae9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:13.566225 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-6d947daf-1b80-4186-b3e2-5edfcd770ae9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.249317 Dec 16 15:04:13.566809 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 543/1073] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:04:13 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:04:14.163690 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-611ef478-e780-4ba6-b2b9-763441145b40 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:04:14.164128 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-611ef478-e780-4ba6-b2b9-763441145b40 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:04:14.171921 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-611ef478-e780-4ba6-b2b9-763441145b40 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:14.172418 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-611ef478-e780-4ba6-b2b9-763441145b40 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:14.173245 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-611ef478-e780-4ba6-b2b9-763441145b40 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:14.173732 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-611ef478-e780-4ba6-b2b9-763441145b40 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:14.388947 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-611ef478-e780-4ba6-b2b9-763441145b40 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:14.398485 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-611ef478-e780-4ba6-b2b9-763441145b40 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.242587 Dec 16 15:04:14.399089 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 531/1074] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:04:14 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:04:14.589515 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-00617aa2-dede-462f-8569-77c8f499f03c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:04:14.590212 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-00617aa2-dede-462f-8569-77c8f499f03c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:04:14.600323 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-00617aa2-dede-462f-8569-77c8f499f03c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:14.600831 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-00617aa2-dede-462f-8569-77c8f499f03c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:14.601675 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-00617aa2-dede-462f-8569-77c8f499f03c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:14.602194 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-00617aa2-dede-462f-8569-77c8f499f03c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:14.826347 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-00617aa2-dede-462f-8569-77c8f499f03c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:14.839206 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-00617aa2-dede-462f-8569-77c8f499f03c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:14.843694 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-00617aa2-dede-462f-8569-77c8f499f03c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:14.844817 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-00617aa2-dede-462f-8569-77c8f499f03c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.263079 Dec 16 15:04:14.845393 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 544/1075] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:04:14 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:04:15.420499 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-68b945f7-04df-4d67-a7ce-ee446edb9733 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:04:15.421186 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-68b945f7-04df-4d67-a7ce-ee446edb9733 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:04:15.429072 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-68b945f7-04df-4d67-a7ce-ee446edb9733 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:15.429583 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-68b945f7-04df-4d67-a7ce-ee446edb9733 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:15.430460 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-68b945f7-04df-4d67-a7ce-ee446edb9733 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:15.430959 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-68b945f7-04df-4d67-a7ce-ee446edb9733 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:15.658339 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-68b945f7-04df-4d67-a7ce-ee446edb9733 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:15.668791 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-68b945f7-04df-4d67-a7ce-ee446edb9733 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.255861 Dec 16 15:04:15.669354 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 532/1076] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:04:15 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:04:15.868621 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-8bf78bf7-ee36-4626-be95-69a25290ff65 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:04:15.869288 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-8bf78bf7-ee36-4626-be95-69a25290ff65 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:04:15.877018 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8bf78bf7-ee36-4626-be95-69a25290ff65 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:15.877524 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8bf78bf7-ee36-4626-be95-69a25290ff65 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:15.878428 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8bf78bf7-ee36-4626-be95-69a25290ff65 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:15.878920 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8bf78bf7-ee36-4626-be95-69a25290ff65 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:16.114106 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-8bf78bf7-ee36-4626-be95-69a25290ff65 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:16.127255 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-8bf78bf7-ee36-4626-be95-69a25290ff65 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:16.131698 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-8bf78bf7-ee36-4626-be95-69a25290ff65 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:16.132872 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-8bf78bf7-ee36-4626-be95-69a25290ff65 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.272572 Dec 16 15:04:16.133456 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 545/1077] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:04:15 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:04:16.690889 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-019dea0f-25c7-4ee3-acb0-0319a0d53d3b tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:04:16.691497 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-019dea0f-25c7-4ee3-acb0-0319a0d53d3b tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:04:16.699587 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-019dea0f-25c7-4ee3-acb0-0319a0d53d3b tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:16.700087 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-019dea0f-25c7-4ee3-acb0-0319a0d53d3b tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:16.700918 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-019dea0f-25c7-4ee3-acb0-0319a0d53d3b tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:16.701410 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-019dea0f-25c7-4ee3-acb0-0319a0d53d3b tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:16.922679 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-019dea0f-25c7-4ee3-acb0-0319a0d53d3b tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:16.931768 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-019dea0f-25c7-4ee3-acb0-0319a0d53d3b tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.248663 Dec 16 15:04:16.932395 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 533/1078] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:04:16 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:04:17.155937 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-a59598a8-b2f2-4750-aeb2-6ab560bebb1c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:04:17.156599 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-a59598a8-b2f2-4750-aeb2-6ab560bebb1c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:04:17.164876 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a59598a8-b2f2-4750-aeb2-6ab560bebb1c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:17.165382 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a59598a8-b2f2-4750-aeb2-6ab560bebb1c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:17.166249 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a59598a8-b2f2-4750-aeb2-6ab560bebb1c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:17.166737 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a59598a8-b2f2-4750-aeb2-6ab560bebb1c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:17.387562 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-a59598a8-b2f2-4750-aeb2-6ab560bebb1c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:17.400517 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-a59598a8-b2f2-4750-aeb2-6ab560bebb1c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:17.404976 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-a59598a8-b2f2-4750-aeb2-6ab560bebb1c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:17.406182 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-a59598a8-b2f2-4750-aeb2-6ab560bebb1c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.257779 Dec 16 15:04:17.406766 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 546/1079] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:04:17 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:04:17.954017 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-f834bd35-8530-4828-9595-beff357fd1c4 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:04:17.954712 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-f834bd35-8530-4828-9595-beff357fd1c4 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:04:17.963126 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f834bd35-8530-4828-9595-beff357fd1c4 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:17.963637 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f834bd35-8530-4828-9595-beff357fd1c4 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:17.964472 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f834bd35-8530-4828-9595-beff357fd1c4 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:17.964963 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f834bd35-8530-4828-9595-beff357fd1c4 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:18.179211 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-f834bd35-8530-4828-9595-beff357fd1c4 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:18.188028 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-f834bd35-8530-4828-9595-beff357fd1c4 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.241858 Dec 16 15:04:18.188607 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 534/1080] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:04:17 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:04:18.429700 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-684422c8-fc2d-4d40-bef3-332033bf4877 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:04:18.430422 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-684422c8-fc2d-4d40-bef3-332033bf4877 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:04:18.438510 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-684422c8-fc2d-4d40-bef3-332033bf4877 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:18.439016 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-684422c8-fc2d-4d40-bef3-332033bf4877 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:18.439847 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-684422c8-fc2d-4d40-bef3-332033bf4877 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:18.440336 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-684422c8-fc2d-4d40-bef3-332033bf4877 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:18.653299 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-684422c8-fc2d-4d40-bef3-332033bf4877 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:18.666057 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-684422c8-fc2d-4d40-bef3-332033bf4877 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:18.670558 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-684422c8-fc2d-4d40-bef3-332033bf4877 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:18.671749 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-684422c8-fc2d-4d40-bef3-332033bf4877 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.249604 Dec 16 15:04:18.672434 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 547/1081] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:04:18 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:04:19.210474 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-2d30a5b6-d216-4a37-be00-2e328896c332 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:04:19.211151 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-2d30a5b6-d216-4a37-be00-2e328896c332 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:04:19.218981 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2d30a5b6-d216-4a37-be00-2e328896c332 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:19.219489 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2d30a5b6-d216-4a37-be00-2e328896c332 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:19.220328 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2d30a5b6-d216-4a37-be00-2e328896c332 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:19.220819 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2d30a5b6-d216-4a37-be00-2e328896c332 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:19.443049 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-2d30a5b6-d216-4a37-be00-2e328896c332 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:19.452471 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-2d30a5b6-d216-4a37-be00-2e328896c332 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.250073 Dec 16 15:04:19.453288 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 535/1082] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:04:19 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:04:19.695520 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-354870cb-4de8-463a-b82e-061e95e9aa0b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:04:19.696114 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-354870cb-4de8-463a-b82e-061e95e9aa0b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:04:19.704373 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-354870cb-4de8-463a-b82e-061e95e9aa0b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:19.704880 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-354870cb-4de8-463a-b82e-061e95e9aa0b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:19.705709 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-354870cb-4de8-463a-b82e-061e95e9aa0b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:19.706230 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-354870cb-4de8-463a-b82e-061e95e9aa0b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:19.922336 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-354870cb-4de8-463a-b82e-061e95e9aa0b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:19.935969 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-354870cb-4de8-463a-b82e-061e95e9aa0b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:19.940985 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-354870cb-4de8-463a-b82e-061e95e9aa0b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:19.942302 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-354870cb-4de8-463a-b82e-061e95e9aa0b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.254494 Dec 16 15:04:19.942896 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 548/1083] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:04:19 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:04:20.474872 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-bf91a70f-407c-40e2-959c-8c1fa0a7b5c7 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:04:20.475643 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-bf91a70f-407c-40e2-959c-8c1fa0a7b5c7 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:04:20.483459 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-bf91a70f-407c-40e2-959c-8c1fa0a7b5c7 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:20.483971 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-bf91a70f-407c-40e2-959c-8c1fa0a7b5c7 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:20.484818 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-bf91a70f-407c-40e2-959c-8c1fa0a7b5c7 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:20.485314 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-bf91a70f-407c-40e2-959c-8c1fa0a7b5c7 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:20.698568 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-bf91a70f-407c-40e2-959c-8c1fa0a7b5c7 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:20.707310 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-bf91a70f-407c-40e2-959c-8c1fa0a7b5c7 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.239938 Dec 16 15:04:20.707903 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 536/1084] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:04:20 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:04:20.966553 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-905e147f-0fa8-4545-bb25-0c3bad7b2792 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:04:20.967212 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-905e147f-0fa8-4545-bb25-0c3bad7b2792 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:04:20.975496 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-905e147f-0fa8-4545-bb25-0c3bad7b2792 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:20.975991 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-905e147f-0fa8-4545-bb25-0c3bad7b2792 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:20.976813 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-905e147f-0fa8-4545-bb25-0c3bad7b2792 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:20.977297 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-905e147f-0fa8-4545-bb25-0c3bad7b2792 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:21.190004 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-905e147f-0fa8-4545-bb25-0c3bad7b2792 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:21.202917 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-905e147f-0fa8-4545-bb25-0c3bad7b2792 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:21.207406 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-905e147f-0fa8-4545-bb25-0c3bad7b2792 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:21.208570 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-905e147f-0fa8-4545-bb25-0c3bad7b2792 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.249915 Dec 16 15:04:21.209152 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 549/1085] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:04:20 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:04:21.728470 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-31e0912c-7a66-41ff-9e1c-24ef9001fc46 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:04:21.729144 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-31e0912c-7a66-41ff-9e1c-24ef9001fc46 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:04:21.737013 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-31e0912c-7a66-41ff-9e1c-24ef9001fc46 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:21.738131 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-31e0912c-7a66-41ff-9e1c-24ef9001fc46 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:21.738976 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-31e0912c-7a66-41ff-9e1c-24ef9001fc46 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:21.739472 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-31e0912c-7a66-41ff-9e1c-24ef9001fc46 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:21.953260 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-31e0912c-7a66-41ff-9e1c-24ef9001fc46 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:21.962159 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-31e0912c-7a66-41ff-9e1c-24ef9001fc46 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.241746 Dec 16 15:04:21.962755 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 537/1086] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:04:21 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:04:22.231898 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-32d019eb-6e6d-4370-9570-d37aa8d3c8b8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:04:22.232559 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-32d019eb-6e6d-4370-9570-d37aa8d3c8b8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:04:22.240622 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-32d019eb-6e6d-4370-9570-d37aa8d3c8b8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:22.241137 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-32d019eb-6e6d-4370-9570-d37aa8d3c8b8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:22.241978 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-32d019eb-6e6d-4370-9570-d37aa8d3c8b8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:22.242504 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-32d019eb-6e6d-4370-9570-d37aa8d3c8b8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:22.463649 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-32d019eb-6e6d-4370-9570-d37aa8d3c8b8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:22.476861 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-32d019eb-6e6d-4370-9570-d37aa8d3c8b8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:22.481353 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-32d019eb-6e6d-4370-9570-d37aa8d3c8b8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:22.482565 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-32d019eb-6e6d-4370-9570-d37aa8d3c8b8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.258225 Dec 16 15:04:22.483139 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 550/1087] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:04:22 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:04:22.983724 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-3dd94bff-8a47-4438-9ac8-cfa9bfd1db63 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:04:22.984334 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-3dd94bff-8a47-4438-9ac8-cfa9bfd1db63 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:04:22.992676 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3dd94bff-8a47-4438-9ac8-cfa9bfd1db63 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:22.993192 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3dd94bff-8a47-4438-9ac8-cfa9bfd1db63 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:22.994060 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3dd94bff-8a47-4438-9ac8-cfa9bfd1db63 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:22.994555 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3dd94bff-8a47-4438-9ac8-cfa9bfd1db63 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:23.208730 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-3dd94bff-8a47-4438-9ac8-cfa9bfd1db63 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:23.217591 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-3dd94bff-8a47-4438-9ac8-cfa9bfd1db63 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.241675 Dec 16 15:04:23.218196 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 538/1088] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:04:22 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:04:23.505462 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-60aefbfa-8192-4247-85d8-e7817ecb69b1 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:04:23.506157 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-60aefbfa-8192-4247-85d8-e7817ecb69b1 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:04:23.514004 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-60aefbfa-8192-4247-85d8-e7817ecb69b1 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:23.514593 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-60aefbfa-8192-4247-85d8-e7817ecb69b1 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:23.515428 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-60aefbfa-8192-4247-85d8-e7817ecb69b1 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:23.515924 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-60aefbfa-8192-4247-85d8-e7817ecb69b1 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:23.732180 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-60aefbfa-8192-4247-85d8-e7817ecb69b1 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:23.745399 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-60aefbfa-8192-4247-85d8-e7817ecb69b1 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:23.749918 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-60aefbfa-8192-4247-85d8-e7817ecb69b1 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:23.751107 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-60aefbfa-8192-4247-85d8-e7817ecb69b1 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.253469 Dec 16 15:04:23.751694 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 551/1089] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:04:23 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:04:24.241069 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-8ef021dc-05b4-474e-b23a-40ad19b28a89 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:04:24.241745 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-8ef021dc-05b4-474e-b23a-40ad19b28a89 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:04:24.249588 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8ef021dc-05b4-474e-b23a-40ad19b28a89 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:24.250133 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8ef021dc-05b4-474e-b23a-40ad19b28a89 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:24.250981 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8ef021dc-05b4-474e-b23a-40ad19b28a89 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:24.251477 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8ef021dc-05b4-474e-b23a-40ad19b28a89 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:24.641676 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-8ef021dc-05b4-474e-b23a-40ad19b28a89 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:24.651133 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-8ef021dc-05b4-474e-b23a-40ad19b28a89 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.418485 Dec 16 15:04:24.651729 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 539/1090] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:04:24 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:04:24.774752 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-a131f056-a221-4cd9-b720-e765e52df081 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:04:24.775355 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-a131f056-a221-4cd9-b720-e765e52df081 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:04:24.783143 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a131f056-a221-4cd9-b720-e765e52df081 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:24.783670 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a131f056-a221-4cd9-b720-e765e52df081 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:24.785065 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a131f056-a221-4cd9-b720-e765e52df081 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:24.785559 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a131f056-a221-4cd9-b720-e765e52df081 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:25.199597 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-a131f056-a221-4cd9-b720-e765e52df081 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:25.212883 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-a131f056-a221-4cd9-b720-e765e52df081 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:25.217335 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-a131f056-a221-4cd9-b720-e765e52df081 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:25.218569 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-a131f056-a221-4cd9-b720-e765e52df081 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.451509 Dec 16 15:04:25.219153 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 552/1091] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:04:24 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:04:25.673209 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-4f0087bb-4f37-4629-8fb9-75b13a9e184c tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:04:25.673864 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-4f0087bb-4f37-4629-8fb9-75b13a9e184c tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:04:25.683421 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4f0087bb-4f37-4629-8fb9-75b13a9e184c tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:25.683891 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4f0087bb-4f37-4629-8fb9-75b13a9e184c tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:25.684773 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4f0087bb-4f37-4629-8fb9-75b13a9e184c tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:25.685261 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4f0087bb-4f37-4629-8fb9-75b13a9e184c tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:25.897960 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-4f0087bb-4f37-4629-8fb9-75b13a9e184c tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:25.906771 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-4f0087bb-4f37-4629-8fb9-75b13a9e184c tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.241210 Dec 16 15:04:25.907358 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 540/1092] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:04:25 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:04:26.242182 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-1aa6a89d-d485-4e53-a5a6-acb2191ae8e2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:04:26.242830 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-1aa6a89d-d485-4e53-a5a6-acb2191ae8e2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:04:26.250706 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1aa6a89d-d485-4e53-a5a6-acb2191ae8e2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:26.251157 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1aa6a89d-d485-4e53-a5a6-acb2191ae8e2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:26.251985 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1aa6a89d-d485-4e53-a5a6-acb2191ae8e2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:26.252471 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1aa6a89d-d485-4e53-a5a6-acb2191ae8e2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:26.465847 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-1aa6a89d-d485-4e53-a5a6-acb2191ae8e2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:26.479020 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-1aa6a89d-d485-4e53-a5a6-acb2191ae8e2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:26.483614 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-1aa6a89d-d485-4e53-a5a6-acb2191ae8e2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:26.484797 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-1aa6a89d-d485-4e53-a5a6-acb2191ae8e2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.250359 Dec 16 15:04:26.485385 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 553/1093] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:04:26 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:04:26.929994 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-7edc90a3-2ca9-404d-bfae-4e49479ca371 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:04:26.930696 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-7edc90a3-2ca9-404d-bfae-4e49479ca371 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:04:26.938531 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7edc90a3-2ca9-404d-bfae-4e49479ca371 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:26.939044 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7edc90a3-2ca9-404d-bfae-4e49479ca371 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:26.939884 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7edc90a3-2ca9-404d-bfae-4e49479ca371 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:26.940401 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7edc90a3-2ca9-404d-bfae-4e49479ca371 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:27.151307 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-7edc90a3-2ca9-404d-bfae-4e49479ca371 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:27.160592 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-7edc90a3-2ca9-404d-bfae-4e49479ca371 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.239200 Dec 16 15:04:27.161189 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 541/1094] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:04:26 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:04:27.508545 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-7df35adb-5a4d-430e-a273-52e8238bbb23 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:04:27.509219 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-7df35adb-5a4d-430e-a273-52e8238bbb23 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:04:27.517205 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7df35adb-5a4d-430e-a273-52e8238bbb23 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:27.517716 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7df35adb-5a4d-430e-a273-52e8238bbb23 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:27.519094 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7df35adb-5a4d-430e-a273-52e8238bbb23 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:27.519657 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7df35adb-5a4d-430e-a273-52e8238bbb23 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:27.735447 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-7df35adb-5a4d-430e-a273-52e8238bbb23 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:27.748058 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-7df35adb-5a4d-430e-a273-52e8238bbb23 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:27.753066 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-7df35adb-5a4d-430e-a273-52e8238bbb23 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:27.754289 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-7df35adb-5a4d-430e-a273-52e8238bbb23 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.253542 Dec 16 15:04:27.754869 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 554/1095] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:04:27 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:04:28.182574 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-0400c66b-7bfc-494c-9082-dbbd76359f50 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:04:28.183192 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-0400c66b-7bfc-494c-9082-dbbd76359f50 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:04:28.191536 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0400c66b-7bfc-494c-9082-dbbd76359f50 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:28.192048 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0400c66b-7bfc-494c-9082-dbbd76359f50 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:28.192896 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0400c66b-7bfc-494c-9082-dbbd76359f50 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:28.193393 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0400c66b-7bfc-494c-9082-dbbd76359f50 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:28.411370 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-0400c66b-7bfc-494c-9082-dbbd76359f50 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:28.420044 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-0400c66b-7bfc-494c-9082-dbbd76359f50 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.245766 Dec 16 15:04:28.420633 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 542/1096] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:04:28 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:04:28.777734 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-fa506d18-1072-4439-99d1-7d5e9cc82176 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:04:28.778484 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-fa506d18-1072-4439-99d1-7d5e9cc82176 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:04:28.786322 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fa506d18-1072-4439-99d1-7d5e9cc82176 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:28.786833 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fa506d18-1072-4439-99d1-7d5e9cc82176 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:28.787674 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fa506d18-1072-4439-99d1-7d5e9cc82176 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:28.788167 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fa506d18-1072-4439-99d1-7d5e9cc82176 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:29.005877 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-fa506d18-1072-4439-99d1-7d5e9cc82176 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:29.018713 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-fa506d18-1072-4439-99d1-7d5e9cc82176 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:29.023224 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-fa506d18-1072-4439-99d1-7d5e9cc82176 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:29.024402 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-fa506d18-1072-4439-99d1-7d5e9cc82176 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.254424 Dec 16 15:04:29.024981 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 555/1097] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:04:28 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:04:29.442787 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-04339c32-dce4-4da6-ad8d-c9420a5a2c80 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:04:29.443461 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-04339c32-dce4-4da6-ad8d-c9420a5a2c80 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:04:29.451565 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-04339c32-dce4-4da6-ad8d-c9420a5a2c80 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:29.452076 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-04339c32-dce4-4da6-ad8d-c9420a5a2c80 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:29.452924 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-04339c32-dce4-4da6-ad8d-c9420a5a2c80 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:29.453422 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-04339c32-dce4-4da6-ad8d-c9420a5a2c80 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:29.669041 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-04339c32-dce4-4da6-ad8d-c9420a5a2c80 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:29.678684 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-04339c32-dce4-4da6-ad8d-c9420a5a2c80 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.244271 Dec 16 15:04:29.679268 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 543/1098] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:04:29 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:04:30.047775 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-f9e9b81b-a3b0-4a49-8a2a-aa202b604b97 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:04:30.048421 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-f9e9b81b-a3b0-4a49-8a2a-aa202b604b97 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:04:30.056899 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f9e9b81b-a3b0-4a49-8a2a-aa202b604b97 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:30.057397 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f9e9b81b-a3b0-4a49-8a2a-aa202b604b97 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:30.058255 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f9e9b81b-a3b0-4a49-8a2a-aa202b604b97 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:30.058740 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f9e9b81b-a3b0-4a49-8a2a-aa202b604b97 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:30.268900 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-f9e9b81b-a3b0-4a49-8a2a-aa202b604b97 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:30.281539 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-f9e9b81b-a3b0-4a49-8a2a-aa202b604b97 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:30.286591 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-f9e9b81b-a3b0-4a49-8a2a-aa202b604b97 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:30.287755 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-f9e9b81b-a3b0-4a49-8a2a-aa202b604b97 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.247784 Dec 16 15:04:30.288336 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 556/1099] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:04:30 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:04:30.700982 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-dd55c4d0-7435-4552-ab69-beeb24ed2c16 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:04:30.701663 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-dd55c4d0-7435-4552-ab69-beeb24ed2c16 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:04:30.710250 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-dd55c4d0-7435-4552-ab69-beeb24ed2c16 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:30.710760 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-dd55c4d0-7435-4552-ab69-beeb24ed2c16 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:30.711608 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-dd55c4d0-7435-4552-ab69-beeb24ed2c16 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:30.712107 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-dd55c4d0-7435-4552-ab69-beeb24ed2c16 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:30.925050 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-dd55c4d0-7435-4552-ab69-beeb24ed2c16 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:30.934476 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-dd55c4d0-7435-4552-ab69-beeb24ed2c16 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.241306 Dec 16 15:04:30.935072 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 544/1100] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:04:30 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:04:31.310384 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-f643d76a-4cc6-4189-9c1d-4a4a0ad7f495 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:04:31.311044 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-f643d76a-4cc6-4189-9c1d-4a4a0ad7f495 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:04:31.319448 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f643d76a-4cc6-4189-9c1d-4a4a0ad7f495 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:31.319946 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f643d76a-4cc6-4189-9c1d-4a4a0ad7f495 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:31.320767 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f643d76a-4cc6-4189-9c1d-4a4a0ad7f495 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:31.321507 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f643d76a-4cc6-4189-9c1d-4a4a0ad7f495 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:31.551918 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-f643d76a-4cc6-4189-9c1d-4a4a0ad7f495 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:31.564716 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-f643d76a-4cc6-4189-9c1d-4a4a0ad7f495 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:31.569219 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-f643d76a-4cc6-4189-9c1d-4a4a0ad7f495 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:31.570488 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-f643d76a-4cc6-4189-9c1d-4a4a0ad7f495 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.267492 Dec 16 15:04:31.571327 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 557/1101] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:04:31 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:04:31.960008 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-a83e3077-225a-42bb-98e5-95a39d0db2db tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:04:31.960679 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-a83e3077-225a-42bb-98e5-95a39d0db2db tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:04:31.968534 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a83e3077-225a-42bb-98e5-95a39d0db2db tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:31.969036 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a83e3077-225a-42bb-98e5-95a39d0db2db tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:31.969877 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a83e3077-225a-42bb-98e5-95a39d0db2db tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:31.970390 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a83e3077-225a-42bb-98e5-95a39d0db2db tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:32.187491 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-a83e3077-225a-42bb-98e5-95a39d0db2db tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:32.196583 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-a83e3077-225a-42bb-98e5-95a39d0db2db tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.244746 Dec 16 15:04:32.197174 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 545/1102] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:04:31 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:04:32.593761 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-f1d0d9c3-c77a-4d22-85d2-ddd78c7e2ff2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:04:32.594487 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-f1d0d9c3-c77a-4d22-85d2-ddd78c7e2ff2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:04:32.602888 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f1d0d9c3-c77a-4d22-85d2-ddd78c7e2ff2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:32.603401 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f1d0d9c3-c77a-4d22-85d2-ddd78c7e2ff2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:32.604245 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f1d0d9c3-c77a-4d22-85d2-ddd78c7e2ff2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:32.604742 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f1d0d9c3-c77a-4d22-85d2-ddd78c7e2ff2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:32.824593 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-f1d0d9c3-c77a-4d22-85d2-ddd78c7e2ff2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:32.837696 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-f1d0d9c3-c77a-4d22-85d2-ddd78c7e2ff2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:32.842181 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-f1d0d9c3-c77a-4d22-85d2-ddd78c7e2ff2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:32.843361 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-f1d0d9c3-c77a-4d22-85d2-ddd78c7e2ff2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.257433 Dec 16 15:04:32.843942 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 558/1103] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:04:32 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:04:33.218343 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-59663361-2b68-49d8-ab79-17a1b03c4321 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:04:33.219010 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-59663361-2b68-49d8-ab79-17a1b03c4321 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:04:33.227467 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-59663361-2b68-49d8-ab79-17a1b03c4321 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:33.227972 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-59663361-2b68-49d8-ab79-17a1b03c4321 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:33.228798 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-59663361-2b68-49d8-ab79-17a1b03c4321 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:33.229284 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-59663361-2b68-49d8-ab79-17a1b03c4321 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:33.442845 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-59663361-2b68-49d8-ab79-17a1b03c4321 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:33.451975 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-59663361-2b68-49d8-ab79-17a1b03c4321 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.241264 Dec 16 15:04:33.452558 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 546/1104] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:04:33 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:04:33.867156 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-270d20b6-f348-4c30-96c3-123a074451af tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:04:33.867817 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-270d20b6-f348-4c30-96c3-123a074451af tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:04:33.876161 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-270d20b6-f348-4c30-96c3-123a074451af tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:33.876668 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-270d20b6-f348-4c30-96c3-123a074451af tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:33.878216 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-270d20b6-f348-4c30-96c3-123a074451af tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:33.878710 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-270d20b6-f348-4c30-96c3-123a074451af tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:34.093330 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-270d20b6-f348-4c30-96c3-123a074451af tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:34.106008 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-270d20b6-f348-4c30-96c3-123a074451af tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:34.110477 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-270d20b6-f348-4c30-96c3-123a074451af tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:34.111643 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-270d20b6-f348-4c30-96c3-123a074451af tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.252024 Dec 16 15:04:34.112732 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 559/1105] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:04:33 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:04:34.473507 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-02646204-f70f-4ece-b239-9a2e05c2de03 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:04:34.474203 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-02646204-f70f-4ece-b239-9a2e05c2de03 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:04:34.481991 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-02646204-f70f-4ece-b239-9a2e05c2de03 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:34.482523 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-02646204-f70f-4ece-b239-9a2e05c2de03 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:34.483365 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-02646204-f70f-4ece-b239-9a2e05c2de03 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:34.483856 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-02646204-f70f-4ece-b239-9a2e05c2de03 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:34.702566 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-02646204-f70f-4ece-b239-9a2e05c2de03 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:34.712495 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-02646204-f70f-4ece-b239-9a2e05c2de03 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.246565 Dec 16 15:04:34.713100 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 547/1106] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:04:34 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:04:35.135506 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-4dfb35af-d73b-4107-9c15-7583b26677fa tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:04:35.136175 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-4dfb35af-d73b-4107-9c15-7583b26677fa tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:04:35.144031 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4dfb35af-d73b-4107-9c15-7583b26677fa tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:35.144548 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4dfb35af-d73b-4107-9c15-7583b26677fa tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:35.145383 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4dfb35af-d73b-4107-9c15-7583b26677fa tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:35.145873 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4dfb35af-d73b-4107-9c15-7583b26677fa tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:35.364317 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-4dfb35af-d73b-4107-9c15-7583b26677fa tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:35.385609 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-4dfb35af-d73b-4107-9c15-7583b26677fa tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:35.393234 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-4dfb35af-d73b-4107-9c15-7583b26677fa tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:35.395414 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-4dfb35af-d73b-4107-9c15-7583b26677fa tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.267742 Dec 16 15:04:35.396461 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 560/1107] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:04:35 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 15:04:35.735382 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-142889ee-0dd1-4e4d-af71-45126b3cd0fc tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:04:35.735983 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-142889ee-0dd1-4e4d-af71-45126b3cd0fc tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:04:35.743925 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-142889ee-0dd1-4e4d-af71-45126b3cd0fc tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:35.744440 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-142889ee-0dd1-4e4d-af71-45126b3cd0fc tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:35.745274 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-142889ee-0dd1-4e4d-af71-45126b3cd0fc tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:35.745768 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-142889ee-0dd1-4e4d-af71-45126b3cd0fc tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:35.965071 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-142889ee-0dd1-4e4d-af71-45126b3cd0fc tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:35.974586 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-142889ee-0dd1-4e4d-af71-45126b3cd0fc tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.247049 Dec 16 15:04:35.975179 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 548/1108] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:04:35 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:04:36.422926 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-2542ef4c-d20e-4fb8-bf28-364c39d1173a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:04:36.423595 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-2542ef4c-d20e-4fb8-bf28-364c39d1173a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:04:36.431552 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2542ef4c-d20e-4fb8-bf28-364c39d1173a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:36.432001 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2542ef4c-d20e-4fb8-bf28-364c39d1173a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:36.432823 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2542ef4c-d20e-4fb8-bf28-364c39d1173a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:36.433310 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2542ef4c-d20e-4fb8-bf28-364c39d1173a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:36.647271 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-2542ef4c-d20e-4fb8-bf28-364c39d1173a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:36.660160 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-2542ef4c-d20e-4fb8-bf28-364c39d1173a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:36.664628 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-2542ef4c-d20e-4fb8-bf28-364c39d1173a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:36.666099 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-2542ef4c-d20e-4fb8-bf28-364c39d1173a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.250869 Dec 16 15:04:36.666675 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 561/1109] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:04:36 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:04:36.996216 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-48bf6076-7529-4ac3-a17d-50262c70c6f7 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:04:36.996893 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-48bf6076-7529-4ac3-a17d-50262c70c6f7 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:04:37.004835 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-48bf6076-7529-4ac3-a17d-50262c70c6f7 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:37.005345 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-48bf6076-7529-4ac3-a17d-50262c70c6f7 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:37.006211 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-48bf6076-7529-4ac3-a17d-50262c70c6f7 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:37.006710 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-48bf6076-7529-4ac3-a17d-50262c70c6f7 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:37.224961 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-48bf6076-7529-4ac3-a17d-50262c70c6f7 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:37.233707 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-48bf6076-7529-4ac3-a17d-50262c70c6f7 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.245049 Dec 16 15:04:37.234330 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 549/1110] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:04:36 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:04:37.689036 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-cc66d1ab-9e7b-4c4c-b47f-aef0d3f82864 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:04:37.689696 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-cc66d1ab-9e7b-4c4c-b47f-aef0d3f82864 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:04:37.697823 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cc66d1ab-9e7b-4c4c-b47f-aef0d3f82864 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:37.698356 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cc66d1ab-9e7b-4c4c-b47f-aef0d3f82864 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:37.699183 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cc66d1ab-9e7b-4c4c-b47f-aef0d3f82864 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:37.699671 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cc66d1ab-9e7b-4c4c-b47f-aef0d3f82864 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:37.916208 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-cc66d1ab-9e7b-4c4c-b47f-aef0d3f82864 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:37.929870 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-cc66d1ab-9e7b-4c4c-b47f-aef0d3f82864 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:37.934478 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-cc66d1ab-9e7b-4c4c-b47f-aef0d3f82864 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:37.935676 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-cc66d1ab-9e7b-4c4c-b47f-aef0d3f82864 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.254278 Dec 16 15:04:37.936268 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 562/1111] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:04:37 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:04:38.255960 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-8cbba7bd-bc93-4ca8-9eee-a3e123e3673a tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:04:38.256639 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-8cbba7bd-bc93-4ca8-9eee-a3e123e3673a tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:04:38.264638 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8cbba7bd-bc93-4ca8-9eee-a3e123e3673a tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:38.265151 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8cbba7bd-bc93-4ca8-9eee-a3e123e3673a tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:38.266026 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8cbba7bd-bc93-4ca8-9eee-a3e123e3673a tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:38.266570 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8cbba7bd-bc93-4ca8-9eee-a3e123e3673a tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:38.481201 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-8cbba7bd-bc93-4ca8-9eee-a3e123e3673a tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:38.490728 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-8cbba7bd-bc93-4ca8-9eee-a3e123e3673a tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.242446 Dec 16 15:04:38.491324 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 550/1112] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:04:38 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:04:38.958938 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-e43c8fbb-1a41-4ebd-9f98-47b2ddfdf117 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:04:38.959599 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-e43c8fbb-1a41-4ebd-9f98-47b2ddfdf117 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:04:38.967416 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e43c8fbb-1a41-4ebd-9f98-47b2ddfdf117 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:38.967915 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e43c8fbb-1a41-4ebd-9f98-47b2ddfdf117 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:38.968738 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e43c8fbb-1a41-4ebd-9f98-47b2ddfdf117 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:38.969227 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e43c8fbb-1a41-4ebd-9f98-47b2ddfdf117 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:39.193473 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-e43c8fbb-1a41-4ebd-9f98-47b2ddfdf117 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:39.206847 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-e43c8fbb-1a41-4ebd-9f98-47b2ddfdf117 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:39.211266 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-e43c8fbb-1a41-4ebd-9f98-47b2ddfdf117 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:39.212429 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-e43c8fbb-1a41-4ebd-9f98-47b2ddfdf117 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.261158 Dec 16 15:04:39.212996 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 563/1113] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:04:38 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:04:39.513189 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-6f00690c-b73f-4769-a072-f22223bffa27 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:04:39.513858 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-6f00690c-b73f-4769-a072-f22223bffa27 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:04:39.521822 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6f00690c-b73f-4769-a072-f22223bffa27 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:39.522361 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6f00690c-b73f-4769-a072-f22223bffa27 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:39.523200 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6f00690c-b73f-4769-a072-f22223bffa27 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:39.523694 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6f00690c-b73f-4769-a072-f22223bffa27 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:39.747279 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-6f00690c-b73f-4769-a072-f22223bffa27 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:39.756457 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-6f00690c-b73f-4769-a072-f22223bffa27 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.250898 Dec 16 15:04:39.757049 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 551/1114] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:04:39 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:04:40.236309 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-300da339-6901-4e0e-9822-2da2391a24c5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:04:40.236983 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-300da339-6901-4e0e-9822-2da2391a24c5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:04:40.244789 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-300da339-6901-4e0e-9822-2da2391a24c5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:40.245297 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-300da339-6901-4e0e-9822-2da2391a24c5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:40.246161 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-300da339-6901-4e0e-9822-2da2391a24c5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:40.246660 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-300da339-6901-4e0e-9822-2da2391a24c5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:40.462779 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-300da339-6901-4e0e-9822-2da2391a24c5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:40.475442 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-300da339-6901-4e0e-9822-2da2391a24c5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:40.479818 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-300da339-6901-4e0e-9822-2da2391a24c5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:40.480988 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-300da339-6901-4e0e-9822-2da2391a24c5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.252466 Dec 16 15:04:40.481578 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 564/1115] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:04:40 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:04:40.777940 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-6d6c3c24-4f6d-4b35-81bc-53f52cdd31c2 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:04:40.778645 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-6d6c3c24-4f6d-4b35-81bc-53f52cdd31c2 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:04:40.786460 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6d6c3c24-4f6d-4b35-81bc-53f52cdd31c2 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:40.786971 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6d6c3c24-4f6d-4b35-81bc-53f52cdd31c2 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:40.787815 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6d6c3c24-4f6d-4b35-81bc-53f52cdd31c2 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:40.788308 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6d6c3c24-4f6d-4b35-81bc-53f52cdd31c2 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:41.005897 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-6d6c3c24-4f6d-4b35-81bc-53f52cdd31c2 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:41.015881 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-6d6c3c24-4f6d-4b35-81bc-53f52cdd31c2 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.245302 Dec 16 15:04:41.016476 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 552/1116] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:04:40 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:04:41.504823 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-6f9dfe29-0b3f-4813-936f-8b6ca3069653 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:04:41.505475 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-6f9dfe29-0b3f-4813-936f-8b6ca3069653 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:04:41.513345 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6f9dfe29-0b3f-4813-936f-8b6ca3069653 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:41.513838 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6f9dfe29-0b3f-4813-936f-8b6ca3069653 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:41.514684 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6f9dfe29-0b3f-4813-936f-8b6ca3069653 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:41.515170 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6f9dfe29-0b3f-4813-936f-8b6ca3069653 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:41.725835 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-6f9dfe29-0b3f-4813-936f-8b6ca3069653 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:41.739147 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-6f9dfe29-0b3f-4813-936f-8b6ca3069653 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:41.743599 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-6f9dfe29-0b3f-4813-936f-8b6ca3069653 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:41.744776 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-6f9dfe29-0b3f-4813-936f-8b6ca3069653 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.248201 Dec 16 15:04:41.745357 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 565/1117] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:04:41 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:04:42.037797 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-92615191-7865-400e-8f31-7b4caf955b8a tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:04:42.038397 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-92615191-7865-400e-8f31-7b4caf955b8a tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:04:42.049464 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-92615191-7865-400e-8f31-7b4caf955b8a tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:42.050029 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-92615191-7865-400e-8f31-7b4caf955b8a tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:42.050995 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-92615191-7865-400e-8f31-7b4caf955b8a tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:42.051499 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-92615191-7865-400e-8f31-7b4caf955b8a tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:42.267907 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-92615191-7865-400e-8f31-7b4caf955b8a tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:42.276866 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-92615191-7865-400e-8f31-7b4caf955b8a tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.246902 Dec 16 15:04:42.277455 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 553/1118] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:04:42 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:04:42.769314 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-69c3eb54-cb92-45fe-bb09-2d0218ee5271 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:04:42.769908 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-69c3eb54-cb92-45fe-bb09-2d0218ee5271 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:04:42.781382 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-69c3eb54-cb92-45fe-bb09-2d0218ee5271 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:42.781954 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-69c3eb54-cb92-45fe-bb09-2d0218ee5271 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:42.783353 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-69c3eb54-cb92-45fe-bb09-2d0218ee5271 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:42.784658 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-69c3eb54-cb92-45fe-bb09-2d0218ee5271 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:43.011248 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-69c3eb54-cb92-45fe-bb09-2d0218ee5271 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:43.024641 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-69c3eb54-cb92-45fe-bb09-2d0218ee5271 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:43.029079 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-69c3eb54-cb92-45fe-bb09-2d0218ee5271 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:43.030286 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-69c3eb54-cb92-45fe-bb09-2d0218ee5271 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.269345 Dec 16 15:04:43.030866 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 566/1119] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:04:42 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:04:43.298790 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-e67c0475-2406-4b8a-a045-35c39e5ea1df tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:04:43.299472 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-e67c0475-2406-4b8a-a045-35c39e5ea1df tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:04:43.307282 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e67c0475-2406-4b8a-a045-35c39e5ea1df tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:43.307789 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e67c0475-2406-4b8a-a045-35c39e5ea1df tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:43.308625 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e67c0475-2406-4b8a-a045-35c39e5ea1df tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:43.309118 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e67c0475-2406-4b8a-a045-35c39e5ea1df tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:43.529318 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-e67c0475-2406-4b8a-a045-35c39e5ea1df tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:43.538912 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-e67c0475-2406-4b8a-a045-35c39e5ea1df tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.247941 Dec 16 15:04:43.539447 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 554/1120] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:04:43 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:04:44.054211 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-a68b5fa3-11da-4f68-b9b8-89727301d03b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:04:44.054925 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-a68b5fa3-11da-4f68-b9b8-89727301d03b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:04:44.062785 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a68b5fa3-11da-4f68-b9b8-89727301d03b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:44.063245 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a68b5fa3-11da-4f68-b9b8-89727301d03b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:44.064106 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a68b5fa3-11da-4f68-b9b8-89727301d03b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:44.064602 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a68b5fa3-11da-4f68-b9b8-89727301d03b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:44.283522 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-a68b5fa3-11da-4f68-b9b8-89727301d03b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:44.296774 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-a68b5fa3-11da-4f68-b9b8-89727301d03b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:44.301274 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-a68b5fa3-11da-4f68-b9b8-89727301d03b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:44.302479 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-a68b5fa3-11da-4f68-b9b8-89727301d03b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.256139 Dec 16 15:04:44.303068 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 567/1121] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:04:44 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:04:44.560371 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-8102acd0-f500-4cb7-9004-8dfde954741c tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:04:44.561046 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-8102acd0-f500-4cb7-9004-8dfde954741c tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:04:44.569396 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8102acd0-f500-4cb7-9004-8dfde954741c tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:44.569902 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8102acd0-f500-4cb7-9004-8dfde954741c tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:44.571014 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8102acd0-f500-4cb7-9004-8dfde954741c tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:44.571507 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8102acd0-f500-4cb7-9004-8dfde954741c tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:44.786912 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-8102acd0-f500-4cb7-9004-8dfde954741c tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:44.795652 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-8102acd0-f500-4cb7-9004-8dfde954741c tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.242929 Dec 16 15:04:44.796245 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 555/1122] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:04:44 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:04:45.326133 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-b3e835c4-d28b-422b-8607-075d6c84ce7c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:04:45.326809 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-b3e835c4-d28b-422b-8607-075d6c84ce7c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:04:45.335233 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b3e835c4-d28b-422b-8607-075d6c84ce7c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:45.335744 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b3e835c4-d28b-422b-8607-075d6c84ce7c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:45.336593 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b3e835c4-d28b-422b-8607-075d6c84ce7c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:45.337089 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b3e835c4-d28b-422b-8607-075d6c84ce7c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:45.550464 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-b3e835c4-d28b-422b-8607-075d6c84ce7c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:45.563532 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-b3e835c4-d28b-422b-8607-075d6c84ce7c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:45.567979 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-b3e835c4-d28b-422b-8607-075d6c84ce7c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:45.569151 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-b3e835c4-d28b-422b-8607-075d6c84ce7c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.250978 Dec 16 15:04:45.569745 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 568/1123] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:04:45 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:04:45.816466 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-10052c8f-356e-476f-8e70-3925273938fb tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:04:45.817135 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-10052c8f-356e-476f-8e70-3925273938fb tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:04:45.825249 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-10052c8f-356e-476f-8e70-3925273938fb tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:45.825773 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-10052c8f-356e-476f-8e70-3925273938fb tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:45.826628 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-10052c8f-356e-476f-8e70-3925273938fb tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:45.827129 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-10052c8f-356e-476f-8e70-3925273938fb tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:46.036535 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-10052c8f-356e-476f-8e70-3925273938fb tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:46.045319 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-10052c8f-356e-476f-8e70-3925273938fb tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.236406 Dec 16 15:04:46.045910 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 556/1124] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:04:45 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:04:46.592694 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-37c4c480-ae15-4a6d-8ddb-220777e3e427 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:04:46.593363 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-37c4c480-ae15-4a6d-8ddb-220777e3e427 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:04:46.601189 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-37c4c480-ae15-4a6d-8ddb-220777e3e427 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:46.601696 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-37c4c480-ae15-4a6d-8ddb-220777e3e427 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:46.602556 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-37c4c480-ae15-4a6d-8ddb-220777e3e427 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:46.603051 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-37c4c480-ae15-4a6d-8ddb-220777e3e427 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:46.821935 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-37c4c480-ae15-4a6d-8ddb-220777e3e427 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:46.840582 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-37c4c480-ae15-4a6d-8ddb-220777e3e427 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:46.850226 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-37c4c480-ae15-4a6d-8ddb-220777e3e427 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:46.851450 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-37c4c480-ae15-4a6d-8ddb-220777e3e427 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.266612 Dec 16 15:04:46.852042 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 569/1125] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:04:46 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:04:47.067115 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-fe5a55cc-e1ee-4cb0-9e6f-e9480ee95a54 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:04:47.067752 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-fe5a55cc-e1ee-4cb0-9e6f-e9480ee95a54 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:04:47.075811 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fe5a55cc-e1ee-4cb0-9e6f-e9480ee95a54 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:47.076308 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fe5a55cc-e1ee-4cb0-9e6f-e9480ee95a54 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:47.077130 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fe5a55cc-e1ee-4cb0-9e6f-e9480ee95a54 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:47.077620 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fe5a55cc-e1ee-4cb0-9e6f-e9480ee95a54 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:47.304807 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-fe5a55cc-e1ee-4cb0-9e6f-e9480ee95a54 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:47.313653 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-fe5a55cc-e1ee-4cb0-9e6f-e9480ee95a54 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.254302 Dec 16 15:04:47.314435 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 557/1126] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:04:47 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:04:47.875453 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-e3feca40-00a0-4df0-9711-9d7cc97bf5e8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:04:47.876119 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-e3feca40-00a0-4df0-9711-9d7cc97bf5e8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:04:47.883934 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e3feca40-00a0-4df0-9711-9d7cc97bf5e8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:47.884444 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e3feca40-00a0-4df0-9711-9d7cc97bf5e8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:47.885284 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e3feca40-00a0-4df0-9711-9d7cc97bf5e8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:47.885782 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e3feca40-00a0-4df0-9711-9d7cc97bf5e8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:48.099469 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-e3feca40-00a0-4df0-9711-9d7cc97bf5e8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:48.112430 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-e3feca40-00a0-4df0-9711-9d7cc97bf5e8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:48.119985 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-e3feca40-00a0-4df0-9711-9d7cc97bf5e8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:48.121945 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-e3feca40-00a0-4df0-9711-9d7cc97bf5e8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.253925 Dec 16 15:04:48.122870 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 570/1127] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:04:47 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:04:48.336413 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-a2655ad6-8e91-48b7-8205-9f039acecd7f tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:04:48.337096 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-a2655ad6-8e91-48b7-8205-9f039acecd7f tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:04:48.345062 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a2655ad6-8e91-48b7-8205-9f039acecd7f tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:48.345576 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a2655ad6-8e91-48b7-8205-9f039acecd7f tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:48.346452 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a2655ad6-8e91-48b7-8205-9f039acecd7f tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:48.346955 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a2655ad6-8e91-48b7-8205-9f039acecd7f tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:48.562124 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-a2655ad6-8e91-48b7-8205-9f039acecd7f tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:48.571299 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-a2655ad6-8e91-48b7-8205-9f039acecd7f tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.242861 Dec 16 15:04:48.571899 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 558/1128] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:04:48 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:04:49.151591 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-6cb736a8-ae07-42d4-b96d-950f71e2f48f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:04:49.152263 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-6cb736a8-ae07-42d4-b96d-950f71e2f48f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:04:49.160512 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6cb736a8-ae07-42d4-b96d-950f71e2f48f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:49.161017 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6cb736a8-ae07-42d4-b96d-950f71e2f48f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:49.161850 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6cb736a8-ae07-42d4-b96d-950f71e2f48f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:49.162367 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6cb736a8-ae07-42d4-b96d-950f71e2f48f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:49.385388 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-6cb736a8-ae07-42d4-b96d-950f71e2f48f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:49.398753 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-6cb736a8-ae07-42d4-b96d-950f71e2f48f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:49.403253 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-6cb736a8-ae07-42d4-b96d-950f71e2f48f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:49.404426 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-6cb736a8-ae07-42d4-b96d-950f71e2f48f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.260541 Dec 16 15:04:49.405007 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 571/1129] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:04:49 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:04:49.592910 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-a1df03a4-62ba-4c50-a12b-65b3f3f1ad5d tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:04:49.593585 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-a1df03a4-62ba-4c50-a12b-65b3f3f1ad5d tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:04:49.601331 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a1df03a4-62ba-4c50-a12b-65b3f3f1ad5d tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:49.601848 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a1df03a4-62ba-4c50-a12b-65b3f3f1ad5d tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:49.602749 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a1df03a4-62ba-4c50-a12b-65b3f3f1ad5d tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:49.603251 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a1df03a4-62ba-4c50-a12b-65b3f3f1ad5d tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:49.817690 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-a1df03a4-62ba-4c50-a12b-65b3f3f1ad5d tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:49.826758 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-a1df03a4-62ba-4c50-a12b-65b3f3f1ad5d tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.241670 Dec 16 15:04:49.827351 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 559/1130] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:04:49 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:04:50.427360 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-f45d5301-ab62-46bc-a808-9a097ee3bbe0 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:04:50.427970 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-f45d5301-ab62-46bc-a808-9a097ee3bbe0 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:04:50.435831 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f45d5301-ab62-46bc-a808-9a097ee3bbe0 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:50.436342 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f45d5301-ab62-46bc-a808-9a097ee3bbe0 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:50.437181 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f45d5301-ab62-46bc-a808-9a097ee3bbe0 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:50.437675 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f45d5301-ab62-46bc-a808-9a097ee3bbe0 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:50.663158 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-f45d5301-ab62-46bc-a808-9a097ee3bbe0 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:50.675955 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-f45d5301-ab62-46bc-a808-9a097ee3bbe0 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:50.680501 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-f45d5301-ab62-46bc-a808-9a097ee3bbe0 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:50.681640 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-f45d5301-ab62-46bc-a808-9a097ee3bbe0 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.262152 Dec 16 15:04:50.682305 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 572/1131] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:04:50 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:04:50.848696 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-32ae7866-ae55-47a0-aa10-2824a61e2d88 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:04:50.849372 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-32ae7866-ae55-47a0-aa10-2824a61e2d88 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:04:50.857250 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-32ae7866-ae55-47a0-aa10-2824a61e2d88 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:50.857765 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-32ae7866-ae55-47a0-aa10-2824a61e2d88 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:50.858639 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-32ae7866-ae55-47a0-aa10-2824a61e2d88 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:50.859175 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-32ae7866-ae55-47a0-aa10-2824a61e2d88 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:51.081775 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-32ae7866-ae55-47a0-aa10-2824a61e2d88 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:51.090619 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-32ae7866-ae55-47a0-aa10-2824a61e2d88 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.249692 Dec 16 15:04:51.091205 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 560/1132] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:04:50 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:04:51.706214 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-f09dc5f7-e093-4357-b4a3-74b5c8d80d9e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:04:51.706896 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-f09dc5f7-e093-4357-b4a3-74b5c8d80d9e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:04:51.714814 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f09dc5f7-e093-4357-b4a3-74b5c8d80d9e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:51.715318 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f09dc5f7-e093-4357-b4a3-74b5c8d80d9e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:51.716147 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f09dc5f7-e093-4357-b4a3-74b5c8d80d9e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:51.716634 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f09dc5f7-e093-4357-b4a3-74b5c8d80d9e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:51.952887 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-f09dc5f7-e093-4357-b4a3-74b5c8d80d9e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:51.966186 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-f09dc5f7-e093-4357-b4a3-74b5c8d80d9e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:51.972374 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-f09dc5f7-e093-4357-b4a3-74b5c8d80d9e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:51.973557 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-f09dc5f7-e093-4357-b4a3-74b5c8d80d9e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.275798 Dec 16 15:04:51.974168 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 573/1133] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:04:51 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:04:52.115894 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-35114b07-b2a8-46bc-bc0b-93b3d3715285 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:04:52.116569 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-35114b07-b2a8-46bc-bc0b-93b3d3715285 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:04:52.124458 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-35114b07-b2a8-46bc-bc0b-93b3d3715285 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:52.124964 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-35114b07-b2a8-46bc-bc0b-93b3d3715285 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:52.125807 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-35114b07-b2a8-46bc-bc0b-93b3d3715285 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:52.126323 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-35114b07-b2a8-46bc-bc0b-93b3d3715285 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:52.496467 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-35114b07-b2a8-46bc-bc0b-93b3d3715285 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:52.505254 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-35114b07-b2a8-46bc-bc0b-93b3d3715285 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.398850 Dec 16 15:04:52.505848 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 561/1134] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:04:52 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:04:52.996492 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-01abfc72-6396-4153-b5d9-afd87d7bc4f7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:04:52.997167 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-01abfc72-6396-4153-b5d9-afd87d7bc4f7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:04:53.005555 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-01abfc72-6396-4153-b5d9-afd87d7bc4f7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:53.006087 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-01abfc72-6396-4153-b5d9-afd87d7bc4f7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:53.006934 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-01abfc72-6396-4153-b5d9-afd87d7bc4f7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:53.007429 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-01abfc72-6396-4153-b5d9-afd87d7bc4f7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:53.222326 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-01abfc72-6396-4153-b5d9-afd87d7bc4f7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:53.236931 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-01abfc72-6396-4153-b5d9-afd87d7bc4f7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:53.241516 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-01abfc72-6396-4153-b5d9-afd87d7bc4f7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:53.242786 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-01abfc72-6396-4153-b5d9-afd87d7bc4f7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.253866 Dec 16 15:04:53.243376 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 574/1135] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:04:52 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:04:53.527315 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-d964622c-67d9-47e2-96a8-9fc07db71e3c tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:04:53.527995 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-d964622c-67d9-47e2-96a8-9fc07db71e3c tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:04:53.536300 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d964622c-67d9-47e2-96a8-9fc07db71e3c tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:53.536802 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d964622c-67d9-47e2-96a8-9fc07db71e3c tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:53.537631 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d964622c-67d9-47e2-96a8-9fc07db71e3c tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:53.538142 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d964622c-67d9-47e2-96a8-9fc07db71e3c tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:53.752068 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-d964622c-67d9-47e2-96a8-9fc07db71e3c tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:53.760890 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-d964622c-67d9-47e2-96a8-9fc07db71e3c tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.241477 Dec 16 15:04:53.761512 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 562/1136] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:04:53 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:04:54.267114 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-74f7fd34-a5d4-4a21-be0b-7691fed66266 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:04:54.268266 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-74f7fd34-a5d4-4a21-be0b-7691fed66266 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:04:54.276121 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-74f7fd34-a5d4-4a21-be0b-7691fed66266 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:54.276631 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-74f7fd34-a5d4-4a21-be0b-7691fed66266 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:54.277471 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-74f7fd34-a5d4-4a21-be0b-7691fed66266 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:54.277964 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-74f7fd34-a5d4-4a21-be0b-7691fed66266 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:54.495002 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-74f7fd34-a5d4-4a21-be0b-7691fed66266 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:54.508200 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-74f7fd34-a5d4-4a21-be0b-7691fed66266 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:54.512881 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-74f7fd34-a5d4-4a21-be0b-7691fed66266 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:54.514075 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-74f7fd34-a5d4-4a21-be0b-7691fed66266 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.254984 Dec 16 15:04:54.514838 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 575/1137] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:04:54 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:04:54.782134 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-3255b95f-98dd-44f4-b6cf-68305bd388fa tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:04:54.782754 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-3255b95f-98dd-44f4-b6cf-68305bd388fa tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:04:54.790761 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3255b95f-98dd-44f4-b6cf-68305bd388fa tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:54.791260 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3255b95f-98dd-44f4-b6cf-68305bd388fa tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:54.792179 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3255b95f-98dd-44f4-b6cf-68305bd388fa tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:54.792657 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3255b95f-98dd-44f4-b6cf-68305bd388fa tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:55.008068 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-3255b95f-98dd-44f4-b6cf-68305bd388fa tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:55.016711 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-3255b95f-98dd-44f4-b6cf-68305bd388fa tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.242136 Dec 16 15:04:55.017298 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 563/1138] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:04:54 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:04:55.538564 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-db3b6382-8c77-463b-8a98-ca4ad4611298 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:04:55.539226 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-db3b6382-8c77-463b-8a98-ca4ad4611298 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:04:55.547152 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-db3b6382-8c77-463b-8a98-ca4ad4611298 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:55.547660 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-db3b6382-8c77-463b-8a98-ca4ad4611298 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:55.548496 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-db3b6382-8c77-463b-8a98-ca4ad4611298 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:55.549054 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-db3b6382-8c77-463b-8a98-ca4ad4611298 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:55.898951 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-db3b6382-8c77-463b-8a98-ca4ad4611298 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:55.912444 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-db3b6382-8c77-463b-8a98-ca4ad4611298 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:55.917109 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-db3b6382-8c77-463b-8a98-ca4ad4611298 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:55.918300 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-db3b6382-8c77-463b-8a98-ca4ad4611298 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.388230 Dec 16 15:04:55.919078 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 576/1139] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:04:55 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:04:56.039503 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-132993dc-8c75-4907-9852-966ad6c4bbdf tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:04:56.040216 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-132993dc-8c75-4907-9852-966ad6c4bbdf tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:04:56.048074 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-132993dc-8c75-4907-9852-966ad6c4bbdf tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:56.048586 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-132993dc-8c75-4907-9852-966ad6c4bbdf tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:56.050047 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-132993dc-8c75-4907-9852-966ad6c4bbdf tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:56.050582 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-132993dc-8c75-4907-9852-966ad6c4bbdf tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:56.419136 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-132993dc-8c75-4907-9852-966ad6c4bbdf tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:56.428000 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-132993dc-8c75-4907-9852-966ad6c4bbdf tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.396909 Dec 16 15:04:56.428601 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 564/1140] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:04:56 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:04:56.942241 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-c0ff99d5-9e8d-4492-ad9d-420a13fa7aab tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:04:56.942908 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-c0ff99d5-9e8d-4492-ad9d-420a13fa7aab tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:04:56.954979 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c0ff99d5-9e8d-4492-ad9d-420a13fa7aab tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:56.955736 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c0ff99d5-9e8d-4492-ad9d-420a13fa7aab tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:56.956988 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c0ff99d5-9e8d-4492-ad9d-420a13fa7aab tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:56.957741 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c0ff99d5-9e8d-4492-ad9d-420a13fa7aab tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:57.183066 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-c0ff99d5-9e8d-4492-ad9d-420a13fa7aab tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:57.195879 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-c0ff99d5-9e8d-4492-ad9d-420a13fa7aab tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:57.200297 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-c0ff99d5-9e8d-4492-ad9d-420a13fa7aab tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:57.201501 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-c0ff99d5-9e8d-4492-ad9d-420a13fa7aab tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.267711 Dec 16 15:04:57.202099 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 577/1141] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:04:56 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:04:57.450393 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-02c30e3a-1227-4704-af71-d1e17dff5f4c tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:04:57.451058 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-02c30e3a-1227-4704-af71-d1e17dff5f4c tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:04:57.459532 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-02c30e3a-1227-4704-af71-d1e17dff5f4c tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:57.460042 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-02c30e3a-1227-4704-af71-d1e17dff5f4c tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:57.460878 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-02c30e3a-1227-4704-af71-d1e17dff5f4c tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:57.461372 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-02c30e3a-1227-4704-af71-d1e17dff5f4c tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:57.676900 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-02c30e3a-1227-4704-af71-d1e17dff5f4c tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:57.685912 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-02c30e3a-1227-4704-af71-d1e17dff5f4c tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.243343 Dec 16 15:04:57.686534 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 565/1142] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:04:57 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:04:58.225154 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-f3ecdad4-1b93-44b4-a107-c4bd968a5f56 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:04:58.225828 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-f3ecdad4-1b93-44b4-a107-c4bd968a5f56 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:04:58.233612 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f3ecdad4-1b93-44b4-a107-c4bd968a5f56 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:58.234149 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f3ecdad4-1b93-44b4-a107-c4bd968a5f56 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:58.234988 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f3ecdad4-1b93-44b4-a107-c4bd968a5f56 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:58.235483 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f3ecdad4-1b93-44b4-a107-c4bd968a5f56 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:58.464318 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-f3ecdad4-1b93-44b4-a107-c4bd968a5f56 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:58.477819 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-f3ecdad4-1b93-44b4-a107-c4bd968a5f56 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:58.482257 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-f3ecdad4-1b93-44b4-a107-c4bd968a5f56 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:58.483425 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-f3ecdad4-1b93-44b4-a107-c4bd968a5f56 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.266431 Dec 16 15:04:58.484003 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 578/1143] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:04:58 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:04:58.709848 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-3cb69888-8986-43ff-a3f1-8a23d53c1790 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:04:58.710500 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-3cb69888-8986-43ff-a3f1-8a23d53c1790 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:04:58.718375 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3cb69888-8986-43ff-a3f1-8a23d53c1790 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:58.718889 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3cb69888-8986-43ff-a3f1-8a23d53c1790 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:58.719737 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3cb69888-8986-43ff-a3f1-8a23d53c1790 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:58.720237 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3cb69888-8986-43ff-a3f1-8a23d53c1790 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:58.937162 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-3cb69888-8986-43ff-a3f1-8a23d53c1790 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:58.946883 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-3cb69888-8986-43ff-a3f1-8a23d53c1790 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.245878 Dec 16 15:04:58.947473 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 566/1144] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:04:58 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:04:59.507046 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-a10c381c-c33c-4000-9cb5-feffbd8e3f1e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:04:59.507753 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-a10c381c-c33c-4000-9cb5-feffbd8e3f1e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:04:59.515364 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a10c381c-c33c-4000-9cb5-feffbd8e3f1e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:59.515899 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a10c381c-c33c-4000-9cb5-feffbd8e3f1e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:59.516712 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a10c381c-c33c-4000-9cb5-feffbd8e3f1e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:59.517208 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a10c381c-c33c-4000-9cb5-feffbd8e3f1e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:59.744092 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-a10c381c-c33c-4000-9cb5-feffbd8e3f1e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:59.756766 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-a10c381c-c33c-4000-9cb5-feffbd8e3f1e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:59.761200 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-a10c381c-c33c-4000-9cb5-feffbd8e3f1e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:04:59.762407 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-a10c381c-c33c-4000-9cb5-feffbd8e3f1e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.263556 Dec 16 15:04:59.762993 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 579/1145] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:04:59 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:04:59.968763 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-4d8331a2-3b5b-4307-b227-5773e2b89d6f tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:04:59.969386 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-4d8331a2-3b5b-4307-b227-5773e2b89d6f tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:04:59.977805 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4d8331a2-3b5b-4307-b227-5773e2b89d6f tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:59.978344 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4d8331a2-3b5b-4307-b227-5773e2b89d6f tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:04:59.979172 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4d8331a2-3b5b-4307-b227-5773e2b89d6f tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:04:59.979659 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4d8331a2-3b5b-4307-b227-5773e2b89d6f tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:00.193663 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-4d8331a2-3b5b-4307-b227-5773e2b89d6f tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:00.202771 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-4d8331a2-3b5b-4307-b227-5773e2b89d6f tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.241797 Dec 16 15:05:00.203363 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 567/1146] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:04:59 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:05:00.785321 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-12d4db77-c448-4886-8348-25672cf79611 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:05:00.785991 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-12d4db77-c448-4886-8348-25672cf79611 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:05:00.793896 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-12d4db77-c448-4886-8348-25672cf79611 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:00.794449 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-12d4db77-c448-4886-8348-25672cf79611 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:00.795286 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-12d4db77-c448-4886-8348-25672cf79611 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:00.795780 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-12d4db77-c448-4886-8348-25672cf79611 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:01.013071 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-12d4db77-c448-4886-8348-25672cf79611 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:01.025858 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-12d4db77-c448-4886-8348-25672cf79611 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:01.030382 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-12d4db77-c448-4886-8348-25672cf79611 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:01.031548 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-12d4db77-c448-4886-8348-25672cf79611 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.253941 Dec 16 15:05:01.032128 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 580/1147] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:05:00 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:05:01.225213 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-8689c289-b351-480b-b55a-0086b848e75e tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:05:01.225884 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-8689c289-b351-480b-b55a-0086b848e75e tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:05:01.233610 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8689c289-b351-480b-b55a-0086b848e75e tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:01.234166 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8689c289-b351-480b-b55a-0086b848e75e tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:01.235000 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8689c289-b351-480b-b55a-0086b848e75e tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:01.235501 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8689c289-b351-480b-b55a-0086b848e75e tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:01.508680 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-8689c289-b351-480b-b55a-0086b848e75e tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:01.508680 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-8689c289-b351-480b-b55a-0086b848e75e tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.244703 Dec 16 15:05:01.508680 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 568/1148] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:05:01 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:05:02.056975 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-a43a783d-a742-4f59-b465-1650bf42ab5c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:05:02.057641 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-a43a783d-a742-4f59-b465-1650bf42ab5c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:05:02.065390 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a43a783d-a742-4f59-b465-1650bf42ab5c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:02.065895 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a43a783d-a742-4f59-b465-1650bf42ab5c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:02.066762 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a43a783d-a742-4f59-b465-1650bf42ab5c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:02.067254 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a43a783d-a742-4f59-b465-1650bf42ab5c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:02.284422 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-a43a783d-a742-4f59-b465-1650bf42ab5c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:02.297191 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-a43a783d-a742-4f59-b465-1650bf42ab5c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:02.301788 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-a43a783d-a742-4f59-b465-1650bf42ab5c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:02.302999 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-a43a783d-a742-4f59-b465-1650bf42ab5c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.254156 Dec 16 15:05:02.303587 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 581/1149] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:05:02 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:05:02.485538 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-9eba700c-fea6-4dcb-a1fc-0469ee8d4ded tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:05:02.486205 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-9eba700c-fea6-4dcb-a1fc-0469ee8d4ded tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:05:02.494192 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9eba700c-fea6-4dcb-a1fc-0469ee8d4ded tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:02.494694 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9eba700c-fea6-4dcb-a1fc-0469ee8d4ded tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:02.495523 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9eba700c-fea6-4dcb-a1fc-0469ee8d4ded tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:02.496009 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9eba700c-fea6-4dcb-a1fc-0469ee8d4ded tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:02.721846 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-9eba700c-fea6-4dcb-a1fc-0469ee8d4ded tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:02.730563 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-9eba700c-fea6-4dcb-a1fc-0469ee8d4ded tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.252690 Dec 16 15:05:02.731158 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 569/1150] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:05:02 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:05:03.326064 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-988343bc-f4a1-4416-9a74-ce02d63d69b5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:05:03.326744 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-988343bc-f4a1-4416-9a74-ce02d63d69b5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:05:03.334740 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-988343bc-f4a1-4416-9a74-ce02d63d69b5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:03.335260 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-988343bc-f4a1-4416-9a74-ce02d63d69b5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:03.336131 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-988343bc-f4a1-4416-9a74-ce02d63d69b5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:03.336668 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-988343bc-f4a1-4416-9a74-ce02d63d69b5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:03.633110 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-988343bc-f4a1-4416-9a74-ce02d63d69b5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:03.646092 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-988343bc-f4a1-4416-9a74-ce02d63d69b5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:03.650574 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-988343bc-f4a1-4416-9a74-ce02d63d69b5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:03.651778 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-988343bc-f4a1-4416-9a74-ce02d63d69b5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.333853 Dec 16 15:05:03.652366 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 582/1151] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:05:03 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:05:03.752626 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-60afa306-0c49-4504-ad92-86ad4ad7e0d7 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:05:03.753295 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-60afa306-0c49-4504-ad92-86ad4ad7e0d7 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:05:03.761180 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-60afa306-0c49-4504-ad92-86ad4ad7e0d7 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:03.761696 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-60afa306-0c49-4504-ad92-86ad4ad7e0d7 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:03.762566 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-60afa306-0c49-4504-ad92-86ad4ad7e0d7 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:03.763066 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-60afa306-0c49-4504-ad92-86ad4ad7e0d7 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:04.155522 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-60afa306-0c49-4504-ad92-86ad4ad7e0d7 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:04.164797 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-60afa306-0c49-4504-ad92-86ad4ad7e0d7 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.420091 Dec 16 15:05:04.165389 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 570/1152] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:05:03 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:05:04.676143 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-907ff7ac-7c2c-4c8e-8d8c-d497263bf7bd tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:05:04.676818 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-907ff7ac-7c2c-4c8e-8d8c-d497263bf7bd tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:05:04.684736 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-907ff7ac-7c2c-4c8e-8d8c-d497263bf7bd tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:04.685196 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-907ff7ac-7c2c-4c8e-8d8c-d497263bf7bd tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:04.686033 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-907ff7ac-7c2c-4c8e-8d8c-d497263bf7bd tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:04.686552 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-907ff7ac-7c2c-4c8e-8d8c-d497263bf7bd tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:04.900131 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-907ff7ac-7c2c-4c8e-8d8c-d497263bf7bd tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:04.913258 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-907ff7ac-7c2c-4c8e-8d8c-d497263bf7bd tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:04.917667 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-907ff7ac-7c2c-4c8e-8d8c-d497263bf7bd tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:04.918885 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-907ff7ac-7c2c-4c8e-8d8c-d497263bf7bd tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.251081 Dec 16 15:05:04.919463 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 583/1153] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:05:04 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:05:05.187130 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-22585855-9bfb-4cf2-8794-6b78c4a4f7e7 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:05:05.187842 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-22585855-9bfb-4cf2-8794-6b78c4a4f7e7 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:05:05.195894 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-22585855-9bfb-4cf2-8794-6b78c4a4f7e7 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:05.196406 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-22585855-9bfb-4cf2-8794-6b78c4a4f7e7 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:05.197245 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-22585855-9bfb-4cf2-8794-6b78c4a4f7e7 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:05.197738 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-22585855-9bfb-4cf2-8794-6b78c4a4f7e7 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:05.490829 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-22585855-9bfb-4cf2-8794-6b78c4a4f7e7 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:05.499742 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-22585855-9bfb-4cf2-8794-6b78c4a4f7e7 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.320343 Dec 16 15:05:05.500340 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 571/1154] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:05:05 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:05:05.944257 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-226c17d8-f684-48d6-bc4b-05ab36df9569 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:05:05.944967 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-226c17d8-f684-48d6-bc4b-05ab36df9569 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:05:05.953044 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-226c17d8-f684-48d6-bc4b-05ab36df9569 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:05.953551 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-226c17d8-f684-48d6-bc4b-05ab36df9569 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:05.954418 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-226c17d8-f684-48d6-bc4b-05ab36df9569 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:05.955011 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-226c17d8-f684-48d6-bc4b-05ab36df9569 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:06.189818 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-226c17d8-f684-48d6-bc4b-05ab36df9569 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:06.203109 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-226c17d8-f684-48d6-bc4b-05ab36df9569 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:06.207543 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-226c17d8-f684-48d6-bc4b-05ab36df9569 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:06.208717 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-226c17d8-f684-48d6-bc4b-05ab36df9569 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.272922 Dec 16 15:05:06.209295 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 584/1155] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:05:05 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:05:06.521857 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-9481b8b6-bbe6-4e09-98c5-a8c20d4a72ab tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:05:06.522555 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-9481b8b6-bbe6-4e09-98c5-a8c20d4a72ab tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:05:06.530325 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9481b8b6-bbe6-4e09-98c5-a8c20d4a72ab tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:06.530834 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9481b8b6-bbe6-4e09-98c5-a8c20d4a72ab tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:06.531669 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9481b8b6-bbe6-4e09-98c5-a8c20d4a72ab tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:06.532158 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9481b8b6-bbe6-4e09-98c5-a8c20d4a72ab tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:06.747540 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-9481b8b6-bbe6-4e09-98c5-a8c20d4a72ab tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:06.757069 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-9481b8b6-bbe6-4e09-98c5-a8c20d4a72ab tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.242837 Dec 16 15:05:06.757664 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 572/1156] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:05:06 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:05:07.231960 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-908940b6-0327-4d77-8c99-457b42748e2d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:05:07.232636 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-908940b6-0327-4d77-8c99-457b42748e2d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:05:07.240536 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-908940b6-0327-4d77-8c99-457b42748e2d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:07.241049 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-908940b6-0327-4d77-8c99-457b42748e2d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:07.241900 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-908940b6-0327-4d77-8c99-457b42748e2d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:07.242426 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-908940b6-0327-4d77-8c99-457b42748e2d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:07.458432 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-908940b6-0327-4d77-8c99-457b42748e2d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:07.471168 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-908940b6-0327-4d77-8c99-457b42748e2d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:07.475609 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-908940b6-0327-4d77-8c99-457b42748e2d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:07.476792 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-908940b6-0327-4d77-8c99-457b42748e2d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.252641 Dec 16 15:05:07.477378 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 585/1157] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:05:07 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:05:07.780790 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-f2e31577-d76a-4927-ba0b-70d488b468bf tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:05:07.781465 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-f2e31577-d76a-4927-ba0b-70d488b468bf tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:05:07.790386 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f2e31577-d76a-4927-ba0b-70d488b468bf tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:07.790959 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f2e31577-d76a-4927-ba0b-70d488b468bf tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:07.791854 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f2e31577-d76a-4927-ba0b-70d488b468bf tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:07.792395 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f2e31577-d76a-4927-ba0b-70d488b468bf tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:08.006748 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-f2e31577-d76a-4927-ba0b-70d488b468bf tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:08.015749 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-f2e31577-d76a-4927-ba0b-70d488b468bf tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.242829 Dec 16 15:05:08.016471 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 573/1158] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:05:07 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:05:08.503234 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-7b35a7ff-1cc3-46eb-8299-3c81527f0e7a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:05:08.503908 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-7b35a7ff-1cc3-46eb-8299-3c81527f0e7a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:05:08.511922 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7b35a7ff-1cc3-46eb-8299-3c81527f0e7a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:08.512435 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7b35a7ff-1cc3-46eb-8299-3c81527f0e7a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:08.513275 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7b35a7ff-1cc3-46eb-8299-3c81527f0e7a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:08.513769 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7b35a7ff-1cc3-46eb-8299-3c81527f0e7a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:08.731140 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-7b35a7ff-1cc3-46eb-8299-3c81527f0e7a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:08.744001 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-7b35a7ff-1cc3-46eb-8299-3c81527f0e7a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:08.748509 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-7b35a7ff-1cc3-46eb-8299-3c81527f0e7a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:08.749688 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-7b35a7ff-1cc3-46eb-8299-3c81527f0e7a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.257584 Dec 16 15:05:08.750291 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 586/1159] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:05:08 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:05:09.038384 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-58163298-ef34-491d-82f6-8869ba568e0e tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:05:09.039060 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-58163298-ef34-491d-82f6-8869ba568e0e tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:05:09.046861 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-58163298-ef34-491d-82f6-8869ba568e0e tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:09.047374 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-58163298-ef34-491d-82f6-8869ba568e0e tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:09.048219 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-58163298-ef34-491d-82f6-8869ba568e0e tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:09.049227 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-58163298-ef34-491d-82f6-8869ba568e0e tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:09.259675 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-58163298-ef34-491d-82f6-8869ba568e0e tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:09.269166 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-58163298-ef34-491d-82f6-8869ba568e0e tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.238456 Dec 16 15:05:09.269756 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 574/1160] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:05:09 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:05:09.772918 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-aa054ebc-55c7-49d1-9458-19d160ac48f9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:05:09.773562 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-aa054ebc-55c7-49d1-9458-19d160ac48f9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:05:09.781767 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-aa054ebc-55c7-49d1-9458-19d160ac48f9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:09.782333 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-aa054ebc-55c7-49d1-9458-19d160ac48f9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:09.783277 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-aa054ebc-55c7-49d1-9458-19d160ac48f9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:09.783772 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-aa054ebc-55c7-49d1-9458-19d160ac48f9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:10.009131 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-aa054ebc-55c7-49d1-9458-19d160ac48f9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:10.021868 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-aa054ebc-55c7-49d1-9458-19d160ac48f9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:10.026400 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-aa054ebc-55c7-49d1-9458-19d160ac48f9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:10.027591 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-aa054ebc-55c7-49d1-9458-19d160ac48f9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.262573 Dec 16 15:05:10.028168 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 587/1161] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:05:09 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:05:10.290700 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-df7d9bc1-20a5-4d74-9310-db8b280d0a8a tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:05:10.291382 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-df7d9bc1-20a5-4d74-9310-db8b280d0a8a tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:05:10.294586 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 15:05:10.294725 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: Thu Dec 16 15:05:10 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 (ip 10.222.0.45) !!! Dec 16 15:05:10.317165 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-df7d9bc1-20a5-4d74-9310-db8b280d0a8a tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:10.317675 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-df7d9bc1-20a5-4d74-9310-db8b280d0a8a tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:10.318560 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-df7d9bc1-20a5-4d74-9310-db8b280d0a8a tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:10.319321 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-df7d9bc1-20a5-4d74-9310-db8b280d0a8a tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:10.539263 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-df7d9bc1-20a5-4d74-9310-db8b280d0a8a tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:10.548845 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-df7d9bc1-20a5-4d74-9310-db8b280d0a8a tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.265251 Dec 16 15:05:10.549445 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 575/1162] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:05:10 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:05:11.051302 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-61dca4e5-1a6e-4a55-9e04-cdef07999f6e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:05:11.051988 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-61dca4e5-1a6e-4a55-9e04-cdef07999f6e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:05:11.059803 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-61dca4e5-1a6e-4a55-9e04-cdef07999f6e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:11.060303 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-61dca4e5-1a6e-4a55-9e04-cdef07999f6e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:11.061143 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-61dca4e5-1a6e-4a55-9e04-cdef07999f6e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:11.061634 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-61dca4e5-1a6e-4a55-9e04-cdef07999f6e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:11.290008 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-61dca4e5-1a6e-4a55-9e04-cdef07999f6e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:11.302786 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-61dca4e5-1a6e-4a55-9e04-cdef07999f6e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:11.307312 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-61dca4e5-1a6e-4a55-9e04-cdef07999f6e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:11.308706 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-61dca4e5-1a6e-4a55-9e04-cdef07999f6e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.265665 Dec 16 15:05:11.309240 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 588/1163] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:05:11 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:05:11.571563 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-0d55431b-70fa-408c-b0e0-a9fa4efc7fb2 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:05:11.572156 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-0d55431b-70fa-408c-b0e0-a9fa4efc7fb2 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:05:11.580534 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0d55431b-70fa-408c-b0e0-a9fa4efc7fb2 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:11.581045 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0d55431b-70fa-408c-b0e0-a9fa4efc7fb2 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:11.581882 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0d55431b-70fa-408c-b0e0-a9fa4efc7fb2 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:11.582549 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0d55431b-70fa-408c-b0e0-a9fa4efc7fb2 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:11.793759 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-0d55431b-70fa-408c-b0e0-a9fa4efc7fb2 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:11.803200 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-0d55431b-70fa-408c-b0e0-a9fa4efc7fb2 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.240283 Dec 16 15:05:11.803791 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 576/1164] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:05:11 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:05:12.331818 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-da30cf2e-13db-4875-a7c6-189bf41f66ad tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:05:12.332473 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-da30cf2e-13db-4875-a7c6-189bf41f66ad tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:05:12.340351 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-da30cf2e-13db-4875-a7c6-189bf41f66ad tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:12.340854 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-da30cf2e-13db-4875-a7c6-189bf41f66ad tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:12.341680 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-da30cf2e-13db-4875-a7c6-189bf41f66ad tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:12.342186 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-da30cf2e-13db-4875-a7c6-189bf41f66ad tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:12.556373 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-da30cf2e-13db-4875-a7c6-189bf41f66ad tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:12.569219 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-da30cf2e-13db-4875-a7c6-189bf41f66ad tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:12.573984 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-da30cf2e-13db-4875-a7c6-189bf41f66ad tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:12.575188 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-da30cf2e-13db-4875-a7c6-189bf41f66ad tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.251789 Dec 16 15:05:12.575775 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 589/1165] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:05:12 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:05:12.824919 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-d47f8ef4-9dcb-40c1-a1a3-0a2ddce245d2 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:05:12.825591 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-d47f8ef4-9dcb-40c1-a1a3-0a2ddce245d2 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:05:12.834095 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d47f8ef4-9dcb-40c1-a1a3-0a2ddce245d2 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:12.834609 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d47f8ef4-9dcb-40c1-a1a3-0a2ddce245d2 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:12.835475 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d47f8ef4-9dcb-40c1-a1a3-0a2ddce245d2 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:12.835942 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d47f8ef4-9dcb-40c1-a1a3-0a2ddce245d2 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:13.054517 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-d47f8ef4-9dcb-40c1-a1a3-0a2ddce245d2 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:13.063535 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-d47f8ef4-9dcb-40c1-a1a3-0a2ddce245d2 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.246543 Dec 16 15:05:13.064640 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 577/1166] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:05:12 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:05:13.598210 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-095838c4-1ea0-4c2b-b491-07b9fa295c3f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:05:13.598877 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-095838c4-1ea0-4c2b-b491-07b9fa295c3f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:05:13.606748 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-095838c4-1ea0-4c2b-b491-07b9fa295c3f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:13.607254 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-095838c4-1ea0-4c2b-b491-07b9fa295c3f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:13.608080 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-095838c4-1ea0-4c2b-b491-07b9fa295c3f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:13.608574 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-095838c4-1ea0-4c2b-b491-07b9fa295c3f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:13.830296 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-095838c4-1ea0-4c2b-b491-07b9fa295c3f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:13.842270 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-095838c4-1ea0-4c2b-b491-07b9fa295c3f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:13.847330 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-095838c4-1ea0-4c2b-b491-07b9fa295c3f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:13.848592 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-095838c4-1ea0-4c2b-b491-07b9fa295c3f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.257977 Dec 16 15:05:13.849171 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 590/1167] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:05:13 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:05:14.086229 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-09312c89-ac98-482c-b4eb-023e09d93d29 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:05:14.086902 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-09312c89-ac98-482c-b4eb-023e09d93d29 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:05:14.094894 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-09312c89-ac98-482c-b4eb-023e09d93d29 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:14.096050 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-09312c89-ac98-482c-b4eb-023e09d93d29 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:14.096971 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-09312c89-ac98-482c-b4eb-023e09d93d29 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:14.097472 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-09312c89-ac98-482c-b4eb-023e09d93d29 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:14.323450 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-09312c89-ac98-482c-b4eb-023e09d93d29 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:14.333273 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-09312c89-ac98-482c-b4eb-023e09d93d29 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.254848 Dec 16 15:05:14.338901 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 578/1168] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:05:14 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:05:14.871750 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-c8603be4-77eb-4bed-9eec-6ecf6cd3a87a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:05:14.872418 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-c8603be4-77eb-4bed-9eec-6ecf6cd3a87a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:05:14.880800 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c8603be4-77eb-4bed-9eec-6ecf6cd3a87a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:14.881302 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c8603be4-77eb-4bed-9eec-6ecf6cd3a87a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:14.882157 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c8603be4-77eb-4bed-9eec-6ecf6cd3a87a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:14.882648 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c8603be4-77eb-4bed-9eec-6ecf6cd3a87a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:15.102120 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-c8603be4-77eb-4bed-9eec-6ecf6cd3a87a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:15.115336 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-c8603be4-77eb-4bed-9eec-6ecf6cd3a87a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:15.119837 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-c8603be4-77eb-4bed-9eec-6ecf6cd3a87a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:15.121037 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-c8603be4-77eb-4bed-9eec-6ecf6cd3a87a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.256939 Dec 16 15:05:15.121619 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 591/1169] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:05:14 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:05:15.356214 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-25a2f62b-9c42-4bb1-88fd-17369bef33ff tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:05:15.356878 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-25a2f62b-9c42-4bb1-88fd-17369bef33ff tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:05:15.370484 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-25a2f62b-9c42-4bb1-88fd-17369bef33ff tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:15.371000 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-25a2f62b-9c42-4bb1-88fd-17369bef33ff tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:15.371981 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-25a2f62b-9c42-4bb1-88fd-17369bef33ff tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:15.372481 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-25a2f62b-9c42-4bb1-88fd-17369bef33ff tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:15.585158 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-25a2f62b-9c42-4bb1-88fd-17369bef33ff tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:15.594075 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-25a2f62b-9c42-4bb1-88fd-17369bef33ff tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.245652 Dec 16 15:05:15.594672 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 579/1170] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:05:15 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:05:16.147338 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-3fca1fcd-524c-4f26-8675-d2f3f26915a2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:05:16.148010 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-3fca1fcd-524c-4f26-8675-d2f3f26915a2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:05:16.156764 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3fca1fcd-524c-4f26-8675-d2f3f26915a2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:16.157706 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3fca1fcd-524c-4f26-8675-d2f3f26915a2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:16.158853 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3fca1fcd-524c-4f26-8675-d2f3f26915a2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:16.159345 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3fca1fcd-524c-4f26-8675-d2f3f26915a2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:16.379015 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-3fca1fcd-524c-4f26-8675-d2f3f26915a2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:16.393153 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-3fca1fcd-524c-4f26-8675-d2f3f26915a2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:16.397592 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-3fca1fcd-524c-4f26-8675-d2f3f26915a2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:16.398807 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-3fca1fcd-524c-4f26-8675-d2f3f26915a2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.261246 Dec 16 15:05:16.399387 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 592/1171] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:05:16 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:05:16.615895 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-94aa505b-8bfe-4135-9d58-51afac7b1513 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:05:16.616567 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-94aa505b-8bfe-4135-9d58-51afac7b1513 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:05:16.624420 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-94aa505b-8bfe-4135-9d58-51afac7b1513 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:16.624930 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-94aa505b-8bfe-4135-9d58-51afac7b1513 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:16.625773 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-94aa505b-8bfe-4135-9d58-51afac7b1513 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:16.626884 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-94aa505b-8bfe-4135-9d58-51afac7b1513 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:16.837666 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-94aa505b-8bfe-4135-9d58-51afac7b1513 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:16.847058 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-94aa505b-8bfe-4135-9d58-51afac7b1513 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.239385 Dec 16 15:05:16.847653 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 580/1172] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:05:16 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:05:17.421166 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-b9923f2a-5d6d-4c4d-9699-2dcf8cb00fc8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:05:17.421833 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-b9923f2a-5d6d-4c4d-9699-2dcf8cb00fc8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:05:17.429727 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b9923f2a-5d6d-4c4d-9699-2dcf8cb00fc8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:17.430277 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b9923f2a-5d6d-4c4d-9699-2dcf8cb00fc8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:17.431123 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b9923f2a-5d6d-4c4d-9699-2dcf8cb00fc8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:17.431616 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b9923f2a-5d6d-4c4d-9699-2dcf8cb00fc8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:17.654697 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-b9923f2a-5d6d-4c4d-9699-2dcf8cb00fc8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:17.667345 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-b9923f2a-5d6d-4c4d-9699-2dcf8cb00fc8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:17.671813 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-b9923f2a-5d6d-4c4d-9699-2dcf8cb00fc8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:17.673031 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-b9923f2a-5d6d-4c4d-9699-2dcf8cb00fc8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.259603 Dec 16 15:05:17.673575 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 593/1173] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:05:17 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:05:17.868989 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-f1480b6a-2260-45ca-ae1b-7896ec8aa059 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:05:17.869710 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-f1480b6a-2260-45ca-ae1b-7896ec8aa059 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:05:17.878098 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f1480b6a-2260-45ca-ae1b-7896ec8aa059 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:17.878614 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f1480b6a-2260-45ca-ae1b-7896ec8aa059 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:17.879487 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f1480b6a-2260-45ca-ae1b-7896ec8aa059 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:17.879962 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f1480b6a-2260-45ca-ae1b-7896ec8aa059 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:18.094354 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-f1480b6a-2260-45ca-ae1b-7896ec8aa059 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:18.103188 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-f1480b6a-2260-45ca-ae1b-7896ec8aa059 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.242005 Dec 16 15:05:18.103786 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 581/1174] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:05:17 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:05:18.696287 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-aed54d9a-096a-408a-b5df-d01b43b44b4a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:05:18.696956 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-aed54d9a-096a-408a-b5df-d01b43b44b4a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:05:18.705292 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-aed54d9a-096a-408a-b5df-d01b43b44b4a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:18.705796 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-aed54d9a-096a-408a-b5df-d01b43b44b4a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:18.706664 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-aed54d9a-096a-408a-b5df-d01b43b44b4a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:18.707152 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-aed54d9a-096a-408a-b5df-d01b43b44b4a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:18.941397 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-aed54d9a-096a-408a-b5df-d01b43b44b4a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:18.954429 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-aed54d9a-096a-408a-b5df-d01b43b44b4a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:18.958825 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-aed54d9a-096a-408a-b5df-d01b43b44b4a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:18.960027 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-aed54d9a-096a-408a-b5df-d01b43b44b4a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.271821 Dec 16 15:05:18.960580 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 594/1175] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:05:18 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:05:19.126210 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-793f73e4-e39d-4bf3-9975-b1aa9fe3ba0d tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:05:19.127041 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-793f73e4-e39d-4bf3-9975-b1aa9fe3ba0d tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:05:19.134818 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-793f73e4-e39d-4bf3-9975-b1aa9fe3ba0d tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:19.135371 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-793f73e4-e39d-4bf3-9975-b1aa9fe3ba0d tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:19.136227 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-793f73e4-e39d-4bf3-9975-b1aa9fe3ba0d tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:19.136727 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-793f73e4-e39d-4bf3-9975-b1aa9fe3ba0d tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:19.359008 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-793f73e4-e39d-4bf3-9975-b1aa9fe3ba0d tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:19.370139 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-793f73e4-e39d-4bf3-9975-b1aa9fe3ba0d tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.251594 Dec 16 15:05:19.371034 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 582/1176] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:05:19 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:05:19.983387 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-68825216-3e0d-44a5-aa01-9603b65b9444 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:05:19.983991 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-68825216-3e0d-44a5-aa01-9603b65b9444 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:05:19.992588 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-68825216-3e0d-44a5-aa01-9603b65b9444 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:19.993096 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-68825216-3e0d-44a5-aa01-9603b65b9444 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:19.993977 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-68825216-3e0d-44a5-aa01-9603b65b9444 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:19.994500 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-68825216-3e0d-44a5-aa01-9603b65b9444 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:20.208637 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-68825216-3e0d-44a5-aa01-9603b65b9444 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:20.221911 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-68825216-3e0d-44a5-aa01-9603b65b9444 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:20.226384 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-68825216-3e0d-44a5-aa01-9603b65b9444 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:20.227549 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-68825216-3e0d-44a5-aa01-9603b65b9444 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.251855 Dec 16 15:05:20.228132 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 595/1177] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:05:19 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:05:20.393151 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-48ce9cf2-7331-4272-8826-8b80d17daac8 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:05:20.393826 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-48ce9cf2-7331-4272-8826-8b80d17daac8 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:05:20.401651 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-48ce9cf2-7331-4272-8826-8b80d17daac8 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:20.402193 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-48ce9cf2-7331-4272-8826-8b80d17daac8 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:20.403041 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-48ce9cf2-7331-4272-8826-8b80d17daac8 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:20.403543 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-48ce9cf2-7331-4272-8826-8b80d17daac8 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:20.617361 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-48ce9cf2-7331-4272-8826-8b80d17daac8 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:20.626088 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-48ce9cf2-7331-4272-8826-8b80d17daac8 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.241208 Dec 16 15:05:20.627194 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 583/1178] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:05:20 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:05:21.249751 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-e80a303a-9116-44c9-96aa-508285df761f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:05:21.250378 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-e80a303a-9116-44c9-96aa-508285df761f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:05:21.259413 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e80a303a-9116-44c9-96aa-508285df761f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:21.259413 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e80a303a-9116-44c9-96aa-508285df761f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:21.260267 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e80a303a-9116-44c9-96aa-508285df761f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:21.260911 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e80a303a-9116-44c9-96aa-508285df761f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:21.486680 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-e80a303a-9116-44c9-96aa-508285df761f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:21.499693 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-e80a303a-9116-44c9-96aa-508285df761f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:21.504259 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-e80a303a-9116-44c9-96aa-508285df761f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:21.505390 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-e80a303a-9116-44c9-96aa-508285df761f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.263473 Dec 16 15:05:21.505977 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 596/1179] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:05:21 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:05:21.648497 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-c7163208-94a6-4709-b2c5-a429befe75f2 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:05:21.649197 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-c7163208-94a6-4709-b2c5-a429befe75f2 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:05:21.657206 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c7163208-94a6-4709-b2c5-a429befe75f2 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:21.658258 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c7163208-94a6-4709-b2c5-a429befe75f2 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:21.659108 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c7163208-94a6-4709-b2c5-a429befe75f2 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:21.659608 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c7163208-94a6-4709-b2c5-a429befe75f2 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:21.880310 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-c7163208-94a6-4709-b2c5-a429befe75f2 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:21.889401 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-c7163208-94a6-4709-b2c5-a429befe75f2 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.248494 Dec 16 15:05:21.889992 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 584/1180] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:05:21 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:05:22.625664 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-cccb9984-e862-47f2-b0ca-cf8fdf5cf8e5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:05:22.626369 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-cccb9984-e862-47f2-b0ca-cf8fdf5cf8e5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:05:22.634414 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cccb9984-e862-47f2-b0ca-cf8fdf5cf8e5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:22.634924 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cccb9984-e862-47f2-b0ca-cf8fdf5cf8e5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:22.635764 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cccb9984-e862-47f2-b0ca-cf8fdf5cf8e5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:22.636262 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cccb9984-e862-47f2-b0ca-cf8fdf5cf8e5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:22.851222 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-cccb9984-e862-47f2-b0ca-cf8fdf5cf8e5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:22.863841 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-cccb9984-e862-47f2-b0ca-cf8fdf5cf8e5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:22.868615 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-cccb9984-e862-47f2-b0ca-cf8fdf5cf8e5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:22.869794 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-cccb9984-e862-47f2-b0ca-cf8fdf5cf8e5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.348922 Dec 16 15:05:22.870406 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 597/1181] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:05:22 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:05:22.911686 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-1ffcf418-f079-444f-bd00-4daf9e3761db tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:05:22.912586 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-1ffcf418-f079-444f-bd00-4daf9e3761db tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:05:22.920473 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1ffcf418-f079-444f-bd00-4daf9e3761db tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:22.920988 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1ffcf418-f079-444f-bd00-4daf9e3761db tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:22.921816 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1ffcf418-f079-444f-bd00-4daf9e3761db tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:22.922318 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1ffcf418-f079-444f-bd00-4daf9e3761db tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:23.136328 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-1ffcf418-f079-444f-bd00-4daf9e3761db tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:23.147565 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-1ffcf418-f079-444f-bd00-4daf9e3761db tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.243286 Dec 16 15:05:23.148196 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 585/1182] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:05:22 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:05:23.894663 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-5d1d62e9-0ac7-442a-8448-c3c0b7ee49ad tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:05:23.895325 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-5d1d62e9-0ac7-442a-8448-c3c0b7ee49ad tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:05:23.903050 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5d1d62e9-0ac7-442a-8448-c3c0b7ee49ad tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:23.903552 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5d1d62e9-0ac7-442a-8448-c3c0b7ee49ad tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:23.904379 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5d1d62e9-0ac7-442a-8448-c3c0b7ee49ad tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:23.904862 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5d1d62e9-0ac7-442a-8448-c3c0b7ee49ad tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:24.120638 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-5d1d62e9-0ac7-442a-8448-c3c0b7ee49ad tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:24.133411 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-5d1d62e9-0ac7-442a-8448-c3c0b7ee49ad tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:24.137817 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-5d1d62e9-0ac7-442a-8448-c3c0b7ee49ad tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:24.139006 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-5d1d62e9-0ac7-442a-8448-c3c0b7ee49ad tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.253431 Dec 16 15:05:24.139584 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 598/1183] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:05:23 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:05:24.169995 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-f5a011f7-a31b-4d34-a10f-68295a96d880 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:05:24.170698 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-f5a011f7-a31b-4d34-a10f-68295a96d880 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:05:24.180000 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f5a011f7-a31b-4d34-a10f-68295a96d880 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:24.180514 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f5a011f7-a31b-4d34-a10f-68295a96d880 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:24.181372 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f5a011f7-a31b-4d34-a10f-68295a96d880 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:24.181867 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f5a011f7-a31b-4d34-a10f-68295a96d880 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:24.397819 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-f5a011f7-a31b-4d34-a10f-68295a96d880 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:24.406658 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-f5a011f7-a31b-4d34-a10f-68295a96d880 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.244307 Dec 16 15:05:24.407256 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 586/1184] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:05:24 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:05:25.163089 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-81ade477-97d5-45a6-a428-52d45c0214ea tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:05:25.163759 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-81ade477-97d5-45a6-a428-52d45c0214ea tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:05:25.171394 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-81ade477-97d5-45a6-a428-52d45c0214ea tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:25.171900 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-81ade477-97d5-45a6-a428-52d45c0214ea tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:25.172737 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-81ade477-97d5-45a6-a428-52d45c0214ea tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:25.175828 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-81ade477-97d5-45a6-a428-52d45c0214ea tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:25.403443 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-81ade477-97d5-45a6-a428-52d45c0214ea tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:25.416546 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-81ade477-97d5-45a6-a428-52d45c0214ea tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:25.421036 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-81ade477-97d5-45a6-a428-52d45c0214ea tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:25.422225 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-81ade477-97d5-45a6-a428-52d45c0214ea tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.267419 Dec 16 15:05:25.422958 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 599/1185] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:05:25 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:05:25.428493 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-e277d4ba-2a83-48db-bf54-1144262cf2ba tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:05:25.429191 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-e277d4ba-2a83-48db-bf54-1144262cf2ba tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:05:25.437033 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e277d4ba-2a83-48db-bf54-1144262cf2ba tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:25.437546 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e277d4ba-2a83-48db-bf54-1144262cf2ba tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:25.438444 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e277d4ba-2a83-48db-bf54-1144262cf2ba tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:25.438974 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e277d4ba-2a83-48db-bf54-1144262cf2ba tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:25.655138 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-e277d4ba-2a83-48db-bf54-1144262cf2ba tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:25.664601 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-e277d4ba-2a83-48db-bf54-1144262cf2ba tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.244353 Dec 16 15:05:25.665599 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 587/1186] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:05:25 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:05:26.446360 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-6f08fd29-a935-46da-ac1f-03e68ce8a0d4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:05:26.447036 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-6f08fd29-a935-46da-ac1f-03e68ce8a0d4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:05:26.455351 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6f08fd29-a935-46da-ac1f-03e68ce8a0d4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:26.455871 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6f08fd29-a935-46da-ac1f-03e68ce8a0d4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:26.456709 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6f08fd29-a935-46da-ac1f-03e68ce8a0d4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:26.457189 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6f08fd29-a935-46da-ac1f-03e68ce8a0d4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:26.676102 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-6f08fd29-a935-46da-ac1f-03e68ce8a0d4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:26.687997 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-37fa9b1f-3b5b-4c9c-b17a-c1d511ca9abb tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:05:26.689269 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-37fa9b1f-3b5b-4c9c-b17a-c1d511ca9abb tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:05:26.692498 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 15:05:26.692723 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: Thu Dec 16 15:05:26 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 (ip 10.222.0.45) !!! Dec 16 15:05:26.692857 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-6f08fd29-a935-46da-ac1f-03e68ce8a0d4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:26.697501 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-6f08fd29-a935-46da-ac1f-03e68ce8a0d4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:26.698746 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-6f08fd29-a935-46da-ac1f-03e68ce8a0d4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.260589 Dec 16 15:05:26.699333 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 600/1187] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:05:26 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:05:26.711372 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-37fa9b1f-3b5b-4c9c-b17a-c1d511ca9abb tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:26.711884 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-37fa9b1f-3b5b-4c9c-b17a-c1d511ca9abb tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:26.712732 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-37fa9b1f-3b5b-4c9c-b17a-c1d511ca9abb tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:26.713226 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-37fa9b1f-3b5b-4c9c-b17a-c1d511ca9abb tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:26.924300 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-37fa9b1f-3b5b-4c9c-b17a-c1d511ca9abb tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:26.933799 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-37fa9b1f-3b5b-4c9c-b17a-c1d511ca9abb tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.254500 Dec 16 15:05:26.934356 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 588/1188] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:05:26 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:05:27.723517 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-60c853e7-9a43-421b-bbc3-360e8bf4f6a3 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:05:27.724181 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-60c853e7-9a43-421b-bbc3-360e8bf4f6a3 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:05:27.732114 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-60c853e7-9a43-421b-bbc3-360e8bf4f6a3 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:27.732624 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-60c853e7-9a43-421b-bbc3-360e8bf4f6a3 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:27.733475 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-60c853e7-9a43-421b-bbc3-360e8bf4f6a3 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:27.733955 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-60c853e7-9a43-421b-bbc3-360e8bf4f6a3 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:27.949350 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-60c853e7-9a43-421b-bbc3-360e8bf4f6a3 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:27.956305 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-644e3810-3b4b-4008-ae97-1edd7dab803f tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:05:27.957021 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-644e3810-3b4b-4008-ae97-1edd7dab803f tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:05:27.962807 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-60c853e7-9a43-421b-bbc3-360e8bf4f6a3 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:27.965050 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-644e3810-3b4b-4008-ae97-1edd7dab803f tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:27.965555 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-644e3810-3b4b-4008-ae97-1edd7dab803f tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:27.966427 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-644e3810-3b4b-4008-ae97-1edd7dab803f tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:27.966921 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-644e3810-3b4b-4008-ae97-1edd7dab803f tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:27.967304 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-60c853e7-9a43-421b-bbc3-360e8bf4f6a3 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:27.968475 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-60c853e7-9a43-421b-bbc3-360e8bf4f6a3 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.253206 Dec 16 15:05:27.969057 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 601/1189] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:05:27 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:05:28.183789 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-644e3810-3b4b-4008-ae97-1edd7dab803f tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:28.192644 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-644e3810-3b4b-4008-ae97-1edd7dab803f tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.244549 Dec 16 15:05:28.193240 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 589/1190] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:05:27 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:05:28.993298 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-4890ba7a-c41c-4a94-93d9-00d71b37cddb tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:05:28.993897 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-4890ba7a-c41c-4a94-93d9-00d71b37cddb tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:05:29.001548 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4890ba7a-c41c-4a94-93d9-00d71b37cddb tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:29.002091 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4890ba7a-c41c-4a94-93d9-00d71b37cddb tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:29.002888 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4890ba7a-c41c-4a94-93d9-00d71b37cddb tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:29.003371 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4890ba7a-c41c-4a94-93d9-00d71b37cddb tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:29.215802 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-24a444ce-5ecf-4760-8675-26a0ce609dc6 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:05:29.216481 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-24a444ce-5ecf-4760-8675-26a0ce609dc6 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:05:29.229499 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-24a444ce-5ecf-4760-8675-26a0ce609dc6 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:29.230011 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-24a444ce-5ecf-4760-8675-26a0ce609dc6 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:29.230906 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-24a444ce-5ecf-4760-8675-26a0ce609dc6 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:29.231401 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-24a444ce-5ecf-4760-8675-26a0ce609dc6 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:29.421551 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-4890ba7a-c41c-4a94-93d9-00d71b37cddb tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:29.436075 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-4890ba7a-c41c-4a94-93d9-00d71b37cddb tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:29.440856 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-4890ba7a-c41c-4a94-93d9-00d71b37cddb tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:29.442356 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-4890ba7a-c41c-4a94-93d9-00d71b37cddb tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.457664 Dec 16 15:05:29.443100 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 602/1191] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:05:28 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:05:29.477417 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-24a444ce-5ecf-4760-8675-26a0ce609dc6 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:29.487188 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-24a444ce-5ecf-4760-8675-26a0ce609dc6 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.279340 Dec 16 15:05:29.487793 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 590/1192] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:05:29 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:05:30.467036 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-eab617bf-47aa-41f5-b86e-83695886f098 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:05:30.467708 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-eab617bf-47aa-41f5-b86e-83695886f098 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:05:30.476194 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-eab617bf-47aa-41f5-b86e-83695886f098 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:30.476704 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-eab617bf-47aa-41f5-b86e-83695886f098 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:30.477541 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-eab617bf-47aa-41f5-b86e-83695886f098 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:30.478070 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-eab617bf-47aa-41f5-b86e-83695886f098 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:30.508834 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-438ca32f-cba4-4251-8b2b-3d62c1ae7dcc tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:05:30.509507 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-438ca32f-cba4-4251-8b2b-3d62c1ae7dcc tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:05:30.517469 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-438ca32f-cba4-4251-8b2b-3d62c1ae7dcc tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:30.517980 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-438ca32f-cba4-4251-8b2b-3d62c1ae7dcc tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:30.518888 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-438ca32f-cba4-4251-8b2b-3d62c1ae7dcc tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:30.519389 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-438ca32f-cba4-4251-8b2b-3d62c1ae7dcc tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:30.707251 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-eab617bf-47aa-41f5-b86e-83695886f098 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:30.721336 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-eab617bf-47aa-41f5-b86e-83695886f098 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:30.725832 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-eab617bf-47aa-41f5-b86e-83695886f098 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:30.727215 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-eab617bf-47aa-41f5-b86e-83695886f098 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.267937 Dec 16 15:05:30.727814 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 603/1193] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:05:30 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 15:05:30.745963 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-438ca32f-cba4-4251-8b2b-3d62c1ae7dcc tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:30.754784 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-438ca32f-cba4-4251-8b2b-3d62c1ae7dcc tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.253710 Dec 16 15:05:30.755378 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 591/1194] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:05:30 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:05:31.749691 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-39e1216c-7e16-42bd-b45e-963474097560 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:05:31.750382 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-39e1216c-7e16-42bd-b45e-963474097560 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:05:31.758909 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-39e1216c-7e16-42bd-b45e-963474097560 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:31.759439 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-39e1216c-7e16-42bd-b45e-963474097560 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:31.760286 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-39e1216c-7e16-42bd-b45e-963474097560 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:31.760783 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-39e1216c-7e16-42bd-b45e-963474097560 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:31.777907 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-f9e4fde6-bfec-4e10-8f0a-cb85c22bc481 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:05:31.778606 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-f9e4fde6-bfec-4e10-8f0a-cb85c22bc481 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:05:31.787055 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f9e4fde6-bfec-4e10-8f0a-cb85c22bc481 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:31.787560 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f9e4fde6-bfec-4e10-8f0a-cb85c22bc481 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:31.788392 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f9e4fde6-bfec-4e10-8f0a-cb85c22bc481 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:31.788886 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f9e4fde6-bfec-4e10-8f0a-cb85c22bc481 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:31.981276 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-39e1216c-7e16-42bd-b45e-963474097560 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:31.994000 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-39e1216c-7e16-42bd-b45e-963474097560 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:31.998471 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-39e1216c-7e16-42bd-b45e-963474097560 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:31.999658 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-39e1216c-7e16-42bd-b45e-963474097560 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.257695 Dec 16 15:05:32.000241 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 604/1195] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:05:31 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:05:32.010808 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-f9e4fde6-bfec-4e10-8f0a-cb85c22bc481 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:32.021465 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-f9e4fde6-bfec-4e10-8f0a-cb85c22bc481 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.251045 Dec 16 15:05:32.022106 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 592/1196] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:05:31 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:05:33.023291 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-47d62f7d-b063-43d4-8360-ac75b0aac113 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:05:33.023953 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-47d62f7d-b063-43d4-8360-ac75b0aac113 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:05:33.031766 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-47d62f7d-b063-43d4-8360-ac75b0aac113 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:33.032264 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-47d62f7d-b063-43d4-8360-ac75b0aac113 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:33.033068 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-47d62f7d-b063-43d4-8360-ac75b0aac113 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:33.033547 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-47d62f7d-b063-43d4-8360-ac75b0aac113 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:33.043526 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-b6ec0283-72f8-4c7f-8120-6a5f8cb235d1 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:05:33.044198 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-b6ec0283-72f8-4c7f-8120-6a5f8cb235d1 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:05:33.052526 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b6ec0283-72f8-4c7f-8120-6a5f8cb235d1 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:33.053031 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b6ec0283-72f8-4c7f-8120-6a5f8cb235d1 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:33.053868 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b6ec0283-72f8-4c7f-8120-6a5f8cb235d1 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:33.054382 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b6ec0283-72f8-4c7f-8120-6a5f8cb235d1 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:33.259664 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-47d62f7d-b063-43d4-8360-ac75b0aac113 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:33.272501 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-b6ec0283-72f8-4c7f-8120-6a5f8cb235d1 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:33.272772 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-47d62f7d-b063-43d4-8360-ac75b0aac113 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:33.277250 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-47d62f7d-b063-43d4-8360-ac75b0aac113 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:33.278469 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-47d62f7d-b063-43d4-8360-ac75b0aac113 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.262878 Dec 16 15:05:33.279062 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 605/1197] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:05:33 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:05:33.281596 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-b6ec0283-72f8-4c7f-8120-6a5f8cb235d1 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.245547 Dec 16 15:05:33.282203 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 593/1198] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:05:33 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:05:34.302137 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-56bd92c6-b61a-49e7-babf-bb7416e21a6d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:05:34.302808 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-56bd92c6-b61a-49e7-babf-bb7416e21a6d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:05:34.304010 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-62efc28f-defa-421b-8076-5fb4b38a4b2c tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:05:34.304681 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-62efc28f-defa-421b-8076-5fb4b38a4b2c tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:05:34.310816 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-56bd92c6-b61a-49e7-babf-bb7416e21a6d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:34.311321 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-56bd92c6-b61a-49e7-babf-bb7416e21a6d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:34.312154 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-56bd92c6-b61a-49e7-babf-bb7416e21a6d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:34.312541 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-62efc28f-defa-421b-8076-5fb4b38a4b2c tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:34.312668 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-56bd92c6-b61a-49e7-babf-bb7416e21a6d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:34.313056 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-62efc28f-defa-421b-8076-5fb4b38a4b2c tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:34.313906 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-62efc28f-defa-421b-8076-5fb4b38a4b2c tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:34.315093 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-62efc28f-defa-421b-8076-5fb4b38a4b2c tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:34.537882 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-62efc28f-defa-421b-8076-5fb4b38a4b2c tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:34.538510 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-56bd92c6-b61a-49e7-babf-bb7416e21a6d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:34.546898 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-62efc28f-defa-421b-8076-5fb4b38a4b2c tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.250550 Dec 16 15:05:34.547492 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 594/1199] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:05:34 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:05:34.551844 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-56bd92c6-b61a-49e7-babf-bb7416e21a6d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:34.556330 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-56bd92c6-b61a-49e7-babf-bb7416e21a6d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:34.557520 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-56bd92c6-b61a-49e7-babf-bb7416e21a6d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.263173 Dec 16 15:05:34.558114 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 606/1200] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:05:34 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:05:35.568809 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-287b1f3c-1383-44a4-9be1-ba8a5c83592e tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:05:35.569424 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-287b1f3c-1383-44a4-9be1-ba8a5c83592e tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:05:35.577639 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-287b1f3c-1383-44a4-9be1-ba8a5c83592e tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:35.578206 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-287b1f3c-1383-44a4-9be1-ba8a5c83592e tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:35.579051 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-287b1f3c-1383-44a4-9be1-ba8a5c83592e tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:35.579552 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-287b1f3c-1383-44a4-9be1-ba8a5c83592e tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:35.580705 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-7119c879-2eb2-4e23-9f16-78c9d48fb46a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:05:35.581371 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-7119c879-2eb2-4e23-9f16-78c9d48fb46a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:05:35.589198 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7119c879-2eb2-4e23-9f16-78c9d48fb46a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:35.589703 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7119c879-2eb2-4e23-9f16-78c9d48fb46a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:35.590564 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7119c879-2eb2-4e23-9f16-78c9d48fb46a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:35.591054 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7119c879-2eb2-4e23-9f16-78c9d48fb46a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:35.796559 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-287b1f3c-1383-44a4-9be1-ba8a5c83592e tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:35.806358 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-287b1f3c-1383-44a4-9be1-ba8a5c83592e tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.245272 Dec 16 15:05:35.806976 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 595/1201] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:05:35 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:05:35.810611 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-7119c879-2eb2-4e23-9f16-78c9d48fb46a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:35.823712 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-7119c879-2eb2-4e23-9f16-78c9d48fb46a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:35.828099 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-7119c879-2eb2-4e23-9f16-78c9d48fb46a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:35.829266 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-7119c879-2eb2-4e23-9f16-78c9d48fb46a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.256340 Dec 16 15:05:35.829861 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 607/1202] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:05:35 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 15:05:36.828423 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-1c6e88f1-049e-4a1b-b2f1-a099d21da8cd tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:05:36.829093 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-1c6e88f1-049e-4a1b-b2f1-a099d21da8cd tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:05:36.836932 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1c6e88f1-049e-4a1b-b2f1-a099d21da8cd tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:36.837446 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1c6e88f1-049e-4a1b-b2f1-a099d21da8cd tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:36.838351 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1c6e88f1-049e-4a1b-b2f1-a099d21da8cd tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:36.838847 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1c6e88f1-049e-4a1b-b2f1-a099d21da8cd tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:36.852105 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-6f582127-d111-4c4b-93eb-f371060a1653 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:05:36.852774 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-6f582127-d111-4c4b-93eb-f371060a1653 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:05:36.860650 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6f582127-d111-4c4b-93eb-f371060a1653 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:36.861647 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6f582127-d111-4c4b-93eb-f371060a1653 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:36.862509 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6f582127-d111-4c4b-93eb-f371060a1653 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:36.863004 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6f582127-d111-4c4b-93eb-f371060a1653 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:37.062989 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-1c6e88f1-049e-4a1b-b2f1-a099d21da8cd tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:37.072669 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-1c6e88f1-049e-4a1b-b2f1-a099d21da8cd tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.251766 Dec 16 15:05:37.073286 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 596/1203] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:05:36 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:05:37.084328 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-6f582127-d111-4c4b-93eb-f371060a1653 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:37.098385 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-6f582127-d111-4c4b-93eb-f371060a1653 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:37.102853 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-6f582127-d111-4c4b-93eb-f371060a1653 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:37.104046 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-6f582127-d111-4c4b-93eb-f371060a1653 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.259687 Dec 16 15:05:37.104636 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 608/1204] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:05:36 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:05:37.417316 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-0b4c092a-a78d-484c-a770-8163b5b40939 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:05:37.417868 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-0b4c092a-a78d-484c-a770-8163b5b40939 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] [instance: 64774bdb-b85b-4d86-9110-0b37d9c15bed] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:05:37.426271 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0b4c092a-a78d-484c-a770-8163b5b40939 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:37.426785 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0b4c092a-a78d-484c-a770-8163b5b40939 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:37.427621 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0b4c092a-a78d-484c-a770-8163b5b40939 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:37.428112 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0b4c092a-a78d-484c-a770-8163b5b40939 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:37.765280 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: ERROR oslo.messaging._drivers.impl_rabbit [None req-0b4c092a-a78d-484c-a770-8163b5b40939 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] [b0432676-a449-44cf-bfe8-13d720240087] AMQP server on 10.222.0.45:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 16 15:05:38.094742 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-21d285a8-ca78-4a39-a5c1-1165f2a43c7b tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:05:38.095914 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-21d285a8-ca78-4a39-a5c1-1165f2a43c7b tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:05:38.104149 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-21d285a8-ca78-4a39-a5c1-1165f2a43c7b tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:38.104651 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-21d285a8-ca78-4a39-a5c1-1165f2a43c7b tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:38.105483 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-21d285a8-ca78-4a39-a5c1-1165f2a43c7b tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:38.105975 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-21d285a8-ca78-4a39-a5c1-1165f2a43c7b tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:38.321565 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-21d285a8-ca78-4a39-a5c1-1165f2a43c7b tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:38.330654 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-21d285a8-ca78-4a39-a5c1-1165f2a43c7b tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.243496 Dec 16 15:05:38.331440 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 609/1205] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:05:38 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:05:38.339694 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-7fa06cea-c4b0-44f5-83cf-b3dda69ad19e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:05:38.340573 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-7fa06cea-c4b0-44f5-83cf-b3dda69ad19e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:05:38.348219 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7fa06cea-c4b0-44f5-83cf-b3dda69ad19e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:38.348669 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7fa06cea-c4b0-44f5-83cf-b3dda69ad19e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:38.349521 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7fa06cea-c4b0-44f5-83cf-b3dda69ad19e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:38.350361 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7fa06cea-c4b0-44f5-83cf-b3dda69ad19e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:38.567409 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-7fa06cea-c4b0-44f5-83cf-b3dda69ad19e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:38.580357 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-7fa06cea-c4b0-44f5-83cf-b3dda69ad19e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:38.584848 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-7fa06cea-c4b0-44f5-83cf-b3dda69ad19e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:38.586026 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-7fa06cea-c4b0-44f5-83cf-b3dda69ad19e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.253800 Dec 16 15:05:38.586643 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 610/1206] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:05:38 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:05:38.781714 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO oslo.messaging._drivers.impl_rabbit [None req-0b4c092a-a78d-484c-a770-8163b5b40939 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] [b0432676-a449-44cf-bfe8-13d720240087] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 43308. Dec 16 15:05:38.785533 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-0b4c092a-a78d-484c-a770-8163b5b40939 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] 10.222.0.45 "DELETE /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed/os-volume_attachments/e38aef8f-bdd5-41fa-94f0-73f0a05837d3" status: 202 len: 0 microversion: 2.1 time: 1.376132 Dec 16 15:05:38.786225 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 597/1207] 10.222.0.45 () {58 vars in 1406 bytes} [Thu Dec 16 15:05:37 2021] DELETE /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed/os-volume_attachments/e38aef8f-bdd5-41fa-94f0-73f0a05837d3 => generated 0 bytes in 1377 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:05:39.352953 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-ccbd1692-1202-4d57-a6f7-b8c6ce13525e tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:05:39.353656 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-ccbd1692-1202-4d57-a6f7-b8c6ce13525e tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:05:39.363570 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ccbd1692-1202-4d57-a6f7-b8c6ce13525e tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:39.364077 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ccbd1692-1202-4d57-a6f7-b8c6ce13525e tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:39.364918 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ccbd1692-1202-4d57-a6f7-b8c6ce13525e tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:39.365441 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ccbd1692-1202-4d57-a6f7-b8c6ce13525e tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:39.583728 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-ccbd1692-1202-4d57-a6f7-b8c6ce13525e tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:39.592498 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-ccbd1692-1202-4d57-a6f7-b8c6ce13525e tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.247519 Dec 16 15:05:39.593097 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 611/1208] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:05:39 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:05:39.612925 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-72db1bdc-7aae-4748-982f-23f8dcf3960a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:05:39.613641 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-72db1bdc-7aae-4748-982f-23f8dcf3960a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:05:39.622301 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-72db1bdc-7aae-4748-982f-23f8dcf3960a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:39.622816 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-72db1bdc-7aae-4748-982f-23f8dcf3960a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:39.623670 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-72db1bdc-7aae-4748-982f-23f8dcf3960a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:39.624170 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-72db1bdc-7aae-4748-982f-23f8dcf3960a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:39.843928 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-72db1bdc-7aae-4748-982f-23f8dcf3960a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:39.857405 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-72db1bdc-7aae-4748-982f-23f8dcf3960a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:39.861954 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-72db1bdc-7aae-4748-982f-23f8dcf3960a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:39.863223 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-72db1bdc-7aae-4748-982f-23f8dcf3960a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.260881 Dec 16 15:05:39.863759 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 598/1209] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:05:39 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:05:40.615163 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-2baf7e96-b79e-4e43-b6cd-78c4e8a8ff47 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:05:40.615838 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-2baf7e96-b79e-4e43-b6cd-78c4e8a8ff47 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:05:40.623695 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2baf7e96-b79e-4e43-b6cd-78c4e8a8ff47 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:40.624207 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2baf7e96-b79e-4e43-b6cd-78c4e8a8ff47 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:40.625053 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2baf7e96-b79e-4e43-b6cd-78c4e8a8ff47 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:40.625624 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2baf7e96-b79e-4e43-b6cd-78c4e8a8ff47 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:40.840540 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-2baf7e96-b79e-4e43-b6cd-78c4e8a8ff47 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:40.849858 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-2baf7e96-b79e-4e43-b6cd-78c4e8a8ff47 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.242835 Dec 16 15:05:40.850493 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 612/1210] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:05:40 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:05:40.886638 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-861aee08-7843-4d28-b492-0ac14e0363d5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:05:40.887398 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-861aee08-7843-4d28-b492-0ac14e0363d5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:05:40.895270 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-861aee08-7843-4d28-b492-0ac14e0363d5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:40.895785 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-861aee08-7843-4d28-b492-0ac14e0363d5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:40.896625 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-861aee08-7843-4d28-b492-0ac14e0363d5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:40.897123 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-861aee08-7843-4d28-b492-0ac14e0363d5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:41.115234 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-861aee08-7843-4d28-b492-0ac14e0363d5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:41.128300 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-861aee08-7843-4d28-b492-0ac14e0363d5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:41.132943 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-861aee08-7843-4d28-b492-0ac14e0363d5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:41.134127 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-861aee08-7843-4d28-b492-0ac14e0363d5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.255255 Dec 16 15:05:41.134705 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 599/1211] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:05:40 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:05:41.872044 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-fc4eed58-13bb-4eff-9afb-d767bb80719e tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:05:41.872700 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-fc4eed58-13bb-4eff-9afb-d767bb80719e tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:05:41.880629 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fc4eed58-13bb-4eff-9afb-d767bb80719e tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:41.881131 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fc4eed58-13bb-4eff-9afb-d767bb80719e tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:41.881969 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fc4eed58-13bb-4eff-9afb-d767bb80719e tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:41.882507 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fc4eed58-13bb-4eff-9afb-d767bb80719e tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:42.100380 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-fc4eed58-13bb-4eff-9afb-d767bb80719e tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:42.109640 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-fc4eed58-13bb-4eff-9afb-d767bb80719e tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.245189 Dec 16 15:05:42.110432 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 613/1212] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:05:41 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:05:42.156746 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-96e9016b-599c-4302-9194-856a32fca771 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:05:42.157419 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-96e9016b-599c-4302-9194-856a32fca771 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:05:42.165815 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-96e9016b-599c-4302-9194-856a32fca771 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:42.166380 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-96e9016b-599c-4302-9194-856a32fca771 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:42.167222 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-96e9016b-599c-4302-9194-856a32fca771 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:42.167719 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-96e9016b-599c-4302-9194-856a32fca771 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:42.387667 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-96e9016b-599c-4302-9194-856a32fca771 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:42.401258 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-96e9016b-599c-4302-9194-856a32fca771 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:42.405712 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-96e9016b-599c-4302-9194-856a32fca771 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:42.406954 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-96e9016b-599c-4302-9194-856a32fca771 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.258086 Dec 16 15:05:42.407553 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 600/1213] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:05:42 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:05:43.131528 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-d08e3211-6ce6-487b-a195-1aae5a684a26 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:05:43.132187 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-d08e3211-6ce6-487b-a195-1aae5a684a26 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:05:43.139990 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d08e3211-6ce6-487b-a195-1aae5a684a26 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:43.140491 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d08e3211-6ce6-487b-a195-1aae5a684a26 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:43.141310 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d08e3211-6ce6-487b-a195-1aae5a684a26 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:43.141789 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d08e3211-6ce6-487b-a195-1aae5a684a26 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:43.356172 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-d08e3211-6ce6-487b-a195-1aae5a684a26 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:43.365240 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-d08e3211-6ce6-487b-a195-1aae5a684a26 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.241725 Dec 16 15:05:43.365844 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 614/1214] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:05:43 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:05:43.430823 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-4822de9e-418e-41fd-9730-2b4cafb26565 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:05:43.431492 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-4822de9e-418e-41fd-9730-2b4cafb26565 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:05:43.439971 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4822de9e-418e-41fd-9730-2b4cafb26565 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:43.440479 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4822de9e-418e-41fd-9730-2b4cafb26565 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:43.441317 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4822de9e-418e-41fd-9730-2b4cafb26565 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:43.441809 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4822de9e-418e-41fd-9730-2b4cafb26565 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:43.651311 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-4822de9e-418e-41fd-9730-2b4cafb26565 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:43.663920 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-4822de9e-418e-41fd-9730-2b4cafb26565 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:43.668362 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-4822de9e-418e-41fd-9730-2b4cafb26565 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:43.669535 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-4822de9e-418e-41fd-9730-2b4cafb26565 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.247160 Dec 16 15:05:43.670139 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 601/1215] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:05:43 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:05:44.387303 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-06aefd95-5dc4-47a9-8375-3b9c9aa7971d tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:05:44.388537 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-06aefd95-5dc4-47a9-8375-3b9c9aa7971d tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:05:44.396890 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-06aefd95-5dc4-47a9-8375-3b9c9aa7971d tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:44.397392 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-06aefd95-5dc4-47a9-8375-3b9c9aa7971d tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:44.398248 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-06aefd95-5dc4-47a9-8375-3b9c9aa7971d tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:44.398732 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-06aefd95-5dc4-47a9-8375-3b9c9aa7971d tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:44.618568 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-06aefd95-5dc4-47a9-8375-3b9c9aa7971d tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:44.631166 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-06aefd95-5dc4-47a9-8375-3b9c9aa7971d tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.251651 Dec 16 15:05:44.631818 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 615/1216] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:05:44 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:05:44.693304 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-0c6873b3-4798-4afb-9236-2828cbf1ecc4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:05:44.693972 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-0c6873b3-4798-4afb-9236-2828cbf1ecc4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:05:44.702014 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0c6873b3-4798-4afb-9236-2828cbf1ecc4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:44.702580 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0c6873b3-4798-4afb-9236-2828cbf1ecc4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:44.703400 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0c6873b3-4798-4afb-9236-2828cbf1ecc4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:44.703896 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0c6873b3-4798-4afb-9236-2828cbf1ecc4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:44.924048 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-0c6873b3-4798-4afb-9236-2828cbf1ecc4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:44.937356 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-0c6873b3-4798-4afb-9236-2828cbf1ecc4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:44.942556 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-0c6873b3-4798-4afb-9236-2828cbf1ecc4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:44.943754 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-0c6873b3-4798-4afb-9236-2828cbf1ecc4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.258839 Dec 16 15:05:44.944341 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 602/1217] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:05:44 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:05:45.653206 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-f4661865-71d8-4a0e-9fca-d400bc51f355 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:05:45.653871 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-f4661865-71d8-4a0e-9fca-d400bc51f355 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:05:45.662312 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f4661865-71d8-4a0e-9fca-d400bc51f355 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:45.662823 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f4661865-71d8-4a0e-9fca-d400bc51f355 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:45.663655 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f4661865-71d8-4a0e-9fca-d400bc51f355 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:45.664146 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f4661865-71d8-4a0e-9fca-d400bc51f355 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:45.873737 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-f4661865-71d8-4a0e-9fca-d400bc51f355 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:45.883314 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-f4661865-71d8-4a0e-9fca-d400bc51f355 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.237678 Dec 16 15:05:45.884252 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 616/1218] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:05:45 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:05:45.967013 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-9011cfbb-7c74-4a2f-b26c-a366eaaae1f3 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:05:45.967680 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-9011cfbb-7c74-4a2f-b26c-a366eaaae1f3 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:05:45.976124 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9011cfbb-7c74-4a2f-b26c-a366eaaae1f3 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:45.976637 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9011cfbb-7c74-4a2f-b26c-a366eaaae1f3 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:45.977478 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9011cfbb-7c74-4a2f-b26c-a366eaaae1f3 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:45.977976 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9011cfbb-7c74-4a2f-b26c-a366eaaae1f3 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:46.194400 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-9011cfbb-7c74-4a2f-b26c-a366eaaae1f3 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:46.207833 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-9011cfbb-7c74-4a2f-b26c-a366eaaae1f3 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:46.212283 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-9011cfbb-7c74-4a2f-b26c-a366eaaae1f3 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:46.213460 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-9011cfbb-7c74-4a2f-b26c-a366eaaae1f3 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.254133 Dec 16 15:05:46.214068 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 603/1219] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:05:45 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:05:46.914463 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-1a0d52c0-f4ce-4d71-8abf-19bf62d608e1 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:05:46.915129 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-1a0d52c0-f4ce-4d71-8abf-19bf62d608e1 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:05:46.922838 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1a0d52c0-f4ce-4d71-8abf-19bf62d608e1 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:46.923913 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1a0d52c0-f4ce-4d71-8abf-19bf62d608e1 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:46.924734 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1a0d52c0-f4ce-4d71-8abf-19bf62d608e1 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:46.925215 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1a0d52c0-f4ce-4d71-8abf-19bf62d608e1 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:47.142385 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-1a0d52c0-f4ce-4d71-8abf-19bf62d608e1 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:47.151275 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-1a0d52c0-f4ce-4d71-8abf-19bf62d608e1 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.244928 Dec 16 15:05:47.152059 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 617/1220] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:05:46 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:05:47.238964 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-42289591-c3b5-4b4c-ba94-3a4033774d65 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:05:47.240182 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-42289591-c3b5-4b4c-ba94-3a4033774d65 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:05:47.248090 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-42289591-c3b5-4b4c-ba94-3a4033774d65 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:47.248591 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-42289591-c3b5-4b4c-ba94-3a4033774d65 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:47.249432 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-42289591-c3b5-4b4c-ba94-3a4033774d65 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:47.249921 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-42289591-c3b5-4b4c-ba94-3a4033774d65 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:47.490010 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-42289591-c3b5-4b4c-ba94-3a4033774d65 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:47.503123 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-42289591-c3b5-4b4c-ba94-3a4033774d65 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:47.507623 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-42289591-c3b5-4b4c-ba94-3a4033774d65 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:47.508822 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-42289591-c3b5-4b4c-ba94-3a4033774d65 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.280044 Dec 16 15:05:47.509408 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 604/1221] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:05:47 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:05:48.174539 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-01b5fbe5-3c33-4dd7-bf74-c547897600f4 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:05:48.175205 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-01b5fbe5-3c33-4dd7-bf74-c547897600f4 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:05:48.183015 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-01b5fbe5-3c33-4dd7-bf74-c547897600f4 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:48.183520 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-01b5fbe5-3c33-4dd7-bf74-c547897600f4 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:48.184358 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-01b5fbe5-3c33-4dd7-bf74-c547897600f4 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:48.184852 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-01b5fbe5-3c33-4dd7-bf74-c547897600f4 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:48.396199 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-01b5fbe5-3c33-4dd7-bf74-c547897600f4 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:48.405151 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-01b5fbe5-3c33-4dd7-bf74-c547897600f4 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.238757 Dec 16 15:05:48.405751 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 618/1222] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:05:48 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:05:48.532868 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-9f0dc6ab-3e57-47ca-a8fc-fb62b4ee3ba3 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:05:48.533457 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-9f0dc6ab-3e57-47ca-a8fc-fb62b4ee3ba3 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:05:48.541227 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9f0dc6ab-3e57-47ca-a8fc-fb62b4ee3ba3 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:48.541738 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9f0dc6ab-3e57-47ca-a8fc-fb62b4ee3ba3 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:48.542604 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9f0dc6ab-3e57-47ca-a8fc-fb62b4ee3ba3 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:48.543099 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9f0dc6ab-3e57-47ca-a8fc-fb62b4ee3ba3 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:48.764055 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-9f0dc6ab-3e57-47ca-a8fc-fb62b4ee3ba3 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:48.776887 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-9f0dc6ab-3e57-47ca-a8fc-fb62b4ee3ba3 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:48.781639 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-9f0dc6ab-3e57-47ca-a8fc-fb62b4ee3ba3 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:48.783386 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-9f0dc6ab-3e57-47ca-a8fc-fb62b4ee3ba3 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.258790 Dec 16 15:05:48.783931 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 605/1223] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:05:48 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:05:49.427243 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-427d509f-3c6f-40ff-ae3f-26c09f9b7d49 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:05:49.428421 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-427d509f-3c6f-40ff-ae3f-26c09f9b7d49 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:05:49.436888 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-427d509f-3c6f-40ff-ae3f-26c09f9b7d49 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:49.437405 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-427d509f-3c6f-40ff-ae3f-26c09f9b7d49 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:49.438274 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-427d509f-3c6f-40ff-ae3f-26c09f9b7d49 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:49.438830 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-427d509f-3c6f-40ff-ae3f-26c09f9b7d49 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:49.656884 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-427d509f-3c6f-40ff-ae3f-26c09f9b7d49 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:49.666352 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-427d509f-3c6f-40ff-ae3f-26c09f9b7d49 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.246580 Dec 16 15:05:49.666947 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 619/1224] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:05:49 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:05:49.807119 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-bf077fd0-76c2-45e7-adb0-cdff54f16e3c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:05:49.808207 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-bf077fd0-76c2-45e7-adb0-cdff54f16e3c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:05:49.816896 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-bf077fd0-76c2-45e7-adb0-cdff54f16e3c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:49.817403 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-bf077fd0-76c2-45e7-adb0-cdff54f16e3c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:49.818318 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-bf077fd0-76c2-45e7-adb0-cdff54f16e3c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:49.818816 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-bf077fd0-76c2-45e7-adb0-cdff54f16e3c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:50.040092 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-bf077fd0-76c2-45e7-adb0-cdff54f16e3c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:50.052825 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-bf077fd0-76c2-45e7-adb0-cdff54f16e3c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:50.057310 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-bf077fd0-76c2-45e7-adb0-cdff54f16e3c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:50.058556 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-bf077fd0-76c2-45e7-adb0-cdff54f16e3c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.259902 Dec 16 15:05:50.059137 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 606/1225] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:05:49 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:05:50.687529 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-2a485619-8e96-47fb-8b27-4db8112165b7 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:05:50.688197 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-2a485619-8e96-47fb-8b27-4db8112165b7 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:05:50.696280 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2a485619-8e96-47fb-8b27-4db8112165b7 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:50.696795 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2a485619-8e96-47fb-8b27-4db8112165b7 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:50.697674 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2a485619-8e96-47fb-8b27-4db8112165b7 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:50.698217 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2a485619-8e96-47fb-8b27-4db8112165b7 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:50.927109 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-2a485619-8e96-47fb-8b27-4db8112165b7 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:50.936610 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-2a485619-8e96-47fb-8b27-4db8112165b7 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.256626 Dec 16 15:05:50.937396 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 620/1226] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:05:50 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:05:51.081409 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-f6bea2d3-845d-4f5f-9033-462cc82d07bd tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:05:51.082145 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-f6bea2d3-845d-4f5f-9033-462cc82d07bd tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:05:51.089913 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f6bea2d3-845d-4f5f-9033-462cc82d07bd tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:51.090478 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f6bea2d3-845d-4f5f-9033-462cc82d07bd tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:51.091392 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f6bea2d3-845d-4f5f-9033-462cc82d07bd tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:51.091889 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f6bea2d3-845d-4f5f-9033-462cc82d07bd tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:51.304538 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-f6bea2d3-845d-4f5f-9033-462cc82d07bd tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:51.317696 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-f6bea2d3-845d-4f5f-9033-462cc82d07bd tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:51.322480 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-f6bea2d3-845d-4f5f-9033-462cc82d07bd tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:51.323653 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-f6bea2d3-845d-4f5f-9033-462cc82d07bd tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.249822 Dec 16 15:05:51.324238 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 607/1227] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:05:51 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:05:51.959932 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-a134bfa0-920f-43c7-bb33-ea371a97b2f0 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:05:51.960679 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-a134bfa0-920f-43c7-bb33-ea371a97b2f0 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:05:51.969880 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a134bfa0-920f-43c7-bb33-ea371a97b2f0 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:51.970823 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a134bfa0-920f-43c7-bb33-ea371a97b2f0 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:51.972381 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a134bfa0-920f-43c7-bb33-ea371a97b2f0 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:51.973280 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a134bfa0-920f-43c7-bb33-ea371a97b2f0 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:52.212382 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-a134bfa0-920f-43c7-bb33-ea371a97b2f0 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:52.221751 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-a134bfa0-920f-43c7-bb33-ea371a97b2f0 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.270172 Dec 16 15:05:52.222371 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 621/1228] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:05:51 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:05:52.347375 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-3b09a899-f3e8-4b1c-93bb-5f34ef90fc0b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:05:52.348041 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-3b09a899-f3e8-4b1c-93bb-5f34ef90fc0b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:05:52.356940 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3b09a899-f3e8-4b1c-93bb-5f34ef90fc0b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:52.357449 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3b09a899-f3e8-4b1c-93bb-5f34ef90fc0b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:52.358420 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3b09a899-f3e8-4b1c-93bb-5f34ef90fc0b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:52.358967 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3b09a899-f3e8-4b1c-93bb-5f34ef90fc0b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:52.572626 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-3b09a899-f3e8-4b1c-93bb-5f34ef90fc0b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:52.589987 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-3b09a899-f3e8-4b1c-93bb-5f34ef90fc0b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:52.598373 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-3b09a899-f3e8-4b1c-93bb-5f34ef90fc0b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:52.600215 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-3b09a899-f3e8-4b1c-93bb-5f34ef90fc0b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.261053 Dec 16 15:05:52.601089 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 608/1229] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:05:52 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:05:53.244219 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-1b370a7a-cf51-4255-90b1-86eee826ddff tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:05:53.244883 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-1b370a7a-cf51-4255-90b1-86eee826ddff tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:05:53.253282 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1b370a7a-cf51-4255-90b1-86eee826ddff tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:53.253786 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1b370a7a-cf51-4255-90b1-86eee826ddff tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:53.254647 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1b370a7a-cf51-4255-90b1-86eee826ddff tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:53.255145 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1b370a7a-cf51-4255-90b1-86eee826ddff tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:53.474871 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-1b370a7a-cf51-4255-90b1-86eee826ddff tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:53.483711 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-1b370a7a-cf51-4255-90b1-86eee826ddff tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.247139 Dec 16 15:05:53.484438 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 622/1230] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:05:53 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:05:53.623493 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-eef4c875-8fa5-49a1-badb-97b2889a50ae tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:05:53.624164 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-eef4c875-8fa5-49a1-badb-97b2889a50ae tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:05:53.632035 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-eef4c875-8fa5-49a1-badb-97b2889a50ae tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:53.632548 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-eef4c875-8fa5-49a1-badb-97b2889a50ae tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:53.633393 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-eef4c875-8fa5-49a1-badb-97b2889a50ae tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:53.633893 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-eef4c875-8fa5-49a1-badb-97b2889a50ae tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:53.846480 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-eef4c875-8fa5-49a1-badb-97b2889a50ae tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:53.859108 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-eef4c875-8fa5-49a1-badb-97b2889a50ae tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:53.864257 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-eef4c875-8fa5-49a1-badb-97b2889a50ae tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:53.865434 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-eef4c875-8fa5-49a1-badb-97b2889a50ae tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.249666 Dec 16 15:05:53.866009 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 609/1231] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:05:53 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:05:54.505853 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-3684724f-fe80-49d2-a1ff-8e8f82fb08b2 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:05:54.506545 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-3684724f-fe80-49d2-a1ff-8e8f82fb08b2 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:05:54.514510 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3684724f-fe80-49d2-a1ff-8e8f82fb08b2 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:54.515020 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3684724f-fe80-49d2-a1ff-8e8f82fb08b2 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:54.515897 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3684724f-fe80-49d2-a1ff-8e8f82fb08b2 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:54.516382 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3684724f-fe80-49d2-a1ff-8e8f82fb08b2 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:54.730367 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-3684724f-fe80-49d2-a1ff-8e8f82fb08b2 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:54.739226 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-3684724f-fe80-49d2-a1ff-8e8f82fb08b2 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.240919 Dec 16 15:05:54.739818 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 623/1232] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:05:54 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:05:54.888799 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-9490027b-141c-4af0-959c-bb3f1e6d4e28 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:05:54.889563 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-9490027b-141c-4af0-959c-bb3f1e6d4e28 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:05:54.898315 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9490027b-141c-4af0-959c-bb3f1e6d4e28 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:54.898825 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9490027b-141c-4af0-959c-bb3f1e6d4e28 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:54.899716 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9490027b-141c-4af0-959c-bb3f1e6d4e28 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:54.900290 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9490027b-141c-4af0-959c-bb3f1e6d4e28 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:55.116775 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-9490027b-141c-4af0-959c-bb3f1e6d4e28 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:55.129494 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-9490027b-141c-4af0-959c-bb3f1e6d4e28 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:55.133968 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-9490027b-141c-4af0-959c-bb3f1e6d4e28 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:55.135200 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-9490027b-141c-4af0-959c-bb3f1e6d4e28 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.254340 Dec 16 15:05:55.135789 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 610/1233] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:05:54 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:05:55.761746 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-acad3f05-bdbc-4e0b-b640-bc04af780033 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:05:55.762446 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-acad3f05-bdbc-4e0b-b640-bc04af780033 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:05:55.770351 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-acad3f05-bdbc-4e0b-b640-bc04af780033 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:55.770862 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-acad3f05-bdbc-4e0b-b640-bc04af780033 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:55.771705 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-acad3f05-bdbc-4e0b-b640-bc04af780033 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:55.772196 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-acad3f05-bdbc-4e0b-b640-bc04af780033 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:55.996081 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-acad3f05-bdbc-4e0b-b640-bc04af780033 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:56.009728 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-acad3f05-bdbc-4e0b-b640-bc04af780033 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.255611 Dec 16 15:05:56.010370 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 624/1234] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:05:55 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:05:56.159023 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-d66121d9-e41e-4f8b-a787-cc210f4eefaa tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:05:56.159694 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-d66121d9-e41e-4f8b-a787-cc210f4eefaa tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:05:56.167533 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d66121d9-e41e-4f8b-a787-cc210f4eefaa tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:56.168040 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d66121d9-e41e-4f8b-a787-cc210f4eefaa tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:56.168875 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d66121d9-e41e-4f8b-a787-cc210f4eefaa tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:56.169367 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d66121d9-e41e-4f8b-a787-cc210f4eefaa tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:56.387664 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-d66121d9-e41e-4f8b-a787-cc210f4eefaa tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:56.402198 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-d66121d9-e41e-4f8b-a787-cc210f4eefaa tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:56.406815 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-d66121d9-e41e-4f8b-a787-cc210f4eefaa tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:56.408039 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-d66121d9-e41e-4f8b-a787-cc210f4eefaa tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.257196 Dec 16 15:05:56.408619 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 611/1235] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:05:56 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:05:57.030637 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-b99320da-2f3f-4cd9-8c38-aa8e40155bec tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:05:57.031308 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-b99320da-2f3f-4cd9-8c38-aa8e40155bec tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:05:57.039904 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b99320da-2f3f-4cd9-8c38-aa8e40155bec tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:57.040395 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b99320da-2f3f-4cd9-8c38-aa8e40155bec tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:57.041230 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b99320da-2f3f-4cd9-8c38-aa8e40155bec tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:57.041723 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b99320da-2f3f-4cd9-8c38-aa8e40155bec tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:57.256385 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-b99320da-2f3f-4cd9-8c38-aa8e40155bec tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:57.265150 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-b99320da-2f3f-4cd9-8c38-aa8e40155bec tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.242043 Dec 16 15:05:57.265738 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 625/1236] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:05:57 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:05:57.431729 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-dbc438ed-9903-4efd-985f-31c0bf130b44 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:05:57.432380 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-dbc438ed-9903-4efd-985f-31c0bf130b44 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:05:57.440736 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-dbc438ed-9903-4efd-985f-31c0bf130b44 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:57.441253 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-dbc438ed-9903-4efd-985f-31c0bf130b44 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:57.442122 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-dbc438ed-9903-4efd-985f-31c0bf130b44 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:57.442623 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-dbc438ed-9903-4efd-985f-31c0bf130b44 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:57.662721 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-dbc438ed-9903-4efd-985f-31c0bf130b44 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:57.675742 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-dbc438ed-9903-4efd-985f-31c0bf130b44 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:57.680337 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-dbc438ed-9903-4efd-985f-31c0bf130b44 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:57.681549 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-dbc438ed-9903-4efd-985f-31c0bf130b44 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.257659 Dec 16 15:05:57.682723 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 612/1237] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:05:57 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:05:58.287650 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-b127cf03-673b-49f6-aacc-4173c45cc9bb tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:05:58.288330 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-b127cf03-673b-49f6-aacc-4173c45cc9bb tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:05:58.296432 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b127cf03-673b-49f6-aacc-4173c45cc9bb tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:58.296944 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b127cf03-673b-49f6-aacc-4173c45cc9bb tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:58.297799 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b127cf03-673b-49f6-aacc-4173c45cc9bb tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:58.298324 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b127cf03-673b-49f6-aacc-4173c45cc9bb tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:58.521635 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-b127cf03-673b-49f6-aacc-4173c45cc9bb tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:58.531358 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-b127cf03-673b-49f6-aacc-4173c45cc9bb tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.251302 Dec 16 15:05:58.533249 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 626/1238] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:05:58 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:05:58.705028 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-13ce70f8-8b93-4551-ba58-43106b4e472e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:05:58.705775 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-13ce70f8-8b93-4551-ba58-43106b4e472e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:05:58.713640 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-13ce70f8-8b93-4551-ba58-43106b4e472e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:58.714207 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-13ce70f8-8b93-4551-ba58-43106b4e472e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:58.715133 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-13ce70f8-8b93-4551-ba58-43106b4e472e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:58.715698 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-13ce70f8-8b93-4551-ba58-43106b4e472e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:59.061684 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-13ce70f8-8b93-4551-ba58-43106b4e472e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:59.075967 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-13ce70f8-8b93-4551-ba58-43106b4e472e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:59.081497 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-13ce70f8-8b93-4551-ba58-43106b4e472e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:59.083479 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-13ce70f8-8b93-4551-ba58-43106b4e472e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.386109 Dec 16 15:05:59.084518 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 613/1239] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:05:58 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:05:59.554349 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-f06913ca-95d7-4953-91cb-f68a72fba499 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:05:59.554990 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-f06913ca-95d7-4953-91cb-f68a72fba499 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:05:59.562959 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f06913ca-95d7-4953-91cb-f68a72fba499 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:59.563472 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f06913ca-95d7-4953-91cb-f68a72fba499 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:59.566128 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f06913ca-95d7-4953-91cb-f68a72fba499 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:05:59.566749 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f06913ca-95d7-4953-91cb-f68a72fba499 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:05:59.787468 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-f06913ca-95d7-4953-91cb-f68a72fba499 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:05:59.796270 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-f06913ca-95d7-4953-91cb-f68a72fba499 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.250453 Dec 16 15:05:59.796865 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 627/1240] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:05:59 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:06:00.107439 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-fde52f43-def2-4499-a12f-a3b426b715bc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:06:00.108109 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-fde52f43-def2-4499-a12f-a3b426b715bc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:06:00.115910 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fde52f43-def2-4499-a12f-a3b426b715bc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:00.116468 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fde52f43-def2-4499-a12f-a3b426b715bc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:00.117308 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fde52f43-def2-4499-a12f-a3b426b715bc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:00.117801 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fde52f43-def2-4499-a12f-a3b426b715bc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:00.336015 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-fde52f43-def2-4499-a12f-a3b426b715bc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:06:00.360778 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-fde52f43-def2-4499-a12f-a3b426b715bc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:06:00.365665 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-fde52f43-def2-4499-a12f-a3b426b715bc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:06:00.367798 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-fde52f43-def2-4499-a12f-a3b426b715bc tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.267768 Dec 16 15:06:00.368385 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 614/1241] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:06:00 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:06:00.819576 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-0dcd6d6d-4571-4557-ad6b-faa5f3ef95bf tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:06:00.820252 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-0dcd6d6d-4571-4557-ad6b-faa5f3ef95bf tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:06:00.828093 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0dcd6d6d-4571-4557-ad6b-faa5f3ef95bf tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:00.828602 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0dcd6d6d-4571-4557-ad6b-faa5f3ef95bf tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:00.829445 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0dcd6d6d-4571-4557-ad6b-faa5f3ef95bf tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:00.829939 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0dcd6d6d-4571-4557-ad6b-faa5f3ef95bf tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:01.046076 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-0dcd6d6d-4571-4557-ad6b-faa5f3ef95bf tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:06:01.055517 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-0dcd6d6d-4571-4557-ad6b-faa5f3ef95bf tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.244491 Dec 16 15:06:01.056113 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 628/1242] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:06:00 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:06:01.396990 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-6ec3cef0-17ab-4d77-bbed-66d0aeab885b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:06:01.397659 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-6ec3cef0-17ab-4d77-bbed-66d0aeab885b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:06:01.405569 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6ec3cef0-17ab-4d77-bbed-66d0aeab885b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:01.406099 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6ec3cef0-17ab-4d77-bbed-66d0aeab885b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:01.406942 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6ec3cef0-17ab-4d77-bbed-66d0aeab885b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:01.407433 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6ec3cef0-17ab-4d77-bbed-66d0aeab885b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:01.619575 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-6ec3cef0-17ab-4d77-bbed-66d0aeab885b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:06:01.632324 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-6ec3cef0-17ab-4d77-bbed-66d0aeab885b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:06:01.636912 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-6ec3cef0-17ab-4d77-bbed-66d0aeab885b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:06:01.638117 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-6ec3cef0-17ab-4d77-bbed-66d0aeab885b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.249634 Dec 16 15:06:01.638756 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 615/1243] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:06:01 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:06:02.078095 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-5b019148-926f-494a-8f20-b3cd4857cd31 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:06:02.078742 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-5b019148-926f-494a-8f20-b3cd4857cd31 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:06:02.090177 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5b019148-926f-494a-8f20-b3cd4857cd31 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:02.090685 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5b019148-926f-494a-8f20-b3cd4857cd31 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:02.091530 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5b019148-926f-494a-8f20-b3cd4857cd31 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:02.092022 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5b019148-926f-494a-8f20-b3cd4857cd31 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:02.309442 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-5b019148-926f-494a-8f20-b3cd4857cd31 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:06:02.318975 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-5b019148-926f-494a-8f20-b3cd4857cd31 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.248528 Dec 16 15:06:02.319832 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 629/1244] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:06:02 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:06:02.662361 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-924ffbbd-9e64-48f5-a982-2f86d34d79f4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:06:02.663021 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-924ffbbd-9e64-48f5-a982-2f86d34d79f4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:06:02.670839 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-924ffbbd-9e64-48f5-a982-2f86d34d79f4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:02.671342 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-924ffbbd-9e64-48f5-a982-2f86d34d79f4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:02.672175 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-924ffbbd-9e64-48f5-a982-2f86d34d79f4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:02.672659 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-924ffbbd-9e64-48f5-a982-2f86d34d79f4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:02.894091 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-924ffbbd-9e64-48f5-a982-2f86d34d79f4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:06:02.906929 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-924ffbbd-9e64-48f5-a982-2f86d34d79f4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:06:02.912034 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-924ffbbd-9e64-48f5-a982-2f86d34d79f4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:06:02.913215 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-924ffbbd-9e64-48f5-a982-2f86d34d79f4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.259207 Dec 16 15:06:02.913805 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 616/1245] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:06:02 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:06:03.340824 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-ee54d965-7019-4423-8778-057917df7fad tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:06:03.341497 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-ee54d965-7019-4423-8778-057917df7fad tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:06:03.350249 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ee54d965-7019-4423-8778-057917df7fad tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:03.350755 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ee54d965-7019-4423-8778-057917df7fad tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:03.351588 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ee54d965-7019-4423-8778-057917df7fad tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:03.352114 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ee54d965-7019-4423-8778-057917df7fad tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:03.569056 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-ee54d965-7019-4423-8778-057917df7fad tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:06:03.578090 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-ee54d965-7019-4423-8778-057917df7fad tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.245059 Dec 16 15:06:03.578683 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 630/1246] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:06:03 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:06:03.936403 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-5053aa7b-ed12-40cc-8cbe-8c4e7e00ce2d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:06:03.937020 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-5053aa7b-ed12-40cc-8cbe-8c4e7e00ce2d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:06:03.945767 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5053aa7b-ed12-40cc-8cbe-8c4e7e00ce2d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:03.946315 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5053aa7b-ed12-40cc-8cbe-8c4e7e00ce2d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:03.947159 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5053aa7b-ed12-40cc-8cbe-8c4e7e00ce2d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:03.947656 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5053aa7b-ed12-40cc-8cbe-8c4e7e00ce2d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:04.168136 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-5053aa7b-ed12-40cc-8cbe-8c4e7e00ce2d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:06:04.181419 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-5053aa7b-ed12-40cc-8cbe-8c4e7e00ce2d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:06:04.185900 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-5053aa7b-ed12-40cc-8cbe-8c4e7e00ce2d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:06:04.187203 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-5053aa7b-ed12-40cc-8cbe-8c4e7e00ce2d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 200 len: 1743 microversion: 2.20 time: 0.258601 Dec 16 15:06:04.187737 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 617/1247] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:06:03 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 1743 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:06:04.312313 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-6955a8b6-fc06-4fd4-b3b0-7de394d3ebeb tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:06:04.312864 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-6955a8b6-fc06-4fd4-b3b0-7de394d3ebeb tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:06:04.321039 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6955a8b6-fc06-4fd4-b3b0-7de394d3ebeb tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:04.321542 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6955a8b6-fc06-4fd4-b3b0-7de394d3ebeb tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:04.322397 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6955a8b6-fc06-4fd4-b3b0-7de394d3ebeb tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:04.322900 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6955a8b6-fc06-4fd4-b3b0-7de394d3ebeb tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:04.600563 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-d59767ca-5754-430c-b6ce-edb779de114b tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:06:04.601238 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-d59767ca-5754-430c-b6ce-edb779de114b tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:06:04.609038 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d59767ca-5754-430c-b6ce-edb779de114b tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:04.609542 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d59767ca-5754-430c-b6ce-edb779de114b tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:04.610412 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d59767ca-5754-430c-b6ce-edb779de114b tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:04.610909 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d59767ca-5754-430c-b6ce-edb779de114b tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:04.835274 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-d59767ca-5754-430c-b6ce-edb779de114b tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:06:04.844151 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-d59767ca-5754-430c-b6ce-edb779de114b tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.252073 Dec 16 15:06:04.844743 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 618/1248] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:06:04 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:06:04.938083 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-6955a8b6-fc06-4fd4-b3b0-7de394d3ebeb tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "DELETE /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/os-volume_attachments/4fbf6f0d-a11f-422b-b252-123f878a2093" status: 202 len: 0 microversion: 2.20 time: 0.636249 Dec 16 15:06:04.938831 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 631/1249] 10.222.0.45 () {60 vars in 1447 bytes} [Thu Dec 16 15:06:04 2021] DELETE /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/os-volume_attachments/4fbf6f0d-a11f-422b-b252-123f878a2093 => generated 0 bytes in 638 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 16 15:06:04.953287 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-69f17165-6f4e-451d-b33b-c741932538df tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:06:04.954461 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-69f17165-6f4e-451d-b33b-c741932538df tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:06:04.962222 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-69f17165-6f4e-451d-b33b-c741932538df tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:04.962727 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-69f17165-6f4e-451d-b33b-c741932538df tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:04.963568 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-69f17165-6f4e-451d-b33b-c741932538df tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:04.964056 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-69f17165-6f4e-451d-b33b-c741932538df tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:05.045213 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-69f17165-6f4e-451d-b33b-c741932538df tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.101365 Dec 16 15:06:05.045746 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 619/1250] 10.222.0.45 () {60 vars in 1333 bytes} [Thu Dec 16 15:06:04 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac/os-volume_attachments => generated 25 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:06:05.156215 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-a186f87f-4315-4d08-ab1e-15ded8255143 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:06:05.156773 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-a186f87f-4315-4d08-ab1e-15ded8255143 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:06:05.165271 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a186f87f-4315-4d08-ab1e-15ded8255143 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:05.165793 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a186f87f-4315-4d08-ab1e-15ded8255143 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:05.166671 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a186f87f-4315-4d08-ab1e-15ded8255143 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:05.167168 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a186f87f-4315-4d08-ab1e-15ded8255143 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:05.238749 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-a186f87f-4315-4d08-ab1e-15ded8255143 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Going to try to terminate instance {{(pid=101356) delete /opt/stack/nova/nova/compute/api.py:2496}} Dec 16 15:06:05.247456 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.compute.api [None req-a186f87f-4315-4d08-ab1e-15ded8255143 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Working on deleting snapshot 85ea25f9-55e6-45a6-bf47-d265a05fdb6a from shelved instance... Dec 16 15:06:05.866854 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-67eec15c-bd76-4874-9113-02519451effe tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:06:05.867489 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-67eec15c-bd76-4874-9113-02519451effe tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:06:05.875259 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-67eec15c-bd76-4874-9113-02519451effe tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:05.875767 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-67eec15c-bd76-4874-9113-02519451effe tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:05.877370 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-67eec15c-bd76-4874-9113-02519451effe tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:05.877866 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-67eec15c-bd76-4874-9113-02519451effe tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:06.102557 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-67eec15c-bd76-4874-9113-02519451effe tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:06:06.112017 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-67eec15c-bd76-4874-9113-02519451effe tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.253307 Dec 16 15:06:06.112628 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 620/1251] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:06:05 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:06:06.572874 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-a186f87f-4315-4d08-ab1e-15ded8255143 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Doing local delete in cell 93843735-3183-4729-8723-375da9e05360(cell1) {{(pid=101356) _delete /opt/stack/nova/nova/compute/api.py:2322}} Dec 16 15:06:06.573748 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a186f87f-4315-4d08-ab1e-15ded8255143 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:06.574316 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a186f87f-4315-4d08-ab1e-15ded8255143 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:06.574832 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.compute.api [None req-a186f87f-4315-4d08-ab1e-15ded8255143 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Dec 16 15:06:06.581806 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.network.neutron [None req-a186f87f-4315-4d08-ab1e-15ded8255143 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] deallocate_for_instance() {{(pid=101356) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1675}} Dec 16 15:06:07.134540 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-831cebb5-86e6-43b8-ab0e-ae00bb186960 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:06:07.135340 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-831cebb5-86e6-43b8-ab0e-ae00bb186960 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:06:07.143705 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-831cebb5-86e6-43b8-ab0e-ae00bb186960 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:07.144245 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-831cebb5-86e6-43b8-ab0e-ae00bb186960 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:07.145334 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-831cebb5-86e6-43b8-ab0e-ae00bb186960 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:07.145834 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-831cebb5-86e6-43b8-ab0e-ae00bb186960 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:07.360266 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-831cebb5-86e6-43b8-ab0e-ae00bb186960 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:06:07.372335 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-831cebb5-86e6-43b8-ab0e-ae00bb186960 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.246164 Dec 16 15:06:07.373527 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 621/1252] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:06:07 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:06:08.418432 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.network.neutron [None req-a186f87f-4315-4d08-ab1e-15ded8255143 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Updating instance_info_cache with network_info: [] {{(pid=101356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:119}} Dec 16 15:06:08.437144 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [req-1bd59987-10e9-4178-b3e1-e9d88a8e4cf1 req-461e1ff6-def7-426b-8f39-0ad53544b531 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd5ffc87-035a-4e91-8fb5-8e44ed5704ac", "name": "network-vif-deleted", "tag": "53c4bcf8-a1ba-44b2-b6d2-735e655c1b9f"}]} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:06:08.441830 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:06:08.441830 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: warnings.warn(msg) Dec 16 15:06:08.457163 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-1bd59987-10e9-4178-b3e1-e9d88a8e4cf1 req-461e1ff6-def7-426b-8f39-0ad53544b531 service nova] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:08.459216 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-1bd59987-10e9-4178-b3e1-e9d88a8e4cf1 req-461e1ff6-def7-426b-8f39-0ad53544b531 service nova] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:08.487700 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.compute.server_external_events [req-1bd59987-10e9-4178-b3e1-e9d88a8e4cf1 req-461e1ff6-def7-426b-8f39-0ad53544b531 service nova] Unable to find a host for instance cd5ffc87-035a-4e91-8fb5-8e44ed5704ac. Dropping event network-vif-deleted {{(pid=101355) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:141}} Dec 16 15:06:08.487700 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [req-1bd59987-10e9-4178-b3e1-e9d88a8e4cf1 req-461e1ff6-def7-426b-8f39-0ad53544b531 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.148111 Dec 16 15:06:08.487700 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 622/1253] 10.222.0.45 () {64 vars in 1308 bytes} [Thu Dec 16 15:06:08 2021] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 149 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Dec 16 15:06:08.493646 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-9ca60552-4f0b-4618-bb86-37f2d7b7d8d2 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:06:08.494348 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-9ca60552-4f0b-4618-bb86-37f2d7b7d8d2 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:06:08.503405 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9ca60552-4f0b-4618-bb86-37f2d7b7d8d2 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:08.503914 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9ca60552-4f0b-4618-bb86-37f2d7b7d8d2 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:08.504775 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9ca60552-4f0b-4618-bb86-37f2d7b7d8d2 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:08.505266 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9ca60552-4f0b-4618-bb86-37f2d7b7d8d2 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:08.748313 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-9ca60552-4f0b-4618-bb86-37f2d7b7d8d2 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:06:08.759279 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-9ca60552-4f0b-4618-bb86-37f2d7b7d8d2 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.272873 Dec 16 15:06:08.760129 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 623/1254] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:06:08 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:06:08.900114 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.scheduler.client.report [None req-a186f87f-4315-4d08-ab1e-15ded8255143 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Deleted allocation for instance cd5ffc87-035a-4e91-8fb5-8e44ed5704ac Dec 16 15:06:09.217485 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-a186f87f-4315-4d08-ab1e-15ded8255143 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "DELETE /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 204 len: 0 microversion: 2.20 time: 4.068672 Dec 16 15:06:09.218365 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 632/1255] 10.222.0.45 () {60 vars in 1270 bytes} [Thu Dec 16 15:06:05 2021] DELETE /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 0 bytes in 4070 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 16 15:06:09.230755 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-3a4c9bb3-494f-427c-9bcb-ea37edd3ead4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:06:09.231530 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-3a4c9bb3-494f-427c-9bcb-ea37edd3ead4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:06:09.240334 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3a4c9bb3-494f-427c-9bcb-ea37edd3ead4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:09.240934 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3a4c9bb3-494f-427c-9bcb-ea37edd3ead4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:09.241865 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3a4c9bb3-494f-427c-9bcb-ea37edd3ead4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:09.242461 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3a4c9bb3-494f-427c-9bcb-ea37edd3ead4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:09.300085 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.wsgi [None req-3a4c9bb3-494f-427c-9bcb-ea37edd3ead4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] HTTP exception thrown: Instance cd5ffc87-035a-4e91-8fb5-8e44ed5704ac could not be found. Dec 16 15:06:09.300683 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-3a4c9bb3-494f-427c-9bcb-ea37edd3ead4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Returning 404 to user: Instance cd5ffc87-035a-4e91-8fb5-8e44ed5704ac could not be found. {{(pid=101355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:941}} Dec 16 15:06:09.301596 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-3a4c9bb3-494f-427c-9bcb-ea37edd3ead4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 404 len: 111 microversion: 2.20 time: 0.078709 Dec 16 15:06:09.302413 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 624/1256] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:06:09 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 16 15:06:09.316361 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-4a3c2993-3f40-4ef1-8655-194f7354b5d4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '.version_select at 0x7f14f7256158>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:06:09.397150 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-4a3c2993-3f40-4ef1-8655-194f7354b5d4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-491906442" status: 204 len: 0 microversion: 2.20 time: 0.089324 Dec 16 15:06:09.397986 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 633/1257] 10.222.0.45 () {60 vars in 1249 bytes} [Thu Dec 16 15:06:09 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-491906442 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 16 15:06:09.784629 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-a49526e5-ef3f-4552-abe1-a95de4968a98 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:06:09.785285 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-a49526e5-ef3f-4552-abe1-a95de4968a98 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:06:09.793436 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a49526e5-ef3f-4552-abe1-a95de4968a98 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:09.794230 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a49526e5-ef3f-4552-abe1-a95de4968a98 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:09.795093 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a49526e5-ef3f-4552-abe1-a95de4968a98 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:09.795592 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a49526e5-ef3f-4552-abe1-a95de4968a98 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:10.019459 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-a49526e5-ef3f-4552-abe1-a95de4968a98 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:06:10.028550 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-a49526e5-ef3f-4552-abe1-a95de4968a98 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.251610 Dec 16 15:06:10.029466 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 625/1258] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:06:09 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:06:10.684767 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-ae2801d7-90e8-4376-924d-86e2301f4129 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'create', calling method: .version_select at 0x7f14f72c1268>, body: {"keypair": {"name": "tempest-keypair-1018199780"}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:06:10.712261 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.quota [None req-ae2801d7-90e8-4376-924d-86e2301f4129 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Getting quotas for project ff7a06ecc2404836b66f3a06d4f34d63. Resources: {'key_pairs'} {{(pid=101356) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 16 15:06:10.716554 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.quota [None req-ae2801d7-90e8-4376-924d-86e2301f4129 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Getting quotas for user 7f435da8bee949fda856a880c75dfa46 and project ff7a06ecc2404836b66f3a06d4f34d63. Resources: {'key_pairs'} {{(pid=101356) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 16 15:06:10.958831 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.quota [None req-ae2801d7-90e8-4376-924d-86e2301f4129 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Getting quotas for project ff7a06ecc2404836b66f3a06d4f34d63. Resources: {'key_pairs'} {{(pid=101356) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 16 15:06:10.962972 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.quota [None req-ae2801d7-90e8-4376-924d-86e2301f4129 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Getting quotas for user 7f435da8bee949fda856a880c75dfa46 and project ff7a06ecc2404836b66f3a06d4f34d63. Resources: {'key_pairs'} {{(pid=101356) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 16 15:06:10.976339 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-ae2801d7-90e8-4376-924d-86e2301f4129 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 0.299043 Dec 16 15:06:10.976991 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 634/1259] 10.222.0.45 () {62 vars in 1189 bytes} [Thu Dec 16 15:06:10 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 300 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Dec 16 15:06:11.051849 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-026db946-0f59-4e37-bbb4-50386109520d tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:06:11.052515 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-026db946-0f59-4e37-bbb4-50386109520d tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:06:11.060479 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-026db946-0f59-4e37-bbb4-50386109520d tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:11.060990 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-026db946-0f59-4e37-bbb4-50386109520d tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:11.061827 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-026db946-0f59-4e37-bbb4-50386109520d tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:11.062341 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-026db946-0f59-4e37-bbb4-50386109520d tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:11.433649 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-026db946-0f59-4e37-bbb4-50386109520d tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:06:11.444677 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-026db946-0f59-4e37-bbb4-50386109520d tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.400984 Dec 16 15:06:11.445280 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 626/1260] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:06:11 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:06:12.467309 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-a3139619-3223-4550-9f4e-02b9df828868 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:06:12.468112 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-a3139619-3223-4550-9f4e-02b9df828868 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:06:12.477166 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a3139619-3223-4550-9f4e-02b9df828868 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:12.477681 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a3139619-3223-4550-9f4e-02b9df828868 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:12.478568 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a3139619-3223-4550-9f4e-02b9df828868 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:12.479066 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a3139619-3223-4550-9f4e-02b9df828868 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:12.709699 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-a3139619-3223-4550-9f4e-02b9df828868 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:06:12.718550 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-a3139619-3223-4550-9f4e-02b9df828868 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.258983 Dec 16 15:06:12.719160 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 635/1261] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:06:12 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:06:13.479359 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-3819afcb-6757-4661-a6e5-5ded3d96e37f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1139734071", "imageRef": "9b00ff4e-db72-4324-820b-87a6bd73b055", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1ab48171-7751-49dd-8d19-babe4bef5701"}], "security_groups": [{"name": "tempest-securitygroup--2140247713"}], "key_name": "tempest-keypair-1018199780", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:06:13.744485 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-d33850be-e0f0-4420-8ffe-ac41fa934d93 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:06:13.745538 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-d33850be-e0f0-4420-8ffe-ac41fa934d93 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:06:13.754770 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d33850be-e0f0-4420-8ffe-ac41fa934d93 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:13.755255 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d33850be-e0f0-4420-8ffe-ac41fa934d93 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:13.756330 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d33850be-e0f0-4420-8ffe-ac41fa934d93 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:13.763874 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d33850be-e0f0-4420-8ffe-ac41fa934d93 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:13.849685 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.network.neutron [None req-3819afcb-6757-4661-a6e5-5ded3d96e37f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] validate_networks() for [('1ab48171-7751-49dd-8d19-babe4bef5701', None, None, None)] {{(pid=101355) validate_networks /opt/stack/nova/nova/network/neutron.py:2383}} Dec 16 15:06:13.991821 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-d33850be-e0f0-4420-8ffe-ac41fa934d93 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:06:14.001290 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-d33850be-e0f0-4420-8ffe-ac41fa934d93 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.267858 Dec 16 15:06:14.002141 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 636/1262] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:06:13 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:06:14.502615 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.virt.hardware [None req-3819afcb-6757-4661-a6e5-5ded3d96e37f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Flavor limits 0:0:0 {{(pid=101355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:338}} Dec 16 15:06:14.503099 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.virt.hardware [None req-3819afcb-6757-4661-a6e5-5ded3d96e37f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Image limits 0:0:0 {{(pid=101355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:342}} Dec 16 15:06:14.503653 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.virt.hardware [None req-3819afcb-6757-4661-a6e5-5ded3d96e37f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Flavor pref 0:0:0 {{(pid=101355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:378}} Dec 16 15:06:14.504111 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.virt.hardware [None req-3819afcb-6757-4661-a6e5-5ded3d96e37f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Image pref 0:0:0 {{(pid=101355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:382}} Dec 16 15:06:14.504573 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.virt.hardware [None req-3819afcb-6757-4661-a6e5-5ded3d96e37f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=101355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:422}} Dec 16 15:06:14.513455 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3819afcb-6757-4661-a6e5-5ded3d96e37f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:14.513956 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3819afcb-6757-4661-a6e5-5ded3d96e37f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:14.514856 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3819afcb-6757-4661-a6e5-5ded3d96e37f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:14.515350 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3819afcb-6757-4661-a6e5-5ded3d96e37f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:14.534232 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.quota [None req-3819afcb-6757-4661-a6e5-5ded3d96e37f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Getting quotas for project ff7a06ecc2404836b66f3a06d4f34d63. Resources: {'ram', 'instances', 'cores'} {{(pid=101355) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 16 15:06:14.538403 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.quota [None req-3819afcb-6757-4661-a6e5-5ded3d96e37f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Getting quotas for user 7f435da8bee949fda856a880c75dfa46 and project ff7a06ecc2404836b66f3a06d4f34d63. Resources: {'ram', 'instances', 'cores'} {{(pid=101355) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 16 15:06:14.550160 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-3819afcb-6757-4661-a6e5-5ded3d96e37f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Going to run 1 instances... {{(pid=101355) _provision_instances /opt/stack/nova/nova/compute/api.py:1224}} Dec 16 15:06:14.552705 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-3819afcb-6757-4661-a6e5-5ded3d96e37f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: 54869618-8ecd-4fac-8904-fe0b3bf2d3b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9b00ff4e-db72-4324-820b-87a6bd73b055',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1616}} Dec 16 15:06:14.720670 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-3819afcb-6757-4661-a6e5-5ded3d96e37f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.248915 Dec 16 15:06:14.721385 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 627/1263] 10.222.0.45 () {62 vars in 1178 bytes} [Thu Dec 16 15:06:13 2021] POST /compute/v2.1/servers => generated 402 bytes in 1251 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Dec 16 15:06:14.736659 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-31396d53-c948-4838-bdb5-ce66aa2f3912 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:06:14.737409 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-31396d53-c948-4838-bdb5-ce66aa2f3912 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: 54869618-8ecd-4fac-8904-fe0b3bf2d3b5] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:06:14.853447 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-31396d53-c948-4838-bdb5-ce66aa2f3912 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:06:14.868646 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-31396d53-c948-4838-bdb5-ce66aa2f3912 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:06:14.873283 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-31396d53-c948-4838-bdb5-ce66aa2f3912 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:06:14.874288 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-31396d53-c948-4838-bdb5-ce66aa2f3912 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5" status: 200 len: 1282 microversion: 2.20 time: 0.146033 Dec 16 15:06:14.874855 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 637/1264] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:06:14 2021] GET /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5 => generated 1282 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 15:06:15.023379 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-995263af-90bb-4476-a933-e37452edbdea tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:06:15.024147 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-995263af-90bb-4476-a933-e37452edbdea tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:06:15.032435 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-995263af-90bb-4476-a933-e37452edbdea tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:15.032953 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-995263af-90bb-4476-a933-e37452edbdea tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:15.033806 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-995263af-90bb-4476-a933-e37452edbdea tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:15.034334 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-995263af-90bb-4476-a933-e37452edbdea tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:15.310190 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-995263af-90bb-4476-a933-e37452edbdea tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:06:15.321013 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-995263af-90bb-4476-a933-e37452edbdea tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.305579 Dec 16 15:06:15.321612 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 628/1265] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:06:15 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:06:15.896830 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-d65b9bd6-436a-4280-a8d2-7190d52e156f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:06:15.897499 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-d65b9bd6-436a-4280-a8d2-7190d52e156f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: 54869618-8ecd-4fac-8904-fe0b3bf2d3b5] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:06:15.905328 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d65b9bd6-436a-4280-a8d2-7190d52e156f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:15.905835 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d65b9bd6-436a-4280-a8d2-7190d52e156f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:15.906713 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d65b9bd6-436a-4280-a8d2-7190d52e156f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:15.907276 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d65b9bd6-436a-4280-a8d2-7190d52e156f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:16.051416 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-d65b9bd6-436a-4280-a8d2-7190d52e156f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:06:16.063634 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-d65b9bd6-436a-4280-a8d2-7190d52e156f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:06:16.068143 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-d65b9bd6-436a-4280-a8d2-7190d52e156f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:06:16.069545 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-d65b9bd6-436a-4280-a8d2-7190d52e156f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5" status: 200 len: 1278 microversion: 2.20 time: 0.180288 Dec 16 15:06:16.070158 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 638/1266] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:06:15 2021] GET /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5 => generated 1278 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:06:16.343406 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-072fc2af-d281-4c4d-bb55-ad2e4962f808 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:06:16.344456 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-072fc2af-d281-4c4d-bb55-ad2e4962f808 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:06:16.353494 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-072fc2af-d281-4c4d-bb55-ad2e4962f808 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:16.354165 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-072fc2af-d281-4c4d-bb55-ad2e4962f808 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:16.355115 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-072fc2af-d281-4c4d-bb55-ad2e4962f808 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:16.355667 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-072fc2af-d281-4c4d-bb55-ad2e4962f808 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:16.571863 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-072fc2af-d281-4c4d-bb55-ad2e4962f808 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:06:16.581908 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-072fc2af-d281-4c4d-bb55-ad2e4962f808 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.246159 Dec 16 15:06:16.582533 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 629/1267] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:06:16 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:06:17.092387 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-42f43b23-cf14-4563-8605-173b7038785a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:06:17.093868 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-42f43b23-cf14-4563-8605-173b7038785a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: 54869618-8ecd-4fac-8904-fe0b3bf2d3b5] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:06:17.102459 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-42f43b23-cf14-4563-8605-173b7038785a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:17.103071 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-42f43b23-cf14-4563-8605-173b7038785a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:17.103971 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-42f43b23-cf14-4563-8605-173b7038785a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:17.104462 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-42f43b23-cf14-4563-8605-173b7038785a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:17.232265 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-42f43b23-cf14-4563-8605-173b7038785a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:06:17.245157 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-42f43b23-cf14-4563-8605-173b7038785a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:06:17.249666 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-42f43b23-cf14-4563-8605-173b7038785a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:06:17.250853 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-42f43b23-cf14-4563-8605-173b7038785a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5" status: 200 len: 1340 microversion: 2.20 time: 0.166150 Dec 16 15:06:17.251480 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 639/1268] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:06:17 2021] GET /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5 => generated 1340 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:06:17.604239 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-b06bbb69-4a06-48f9-96a0-a62ba164d873 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:06:17.605082 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-b06bbb69-4a06-48f9-96a0-a62ba164d873 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:06:17.613943 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b06bbb69-4a06-48f9-96a0-a62ba164d873 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:17.614485 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b06bbb69-4a06-48f9-96a0-a62ba164d873 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:17.615343 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b06bbb69-4a06-48f9-96a0-a62ba164d873 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:17.615843 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b06bbb69-4a06-48f9-96a0-a62ba164d873 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:18.070960 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-b06bbb69-4a06-48f9-96a0-a62ba164d873 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:06:18.080731 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-b06bbb69-4a06-48f9-96a0-a62ba164d873 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.485112 Dec 16 15:06:18.081341 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 630/1269] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:06:17 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:06:18.278808 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-1be307a9-19cc-45ec-aa54-571e1d19eac2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:06:18.279480 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-1be307a9-19cc-45ec-aa54-571e1d19eac2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: 54869618-8ecd-4fac-8904-fe0b3bf2d3b5] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:06:18.289562 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1be307a9-19cc-45ec-aa54-571e1d19eac2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:18.290395 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1be307a9-19cc-45ec-aa54-571e1d19eac2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:18.291534 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1be307a9-19cc-45ec-aa54-571e1d19eac2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:18.292060 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1be307a9-19cc-45ec-aa54-571e1d19eac2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:18.550340 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-1be307a9-19cc-45ec-aa54-571e1d19eac2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:06:18.565055 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-1be307a9-19cc-45ec-aa54-571e1d19eac2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:06:18.570020 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-1be307a9-19cc-45ec-aa54-571e1d19eac2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:06:18.571211 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-1be307a9-19cc-45ec-aa54-571e1d19eac2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5" status: 200 len: 1408 microversion: 2.20 time: 0.302945 Dec 16 15:06:18.578257 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 640/1270] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:06:18 2021] GET /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5 => generated 1408 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:06:19.103442 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-490145e2-2a47-4a5d-96f7-64e2a27cd6d0 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:06:19.104116 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-490145e2-2a47-4a5d-96f7-64e2a27cd6d0 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:06:19.112572 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-490145e2-2a47-4a5d-96f7-64e2a27cd6d0 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:19.113090 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-490145e2-2a47-4a5d-96f7-64e2a27cd6d0 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:19.113935 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-490145e2-2a47-4a5d-96f7-64e2a27cd6d0 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:19.114460 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-490145e2-2a47-4a5d-96f7-64e2a27cd6d0 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:19.429269 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [req-dede0cc9-1ef1-4458-a377-a58ada1e7b78 req-d9b75ad2-42b3-433c-a720-072ce7916fdb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54869618-8ecd-4fac-8904-fe0b3bf2d3b5", "tag": "1bad7080-7c47-432c-95a6-beb94a24904a"}]} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:06:19.434033 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:06:19.434033 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: warnings.warn(msg) Dec 16 15:06:19.438868 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c006f2bf-d7e6-4bb8-aace-c3797b4b538d] AMQP server on 10.222.0.45:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 15:06:19.446274 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-dede0cc9-1ef1-4458-a377-a58ada1e7b78 req-d9b75ad2-42b3-433c-a720-072ce7916fdb service nova] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:19.446784 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-dede0cc9-1ef1-4458-a377-a58ada1e7b78 req-d9b75ad2-42b3-433c-a720-072ce7916fdb service nova] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:19.465466 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.compute.server_external_events [req-dede0cc9-1ef1-4458-a377-a58ada1e7b78 req-d9b75ad2-42b3-433c-a720-072ce7916fdb service nova] Creating event network-changed:1bad7080-7c47-432c-95a6-beb94a24904a for instance 54869618-8ecd-4fac-8904-fe0b3bf2d3b5 on hv-cinder-82189 Dec 16 15:06:19.472883 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [req-dede0cc9-1ef1-4458-a377-a58ada1e7b78 req-d9b75ad2-42b3-433c-a720-072ce7916fdb service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.185338 Dec 16 15:06:19.474103 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 641/1271] 10.222.0.45 () {64 vars in 1308 bytes} [Thu Dec 16 15:06:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:06:19.489384 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-490145e2-2a47-4a5d-96f7-64e2a27cd6d0 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:06:19.499731 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-490145e2-2a47-4a5d-96f7-64e2a27cd6d0 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.404299 Dec 16 15:06:19.500570 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 631/1272] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:06:19 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:06:19.594960 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-159d424c-0ab0-4509-bca0-88525f7390ed tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:06:19.596311 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-159d424c-0ab0-4509-bca0-88525f7390ed tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: 54869618-8ecd-4fac-8904-fe0b3bf2d3b5] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:06:19.604579 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-159d424c-0ab0-4509-bca0-88525f7390ed tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:19.605089 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-159d424c-0ab0-4509-bca0-88525f7390ed tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:19.605938 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-159d424c-0ab0-4509-bca0-88525f7390ed tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:19.606457 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-159d424c-0ab0-4509-bca0-88525f7390ed tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:19.831772 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-159d424c-0ab0-4509-bca0-88525f7390ed tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:06:19.844662 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-159d424c-0ab0-4509-bca0-88525f7390ed tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:06:19.850568 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-159d424c-0ab0-4509-bca0-88525f7390ed tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:06:19.850568 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-159d424c-0ab0-4509-bca0-88525f7390ed tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5" status: 200 len: 1408 microversion: 2.20 time: 0.263647 Dec 16 15:06:19.861405 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 642/1273] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:06:19 2021] GET /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5 => generated 1408 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:06:20.522293 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-8d7fface-f07f-4252-9b9a-15c895a90461 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:06:20.522975 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-8d7fface-f07f-4252-9b9a-15c895a90461 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:06:20.531204 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8d7fface-f07f-4252-9b9a-15c895a90461 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:20.531709 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8d7fface-f07f-4252-9b9a-15c895a90461 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:20.533066 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8d7fface-f07f-4252-9b9a-15c895a90461 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:20.533566 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8d7fface-f07f-4252-9b9a-15c895a90461 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:20.872977 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-e6bad10f-e885-4618-a340-cfa6a01c3542 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:06:20.873770 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-e6bad10f-e885-4618-a340-cfa6a01c3542 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: 54869618-8ecd-4fac-8904-fe0b3bf2d3b5] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:06:20.896370 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO oslo.messaging._drivers.impl_rabbit [-] [c006f2bf-d7e6-4bb8-aace-c3797b4b538d] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 43880. Dec 16 15:06:20.900451 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e6bad10f-e885-4618-a340-cfa6a01c3542 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:20.900966 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e6bad10f-e885-4618-a340-cfa6a01c3542 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:20.901817 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e6bad10f-e885-4618-a340-cfa6a01c3542 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:20.902338 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e6bad10f-e885-4618-a340-cfa6a01c3542 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:20.924540 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-8d7fface-f07f-4252-9b9a-15c895a90461 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:06:20.938671 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-8d7fface-f07f-4252-9b9a-15c895a90461 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.424060 Dec 16 15:06:20.940040 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 632/1274] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:06:20 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:06:21.128798 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-e6bad10f-e885-4618-a340-cfa6a01c3542 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:06:21.141117 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-e6bad10f-e885-4618-a340-cfa6a01c3542 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:06:21.146126 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-e6bad10f-e885-4618-a340-cfa6a01c3542 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:06:21.147374 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-e6bad10f-e885-4618-a340-cfa6a01c3542 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5" status: 200 len: 1408 microversion: 2.20 time: 0.282335 Dec 16 15:06:21.147961 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 643/1275] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:06:20 2021] GET /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5 => generated 1408 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 16 15:06:21.963124 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-b69e1da8-76c5-496c-b724-f3dfae17d4d1 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:06:21.963840 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-b69e1da8-76c5-496c-b724-f3dfae17d4d1 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:06:21.977357 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b69e1da8-76c5-496c-b724-f3dfae17d4d1 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:21.977872 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b69e1da8-76c5-496c-b724-f3dfae17d4d1 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:21.978752 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b69e1da8-76c5-496c-b724-f3dfae17d4d1 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:21.979248 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b69e1da8-76c5-496c-b724-f3dfae17d4d1 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:22.170872 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-4eefb00d-f215-4565-bfc3-42e48e39a0a0 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:06:22.171633 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-4eefb00d-f215-4565-bfc3-42e48e39a0a0 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: 54869618-8ecd-4fac-8904-fe0b3bf2d3b5] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:06:22.179580 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4eefb00d-f215-4565-bfc3-42e48e39a0a0 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:22.180092 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4eefb00d-f215-4565-bfc3-42e48e39a0a0 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:22.180996 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4eefb00d-f215-4565-bfc3-42e48e39a0a0 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:22.181486 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4eefb00d-f215-4565-bfc3-42e48e39a0a0 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:22.192412 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-b69e1da8-76c5-496c-b724-f3dfae17d4d1 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:06:22.201595 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-b69e1da8-76c5-496c-b724-f3dfae17d4d1 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.246197 Dec 16 15:06:22.202214 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 633/1276] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:06:21 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:06:22.400041 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-4eefb00d-f215-4565-bfc3-42e48e39a0a0 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:06:22.412275 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-4eefb00d-f215-4565-bfc3-42e48e39a0a0 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:06:22.416736 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-4eefb00d-f215-4565-bfc3-42e48e39a0a0 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:06:22.417863 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-4eefb00d-f215-4565-bfc3-42e48e39a0a0 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5" status: 200 len: 1408 microversion: 2.20 time: 0.254862 Dec 16 15:06:22.418465 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 644/1277] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:06:22 2021] GET /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5 => generated 1408 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:06:23.224630 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-e0b6c38a-2f2f-4a76-a5c3-407be2c4c947 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:06:23.225298 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-e0b6c38a-2f2f-4a76-a5c3-407be2c4c947 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:06:23.233155 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e0b6c38a-2f2f-4a76-a5c3-407be2c4c947 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:23.233654 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e0b6c38a-2f2f-4a76-a5c3-407be2c4c947 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:23.234535 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e0b6c38a-2f2f-4a76-a5c3-407be2c4c947 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:23.235047 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e0b6c38a-2f2f-4a76-a5c3-407be2c4c947 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:23.441040 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-1e30f43e-1248-43f1-81d1-c481c509e247 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:06:23.441632 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-1e30f43e-1248-43f1-81d1-c481c509e247 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: 54869618-8ecd-4fac-8904-fe0b3bf2d3b5] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:06:23.449788 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1e30f43e-1248-43f1-81d1-c481c509e247 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:23.450345 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1e30f43e-1248-43f1-81d1-c481c509e247 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:23.451529 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1e30f43e-1248-43f1-81d1-c481c509e247 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:23.451648 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1e30f43e-1248-43f1-81d1-c481c509e247 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:23.463162 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-e0b6c38a-2f2f-4a76-a5c3-407be2c4c947 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:06:23.472543 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-e0b6c38a-2f2f-4a76-a5c3-407be2c4c947 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.256314 Dec 16 15:06:23.473137 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 634/1278] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:06:23 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:06:23.668535 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-1e30f43e-1248-43f1-81d1-c481c509e247 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:06:23.682785 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-1e30f43e-1248-43f1-81d1-c481c509e247 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:06:23.687419 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-1e30f43e-1248-43f1-81d1-c481c509e247 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:06:23.688749 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-1e30f43e-1248-43f1-81d1-c481c509e247 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5" status: 200 len: 1408 microversion: 2.20 time: 0.255149 Dec 16 15:06:23.689337 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 645/1279] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:06:23 2021] GET /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5 => generated 1408 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:06:24.494166 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-8bcf1d85-5016-43f1-b1a0-2ce9f7ae446a tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:06:24.494828 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-8bcf1d85-5016-43f1-b1a0-2ce9f7ae446a tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:06:24.503172 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8bcf1d85-5016-43f1-b1a0-2ce9f7ae446a tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:24.503622 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8bcf1d85-5016-43f1-b1a0-2ce9f7ae446a tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:24.504446 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8bcf1d85-5016-43f1-b1a0-2ce9f7ae446a tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:24.504933 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8bcf1d85-5016-43f1-b1a0-2ce9f7ae446a tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:24.714265 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-8547e0b9-bf38-4d57-a820-16438991f545 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:06:24.714931 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-8547e0b9-bf38-4d57-a820-16438991f545 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: 54869618-8ecd-4fac-8904-fe0b3bf2d3b5] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:06:24.719672 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-8bcf1d85-5016-43f1-b1a0-2ce9f7ae446a tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:06:24.722708 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8547e0b9-bf38-4d57-a820-16438991f545 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:24.723215 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8547e0b9-bf38-4d57-a820-16438991f545 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:24.724049 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8547e0b9-bf38-4d57-a820-16438991f545 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:24.724534 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8547e0b9-bf38-4d57-a820-16438991f545 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:24.728624 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-8bcf1d85-5016-43f1-b1a0-2ce9f7ae446a tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.242259 Dec 16 15:06:24.729224 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 635/1280] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:06:24 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:06:24.944957 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-8547e0b9-bf38-4d57-a820-16438991f545 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:06:24.957588 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-8547e0b9-bf38-4d57-a820-16438991f545 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:06:24.962109 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-8547e0b9-bf38-4d57-a820-16438991f545 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:06:24.963248 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-8547e0b9-bf38-4d57-a820-16438991f545 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5" status: 200 len: 1408 microversion: 2.20 time: 0.256650 Dec 16 15:06:24.963952 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 646/1281] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:06:24 2021] GET /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5 => generated 1408 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:06:25.751128 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-d19eecfc-f968-44c3-880b-8fa08e7e6faa tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:06:25.751729 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-d19eecfc-f968-44c3-880b-8fa08e7e6faa tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:06:25.760100 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d19eecfc-f968-44c3-880b-8fa08e7e6faa tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:25.760610 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d19eecfc-f968-44c3-880b-8fa08e7e6faa tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:25.761453 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d19eecfc-f968-44c3-880b-8fa08e7e6faa tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:25.761957 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d19eecfc-f968-44c3-880b-8fa08e7e6faa tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:25.974070 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-d19eecfc-f968-44c3-880b-8fa08e7e6faa tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:06:25.983450 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-d19eecfc-f968-44c3-880b-8fa08e7e6faa tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.240067 Dec 16 15:06:25.984032 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 636/1282] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:06:25 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:06:25.987355 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-8fd90e7f-4d68-405d-a854-6efc52283d83 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:06:25.988185 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-8fd90e7f-4d68-405d-a854-6efc52283d83 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: 54869618-8ecd-4fac-8904-fe0b3bf2d3b5] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:06:25.996227 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8fd90e7f-4d68-405d-a854-6efc52283d83 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:25.996734 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8fd90e7f-4d68-405d-a854-6efc52283d83 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:25.997575 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8fd90e7f-4d68-405d-a854-6efc52283d83 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:25.998120 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8fd90e7f-4d68-405d-a854-6efc52283d83 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:26.223776 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-8fd90e7f-4d68-405d-a854-6efc52283d83 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:06:26.238292 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-8fd90e7f-4d68-405d-a854-6efc52283d83 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:06:26.242841 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-8fd90e7f-4d68-405d-a854-6efc52283d83 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:06:26.243996 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-8fd90e7f-4d68-405d-a854-6efc52283d83 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5" status: 200 len: 1408 microversion: 2.20 time: 0.264931 Dec 16 15:06:26.244586 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 647/1283] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:06:25 2021] GET /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5 => generated 1408 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:06:26.302061 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [req-eaba184b-4bef-4c4c-8693-75036e64b848 req-b435cf50-6bd3-403e-b299-134ab5cfbb20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54869618-8ecd-4fac-8904-fe0b3bf2d3b5", "name": "network-vif-plugged", "status": "completed", "tag": "1bad7080-7c47-432c-95a6-beb94a24904a"}]} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:06:26.306785 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:06:26.306785 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: warnings.warn(msg) Dec 16 15:06:26.316206 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-eaba184b-4bef-4c4c-8693-75036e64b848 req-b435cf50-6bd3-403e-b299-134ab5cfbb20 service nova] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:26.316701 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-eaba184b-4bef-4c4c-8693-75036e64b848 req-b435cf50-6bd3-403e-b299-134ab5cfbb20 service nova] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:26.337183 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.compute.server_external_events [req-eaba184b-4bef-4c4c-8693-75036e64b848 req-b435cf50-6bd3-403e-b299-134ab5cfbb20 service nova] Creating event network-vif-plugged:1bad7080-7c47-432c-95a6-beb94a24904a for instance 54869618-8ecd-4fac-8904-fe0b3bf2d3b5 on hv-cinder-82189 Dec 16 15:06:26.342626 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [req-eaba184b-4bef-4c4c-8693-75036e64b848 req-b435cf50-6bd3-403e-b299-134ab5cfbb20 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048948 Dec 16 15:06:26.343268 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 637/1284] 10.222.0.45 () {64 vars in 1308 bytes} [Thu Dec 16 15:06:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:06:27.005898 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-27372eed-9c48-4051-8324-6623d7fcbdd0 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:06:27.006549 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-27372eed-9c48-4051-8324-6623d7fcbdd0 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:06:27.014441 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-27372eed-9c48-4051-8324-6623d7fcbdd0 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:27.014949 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-27372eed-9c48-4051-8324-6623d7fcbdd0 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:27.015781 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-27372eed-9c48-4051-8324-6623d7fcbdd0 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:27.016274 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-27372eed-9c48-4051-8324-6623d7fcbdd0 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:27.237207 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-27372eed-9c48-4051-8324-6623d7fcbdd0 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:06:27.246122 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-27372eed-9c48-4051-8324-6623d7fcbdd0 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.248312 Dec 16 15:06:27.246707 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 648/1285] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:06:26 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:06:27.261816 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c89047bd-5046-4dc5-81a4-5f3a093a9e0b] AMQP server on 10.222.0.45:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 15:06:27.269338 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-e3771359-504b-42fc-a054-e0a6fb445274 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:06:27.270126 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-e3771359-504b-42fc-a054-e0a6fb445274 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: 54869618-8ecd-4fac-8904-fe0b3bf2d3b5] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:06:27.278129 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e3771359-504b-42fc-a054-e0a6fb445274 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:27.278642 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e3771359-504b-42fc-a054-e0a6fb445274 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:27.279481 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e3771359-504b-42fc-a054-e0a6fb445274 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:27.279978 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e3771359-504b-42fc-a054-e0a6fb445274 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:27.546211 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-e3771359-504b-42fc-a054-e0a6fb445274 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:06:27.559010 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-e3771359-504b-42fc-a054-e0a6fb445274 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:06:27.563471 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-e3771359-504b-42fc-a054-e0a6fb445274 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:06:27.564607 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-e3771359-504b-42fc-a054-e0a6fb445274 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5" status: 200 len: 1408 microversion: 2.20 time: 0.304521 Dec 16 15:06:27.565187 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 638/1286] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:06:27 2021] GET /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5 => generated 1408 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:06:28.269100 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-d5d498ba-aa48-4df8-ad36-9aa9e9dc09eb tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:06:28.270467 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-d5d498ba-aa48-4df8-ad36-9aa9e9dc09eb tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:06:28.280887 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d5d498ba-aa48-4df8-ad36-9aa9e9dc09eb tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:28.281653 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d5d498ba-aa48-4df8-ad36-9aa9e9dc09eb tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:28.282965 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d5d498ba-aa48-4df8-ad36-9aa9e9dc09eb tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:28.283670 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d5d498ba-aa48-4df8-ad36-9aa9e9dc09eb tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:28.519290 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-d5d498ba-aa48-4df8-ad36-9aa9e9dc09eb tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:06:28.528181 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-d5d498ba-aa48-4df8-ad36-9aa9e9dc09eb tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.268047 Dec 16 15:06:28.528777 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 649/1287] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:06:28 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:06:28.586986 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-0034a0f5-d964-47d3-9f71-80df90cae3b2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:06:28.587644 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-0034a0f5-d964-47d3-9f71-80df90cae3b2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: 54869618-8ecd-4fac-8904-fe0b3bf2d3b5] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:06:28.607704 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0034a0f5-d964-47d3-9f71-80df90cae3b2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:28.608208 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0034a0f5-d964-47d3-9f71-80df90cae3b2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:28.609047 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0034a0f5-d964-47d3-9f71-80df90cae3b2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:28.609532 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0034a0f5-d964-47d3-9f71-80df90cae3b2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:28.645734 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO oslo.messaging._drivers.impl_rabbit [-] [c89047bd-5046-4dc5-81a4-5f3a093a9e0b] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 43964. Dec 16 15:06:28.828067 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-0034a0f5-d964-47d3-9f71-80df90cae3b2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:06:28.840237 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-0034a0f5-d964-47d3-9f71-80df90cae3b2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:06:28.844729 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-0034a0f5-d964-47d3-9f71-80df90cae3b2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:06:28.846439 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-0034a0f5-d964-47d3-9f71-80df90cae3b2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5" status: 200 len: 1600 microversion: 2.20 time: 0.266705 Dec 16 15:06:28.847016 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 639/1288] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:06:28 2021] GET /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5 => generated 1600 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:06:28.869043 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-7100e27d-3964-4d13-acd0-1f610e2b9bb6 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:06:28.869586 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-7100e27d-3964-4d13-acd0-1f610e2b9bb6 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: 54869618-8ecd-4fac-8904-fe0b3bf2d3b5] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:06:28.877830 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7100e27d-3964-4d13-acd0-1f610e2b9bb6 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:28.878378 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7100e27d-3964-4d13-acd0-1f610e2b9bb6 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:28.879210 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7100e27d-3964-4d13-acd0-1f610e2b9bb6 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:28.879702 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7100e27d-3964-4d13-acd0-1f610e2b9bb6 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:29.038628 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-7100e27d-3964-4d13-acd0-1f610e2b9bb6 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.177731 Dec 16 15:06:29.039280 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 650/1289] 10.222.0.45 () {60 vars in 1306 bytes} [Thu Dec 16 15:06:28 2021] GET /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/os-interface => generated 285 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:06:29.553199 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-447f2ead-c617-4a54-9687-b866bf87be6e tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:06:29.553879 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-447f2ead-c617-4a54-9687-b866bf87be6e tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:06:29.561882 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-447f2ead-c617-4a54-9687-b866bf87be6e tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:29.562423 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-447f2ead-c617-4a54-9687-b866bf87be6e tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:29.563260 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-447f2ead-c617-4a54-9687-b866bf87be6e tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:29.563742 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-447f2ead-c617-4a54-9687-b866bf87be6e tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:29.786712 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-447f2ead-c617-4a54-9687-b866bf87be6e tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:06:29.796186 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-447f2ead-c617-4a54-9687-b866bf87be6e tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.253409 Dec 16 15:06:29.797005 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 640/1290] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:06:29 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:06:30.820136 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-45bf43fc-93a1-404b-a7ad-c0cbd8e1c137 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:06:30.820810 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-45bf43fc-93a1-404b-a7ad-c0cbd8e1c137 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:06:30.828670 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-45bf43fc-93a1-404b-a7ad-c0cbd8e1c137 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:30.829170 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-45bf43fc-93a1-404b-a7ad-c0cbd8e1c137 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:30.830007 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-45bf43fc-93a1-404b-a7ad-c0cbd8e1c137 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:30.830517 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-45bf43fc-93a1-404b-a7ad-c0cbd8e1c137 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:31.006017 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-bfe2ecc8-f56e-44a9-b882-48168699a08b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:06:31.007375 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-bfe2ecc8-f56e-44a9-b882-48168699a08b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: 54869618-8ecd-4fac-8904-fe0b3bf2d3b5] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:06:31.015348 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-bfe2ecc8-f56e-44a9-b882-48168699a08b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:31.015872 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-bfe2ecc8-f56e-44a9-b882-48168699a08b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:31.016722 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-bfe2ecc8-f56e-44a9-b882-48168699a08b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:31.017216 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-bfe2ecc8-f56e-44a9-b882-48168699a08b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:31.089638 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-45bf43fc-93a1-404b-a7ad-c0cbd8e1c137 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:06:31.099412 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-45bf43fc-93a1-404b-a7ad-c0cbd8e1c137 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.287828 Dec 16 15:06:31.100099 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 651/1291] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:06:30 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:06:31.108365 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [req-d038c74a-ed49-4e40-878e-a79a8105ec87 req-2f61b0ca-a3c8-428c-b6d2-a6a62b49f9ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54869618-8ecd-4fac-8904-fe0b3bf2d3b5", "tag": "1bad7080-7c47-432c-95a6-beb94a24904a"}]} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:06:31.113643 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:06:31.113643 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: warnings.warn(msg) Dec 16 15:06:31.122520 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-d038c74a-ed49-4e40-878e-a79a8105ec87 req-2f61b0ca-a3c8-428c-b6d2-a6a62b49f9ff service nova] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:31.123042 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-d038c74a-ed49-4e40-878e-a79a8105ec87 req-2f61b0ca-a3c8-428c-b6d2-a6a62b49f9ff service nova] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:31.140040 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.compute.server_external_events [req-d038c74a-ed49-4e40-878e-a79a8105ec87 req-2f61b0ca-a3c8-428c-b6d2-a6a62b49f9ff service nova] Creating event network-changed:1bad7080-7c47-432c-95a6-beb94a24904a for instance 54869618-8ecd-4fac-8904-fe0b3bf2d3b5 on hv-cinder-82189 Dec 16 15:06:31.145321 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [req-d038c74a-ed49-4e40-878e-a79a8105ec87 req-2f61b0ca-a3c8-428c-b6d2-a6a62b49f9ff service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043886 Dec 16 15:06:31.145907 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 652/1292] 10.222.0.45 () {64 vars in 1308 bytes} [Thu Dec 16 15:06:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:06:31.148071 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-bfe2ecc8-f56e-44a9-b882-48168699a08b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action" status: 200 len: 14 microversion: 2.20 time: 0.152008 Dec 16 15:06:31.148837 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 641/1293] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 15:06:30 2021] POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action => generated 14 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:06:32.121422 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-df8edc21-abcb-46e3-90e7-efd8dbf3e301 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:06:32.122251 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-df8edc21-abcb-46e3-90e7-efd8dbf3e301 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:06:32.130248 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-df8edc21-abcb-46e3-90e7-efd8dbf3e301 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:32.130754 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-df8edc21-abcb-46e3-90e7-efd8dbf3e301 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:32.131598 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-df8edc21-abcb-46e3-90e7-efd8dbf3e301 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:32.132093 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-df8edc21-abcb-46e3-90e7-efd8dbf3e301 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:32.165227 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-94919ff0-2b2f-4400-8800-d93471adbec1 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:06:32.166601 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-94919ff0-2b2f-4400-8800-d93471adbec1 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: 54869618-8ecd-4fac-8904-fe0b3bf2d3b5] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:06:32.175357 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-94919ff0-2b2f-4400-8800-d93471adbec1 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:32.175874 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-94919ff0-2b2f-4400-8800-d93471adbec1 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:32.176742 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-94919ff0-2b2f-4400-8800-d93471adbec1 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:32.177244 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-94919ff0-2b2f-4400-8800-d93471adbec1 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:32.300603 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-94919ff0-2b2f-4400-8800-d93471adbec1 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action" status: 200 len: 14 microversion: 2.20 time: 0.144122 Dec 16 15:06:32.301286 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 642/1294] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 15:06:32 2021] POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action => generated 14 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:06:32.359059 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-df8edc21-abcb-46e3-90e7-efd8dbf3e301 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:06:32.367992 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-df8edc21-abcb-46e3-90e7-efd8dbf3e301 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.254835 Dec 16 15:06:32.368634 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 653/1295] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:06:32 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:06:33.316701 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-e90335a7-1595-49f5-9379-afdb33f3e6ba tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:06:33.317836 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-e90335a7-1595-49f5-9379-afdb33f3e6ba tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: 54869618-8ecd-4fac-8904-fe0b3bf2d3b5] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:06:33.326723 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e90335a7-1595-49f5-9379-afdb33f3e6ba tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:33.327233 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e90335a7-1595-49f5-9379-afdb33f3e6ba tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:33.328071 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e90335a7-1595-49f5-9379-afdb33f3e6ba tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:33.328578 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e90335a7-1595-49f5-9379-afdb33f3e6ba tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:33.388967 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-4b568f69-4e93-4f08-9abd-1c63ed7a21ba tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:06:33.389842 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-4b568f69-4e93-4f08-9abd-1c63ed7a21ba tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:06:33.397720 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4b568f69-4e93-4f08-9abd-1c63ed7a21ba tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:33.398961 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4b568f69-4e93-4f08-9abd-1c63ed7a21ba tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:33.399857 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4b568f69-4e93-4f08-9abd-1c63ed7a21ba tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:33.400345 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4b568f69-4e93-4f08-9abd-1c63ed7a21ba tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:33.452645 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-e90335a7-1595-49f5-9379-afdb33f3e6ba tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action" status: 200 len: 14 microversion: 2.20 time: 0.144076 Dec 16 15:06:33.453466 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 643/1296] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 15:06:33 2021] POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action => generated 14 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:06:33.613867 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-4b568f69-4e93-4f08-9abd-1c63ed7a21ba tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:06:33.622712 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-4b568f69-4e93-4f08-9abd-1c63ed7a21ba tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.241453 Dec 16 15:06:33.623308 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 654/1297] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:06:33 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:06:34.469489 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-6e3986d6-a16c-4c97-9200-02b05758b960 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:06:34.470578 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-6e3986d6-a16c-4c97-9200-02b05758b960 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: 54869618-8ecd-4fac-8904-fe0b3bf2d3b5] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:06:34.479466 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6e3986d6-a16c-4c97-9200-02b05758b960 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:34.479976 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6e3986d6-a16c-4c97-9200-02b05758b960 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:34.480837 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6e3986d6-a16c-4c97-9200-02b05758b960 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:34.481338 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6e3986d6-a16c-4c97-9200-02b05758b960 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:34.600386 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-6e3986d6-a16c-4c97-9200-02b05758b960 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action" status: 200 len: 14 microversion: 2.20 time: 0.139197 Dec 16 15:06:34.601053 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 644/1298] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 15:06:34 2021] POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action => generated 14 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:06:34.644211 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-e8889b11-9864-453e-a876-9261ffbaa311 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:06:34.644875 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-e8889b11-9864-453e-a876-9261ffbaa311 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:06:34.652679 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e8889b11-9864-453e-a876-9261ffbaa311 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:34.653182 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e8889b11-9864-453e-a876-9261ffbaa311 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:34.654010 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e8889b11-9864-453e-a876-9261ffbaa311 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:34.654525 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e8889b11-9864-453e-a876-9261ffbaa311 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:34.872240 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-e8889b11-9864-453e-a876-9261ffbaa311 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:06:34.881229 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-e8889b11-9864-453e-a876-9261ffbaa311 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.244513 Dec 16 15:06:34.881826 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 655/1299] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:06:34 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:06:35.617197 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-d896be31-d66f-4fe1-842f-7740ced61afd tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:06:35.618368 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-d896be31-d66f-4fe1-842f-7740ced61afd tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: 54869618-8ecd-4fac-8904-fe0b3bf2d3b5] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:06:35.627035 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d896be31-d66f-4fe1-842f-7740ced61afd tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:35.627546 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d896be31-d66f-4fe1-842f-7740ced61afd tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:35.628390 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d896be31-d66f-4fe1-842f-7740ced61afd tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:35.628889 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d896be31-d66f-4fe1-842f-7740ced61afd tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:35.748394 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-d896be31-d66f-4fe1-842f-7740ced61afd tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action" status: 200 len: 14 microversion: 2.20 time: 0.139846 Dec 16 15:06:35.749219 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 645/1300] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 15:06:35 2021] POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action => generated 14 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:06:35.903049 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-ea2940ae-a25c-436e-8dc1-072f62b06663 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:06:35.903716 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-ea2940ae-a25c-436e-8dc1-072f62b06663 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:06:35.912110 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ea2940ae-a25c-436e-8dc1-072f62b06663 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:35.912610 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ea2940ae-a25c-436e-8dc1-072f62b06663 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:35.913443 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ea2940ae-a25c-436e-8dc1-072f62b06663 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:35.913924 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ea2940ae-a25c-436e-8dc1-072f62b06663 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:36.154421 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-ea2940ae-a25c-436e-8dc1-072f62b06663 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:06:36.164089 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-ea2940ae-a25c-436e-8dc1-072f62b06663 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.268555 Dec 16 15:06:36.164691 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 656/1301] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:06:35 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:06:36.764885 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-a7859941-d28d-40ee-b671-e6546cbe731a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:06:36.765950 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-a7859941-d28d-40ee-b671-e6546cbe731a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: 54869618-8ecd-4fac-8904-fe0b3bf2d3b5] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:06:36.775311 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a7859941-d28d-40ee-b671-e6546cbe731a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:36.775822 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a7859941-d28d-40ee-b671-e6546cbe731a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:36.776667 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a7859941-d28d-40ee-b671-e6546cbe731a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:36.777167 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a7859941-d28d-40ee-b671-e6546cbe731a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:36.913845 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-a7859941-d28d-40ee-b671-e6546cbe731a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action" status: 200 len: 14 microversion: 2.20 time: 0.157264 Dec 16 15:06:36.914585 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 646/1302] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 15:06:36 2021] POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action => generated 14 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:06:37.185810 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-d917f3ab-a63e-436f-951b-b58a4a9690ad tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:06:37.186629 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-d917f3ab-a63e-436f-951b-b58a4a9690ad tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:06:37.195321 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d917f3ab-a63e-436f-951b-b58a4a9690ad tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:37.195839 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d917f3ab-a63e-436f-951b-b58a4a9690ad tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:37.196725 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d917f3ab-a63e-436f-951b-b58a4a9690ad tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:37.197219 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d917f3ab-a63e-436f-951b-b58a4a9690ad tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:37.556579 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-d917f3ab-a63e-436f-951b-b58a4a9690ad tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:06:37.566030 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-d917f3ab-a63e-436f-951b-b58a4a9690ad tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.387922 Dec 16 15:06:37.566674 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 657/1303] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:06:37 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:06:37.930614 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-8a177f36-80aa-4fa7-a823-78b3dd2b1af7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:06:37.931751 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-8a177f36-80aa-4fa7-a823-78b3dd2b1af7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: 54869618-8ecd-4fac-8904-fe0b3bf2d3b5] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:06:37.940493 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8a177f36-80aa-4fa7-a823-78b3dd2b1af7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:37.941004 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8a177f36-80aa-4fa7-a823-78b3dd2b1af7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:37.941847 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8a177f36-80aa-4fa7-a823-78b3dd2b1af7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:37.942376 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8a177f36-80aa-4fa7-a823-78b3dd2b1af7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:38.198502 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-8a177f36-80aa-4fa7-a823-78b3dd2b1af7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action" status: 200 len: 14 microversion: 2.20 time: 0.277021 Dec 16 15:06:38.199241 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 647/1304] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 15:06:37 2021] POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action => generated 14 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:06:38.588714 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-74f03f48-7f24-4092-a815-9e145b0dfc09 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:06:38.589372 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-74f03f48-7f24-4092-a815-9e145b0dfc09 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:06:38.597201 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-74f03f48-7f24-4092-a815-9e145b0dfc09 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:38.597703 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-74f03f48-7f24-4092-a815-9e145b0dfc09 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:38.598558 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-74f03f48-7f24-4092-a815-9e145b0dfc09 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:38.599042 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-74f03f48-7f24-4092-a815-9e145b0dfc09 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:38.812851 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-74f03f48-7f24-4092-a815-9e145b0dfc09 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:06:38.822266 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-74f03f48-7f24-4092-a815-9e145b0dfc09 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.241131 Dec 16 15:06:38.822847 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 658/1305] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:06:38 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:06:39.214217 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-a6ab5c16-a20a-498d-9dd3-e35a4e35d9e4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:06:39.215358 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-a6ab5c16-a20a-498d-9dd3-e35a4e35d9e4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: 54869618-8ecd-4fac-8904-fe0b3bf2d3b5] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:06:39.224843 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a6ab5c16-a20a-498d-9dd3-e35a4e35d9e4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:39.225356 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a6ab5c16-a20a-498d-9dd3-e35a4e35d9e4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:39.227639 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a6ab5c16-a20a-498d-9dd3-e35a4e35d9e4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:39.228144 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a6ab5c16-a20a-498d-9dd3-e35a4e35d9e4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:39.352085 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-a6ab5c16-a20a-498d-9dd3-e35a4e35d9e4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action" status: 200 len: 14 microversion: 2.20 time: 0.146100 Dec 16 15:06:39.353468 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 648/1306] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 15:06:39 2021] POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action => generated 14 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:06:39.844495 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-82584927-cb37-459d-a272-f0dd198fbc63 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:06:39.846258 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-82584927-cb37-459d-a272-f0dd198fbc63 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:06:39.854712 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-82584927-cb37-459d-a272-f0dd198fbc63 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:39.855278 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-82584927-cb37-459d-a272-f0dd198fbc63 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:39.856125 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-82584927-cb37-459d-a272-f0dd198fbc63 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:39.856618 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-82584927-cb37-459d-a272-f0dd198fbc63 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:40.068447 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-82584927-cb37-459d-a272-f0dd198fbc63 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:06:40.077495 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-82584927-cb37-459d-a272-f0dd198fbc63 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.240688 Dec 16 15:06:40.078103 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 659/1307] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:06:39 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:06:40.368799 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-97d68963-79d9-49f9-a4f2-0f60cfae5926 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:06:40.370225 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-97d68963-79d9-49f9-a4f2-0f60cfae5926 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: 54869618-8ecd-4fac-8904-fe0b3bf2d3b5] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:06:40.379360 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-97d68963-79d9-49f9-a4f2-0f60cfae5926 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:40.380038 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-97d68963-79d9-49f9-a4f2-0f60cfae5926 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:40.380896 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-97d68963-79d9-49f9-a4f2-0f60cfae5926 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:40.381394 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-97d68963-79d9-49f9-a4f2-0f60cfae5926 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:40.513811 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-97d68963-79d9-49f9-a4f2-0f60cfae5926 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action" status: 200 len: 6371 microversion: 2.20 time: 0.154024 Dec 16 15:06:40.516995 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 649/1308] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 15:06:40 2021] POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action => generated 6371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:06:41.100513 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-231a1a28-4841-4e54-a930-389abdcc8112 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:06:41.101208 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-231a1a28-4841-4e54-a930-389abdcc8112 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:06:41.108950 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-231a1a28-4841-4e54-a930-389abdcc8112 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:41.109394 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-231a1a28-4841-4e54-a930-389abdcc8112 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:41.110249 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-231a1a28-4841-4e54-a930-389abdcc8112 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:41.110731 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-231a1a28-4841-4e54-a930-389abdcc8112 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:41.330419 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-231a1a28-4841-4e54-a930-389abdcc8112 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:06:41.339352 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-231a1a28-4841-4e54-a930-389abdcc8112 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.247067 Dec 16 15:06:41.340181 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 660/1309] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:06:41 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:06:41.529478 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-1f8d4603-d706-49bf-b482-b32e715d5815 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:06:41.530643 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-1f8d4603-d706-49bf-b482-b32e715d5815 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: 54869618-8ecd-4fac-8904-fe0b3bf2d3b5] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:06:41.539759 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1f8d4603-d706-49bf-b482-b32e715d5815 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:41.540265 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1f8d4603-d706-49bf-b482-b32e715d5815 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:41.541105 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1f8d4603-d706-49bf-b482-b32e715d5815 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:41.541609 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1f8d4603-d706-49bf-b482-b32e715d5815 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:41.675858 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-1f8d4603-d706-49bf-b482-b32e715d5815 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action" status: 200 len: 15025 microversion: 2.20 time: 0.154198 Dec 16 15:06:41.679799 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 650/1310] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 15:06:41 2021] POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action => generated 15025 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:06:42.361638 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-eb323c2a-9974-4c15-a513-f2dddd769e47 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:06:42.362395 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-eb323c2a-9974-4c15-a513-f2dddd769e47 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:06:42.370424 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-eb323c2a-9974-4c15-a513-f2dddd769e47 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:42.370935 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-eb323c2a-9974-4c15-a513-f2dddd769e47 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:42.371775 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-eb323c2a-9974-4c15-a513-f2dddd769e47 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:42.372271 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-eb323c2a-9974-4c15-a513-f2dddd769e47 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:42.588895 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-eb323c2a-9974-4c15-a513-f2dddd769e47 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:06:42.598592 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-eb323c2a-9974-4c15-a513-f2dddd769e47 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.244649 Dec 16 15:06:42.599197 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 661/1311] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:06:42 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:06:42.692568 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-2145bddf-58a5-4bb0-a7bc-8bf93fc491dd tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:06:42.693979 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-2145bddf-58a5-4bb0-a7bc-8bf93fc491dd tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: 54869618-8ecd-4fac-8904-fe0b3bf2d3b5] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:06:42.703376 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2145bddf-58a5-4bb0-a7bc-8bf93fc491dd tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:42.703892 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2145bddf-58a5-4bb0-a7bc-8bf93fc491dd tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:42.705434 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2145bddf-58a5-4bb0-a7bc-8bf93fc491dd tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:42.705928 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2145bddf-58a5-4bb0-a7bc-8bf93fc491dd tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:42.835508 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-2145bddf-58a5-4bb0-a7bc-8bf93fc491dd tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action" status: 200 len: 18398 microversion: 2.20 time: 0.151085 Dec 16 15:06:42.836669 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 651/1312] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 15:06:42 2021] POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action => generated 18398 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 16 15:06:43.620224 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-a39f390c-87f7-46a1-a8d6-ca7a49a07b68 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:06:43.620886 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-a39f390c-87f7-46a1-a8d6-ca7a49a07b68 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:06:43.628756 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a39f390c-87f7-46a1-a8d6-ca7a49a07b68 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:43.629261 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a39f390c-87f7-46a1-a8d6-ca7a49a07b68 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:43.630118 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a39f390c-87f7-46a1-a8d6-ca7a49a07b68 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:43.630614 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a39f390c-87f7-46a1-a8d6-ca7a49a07b68 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:43.850027 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-a39f390c-87f7-46a1-a8d6-ca7a49a07b68 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:06:43.851823 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-a74e6bb5-68da-4a2d-84fc-631432db44cf tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:06:43.852967 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-a74e6bb5-68da-4a2d-84fc-631432db44cf tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: 54869618-8ecd-4fac-8904-fe0b3bf2d3b5] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:06:43.862791 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a74e6bb5-68da-4a2d-84fc-631432db44cf tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:43.863538 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a74e6bb5-68da-4a2d-84fc-631432db44cf tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:43.864393 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a74e6bb5-68da-4a2d-84fc-631432db44cf tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:43.864892 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a74e6bb5-68da-4a2d-84fc-631432db44cf tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:43.865111 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-a39f390c-87f7-46a1-a8d6-ca7a49a07b68 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.252251 Dec 16 15:06:43.865879 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 662/1313] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:06:43 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:06:43.995240 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-a74e6bb5-68da-4a2d-84fc-631432db44cf tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action" status: 200 len: 19399 microversion: 2.20 time: 0.151939 Dec 16 15:06:43.995905 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 652/1314] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 15:06:43 2021] POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action => generated 19399 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:06:44.887784 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-ed027614-d2bc-4946-9322-320b97134f62 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:06:44.888462 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-ed027614-d2bc-4946-9322-320b97134f62 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:06:44.896251 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ed027614-d2bc-4946-9322-320b97134f62 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:44.896765 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ed027614-d2bc-4946-9322-320b97134f62 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:44.897634 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ed027614-d2bc-4946-9322-320b97134f62 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:44.898133 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ed027614-d2bc-4946-9322-320b97134f62 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:45.013546 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-3571f472-a6f9-498d-94fd-9d623a618252 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:06:45.014900 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-3571f472-a6f9-498d-94fd-9d623a618252 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: 54869618-8ecd-4fac-8904-fe0b3bf2d3b5] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:06:45.024068 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3571f472-a6f9-498d-94fd-9d623a618252 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:45.024579 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3571f472-a6f9-498d-94fd-9d623a618252 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:45.025434 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3571f472-a6f9-498d-94fd-9d623a618252 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:45.025932 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3571f472-a6f9-498d-94fd-9d623a618252 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:45.117181 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-ed027614-d2bc-4946-9322-320b97134f62 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:06:45.125950 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-ed027614-d2bc-4946-9322-320b97134f62 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.245807 Dec 16 15:06:45.127233 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 663/1315] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:06:44 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:06:45.159915 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-3571f472-a6f9-498d-94fd-9d623a618252 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action" status: 200 len: 22616 microversion: 2.20 time: 0.155360 Dec 16 15:06:45.160616 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 653/1316] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 15:06:45 2021] POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action => generated 22616 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 16 15:06:46.149221 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-f3d0b960-87eb-425c-b422-0f0eede33369 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:06:46.149834 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-f3d0b960-87eb-425c-b422-0f0eede33369 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:06:46.157639 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f3d0b960-87eb-425c-b422-0f0eede33369 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:46.158183 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f3d0b960-87eb-425c-b422-0f0eede33369 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:46.159027 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f3d0b960-87eb-425c-b422-0f0eede33369 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:46.159525 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f3d0b960-87eb-425c-b422-0f0eede33369 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:46.176887 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-fa509a2e-19e1-44ef-900d-6c6a209643f1 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:06:46.178006 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-fa509a2e-19e1-44ef-900d-6c6a209643f1 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: 54869618-8ecd-4fac-8904-fe0b3bf2d3b5] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:06:46.186494 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fa509a2e-19e1-44ef-900d-6c6a209643f1 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:46.187004 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fa509a2e-19e1-44ef-900d-6c6a209643f1 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:46.187842 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fa509a2e-19e1-44ef-900d-6c6a209643f1 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:46.188332 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fa509a2e-19e1-44ef-900d-6c6a209643f1 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:46.322237 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-fa509a2e-19e1-44ef-900d-6c6a209643f1 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action" status: 200 len: 23804 microversion: 2.20 time: 0.153352 Dec 16 15:06:46.326493 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 654/1317] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 15:06:46 2021] POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action => generated 23804 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:06:46.381359 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-f3d0b960-87eb-425c-b422-0f0eede33369 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:06:46.390476 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-f3d0b960-87eb-425c-b422-0f0eede33369 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.249510 Dec 16 15:06:46.391489 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 664/1318] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:06:46 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:06:47.339596 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-2426e267-ab6e-4816-99da-75e2ef45da11 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:06:47.340738 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-2426e267-ab6e-4816-99da-75e2ef45da11 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: 54869618-8ecd-4fac-8904-fe0b3bf2d3b5] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:06:47.350150 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2426e267-ab6e-4816-99da-75e2ef45da11 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:47.350669 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2426e267-ab6e-4816-99da-75e2ef45da11 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:47.351514 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2426e267-ab6e-4816-99da-75e2ef45da11 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:47.352010 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2426e267-ab6e-4816-99da-75e2ef45da11 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:47.413328 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-fac36de8-3559-496b-870d-ad545a515b39 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:06:47.414070 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-fac36de8-3559-496b-870d-ad545a515b39 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:06:47.423048 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fac36de8-3559-496b-870d-ad545a515b39 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:47.423558 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fac36de8-3559-496b-870d-ad545a515b39 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:47.424413 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fac36de8-3559-496b-870d-ad545a515b39 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:47.424890 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fac36de8-3559-496b-870d-ad545a515b39 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:47.483878 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-2426e267-ab6e-4816-99da-75e2ef45da11 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action" status: 200 len: 25812 microversion: 2.20 time: 0.151881 Dec 16 15:06:47.488207 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 655/1319] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 15:06:47 2021] POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action => generated 25812 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:06:47.639834 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-fac36de8-3559-496b-870d-ad545a515b39 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:06:47.648713 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-fac36de8-3559-496b-870d-ad545a515b39 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.243713 Dec 16 15:06:47.649308 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 665/1320] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:06:47 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:06:48.500537 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-9ba23e7e-a148-4cf1-b76c-857bb91a18ca tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:06:48.501752 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-9ba23e7e-a148-4cf1-b76c-857bb91a18ca tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: 54869618-8ecd-4fac-8904-fe0b3bf2d3b5] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:06:48.510071 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9ba23e7e-a148-4cf1-b76c-857bb91a18ca tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:48.510578 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9ba23e7e-a148-4cf1-b76c-857bb91a18ca tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:48.511410 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9ba23e7e-a148-4cf1-b76c-857bb91a18ca tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:48.511901 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9ba23e7e-a148-4cf1-b76c-857bb91a18ca tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:48.651921 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-9ba23e7e-a148-4cf1-b76c-857bb91a18ca tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action" status: 200 len: 27095 microversion: 2.20 time: 0.159337 Dec 16 15:06:48.652634 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 656/1321] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 15:06:48 2021] POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action => generated 27095 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:06:48.670932 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-2c7c2760-ebd7-4907-9e72-a6db544a6605 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:06:48.671605 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-2c7c2760-ebd7-4907-9e72-a6db544a6605 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:06:48.679930 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2c7c2760-ebd7-4907-9e72-a6db544a6605 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:48.680442 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2c7c2760-ebd7-4907-9e72-a6db544a6605 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:48.681275 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2c7c2760-ebd7-4907-9e72-a6db544a6605 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:48.681768 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2c7c2760-ebd7-4907-9e72-a6db544a6605 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:48.894659 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-2c7c2760-ebd7-4907-9e72-a6db544a6605 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:06:48.903473 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-2c7c2760-ebd7-4907-9e72-a6db544a6605 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.240048 Dec 16 15:06:48.904068 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 666/1322] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:06:48 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:06:49.669482 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-3568bf75-034c-45f1-825c-7aff24cb4acb tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:06:49.670577 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-3568bf75-034c-45f1-825c-7aff24cb4acb tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: 54869618-8ecd-4fac-8904-fe0b3bf2d3b5] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:06:49.679077 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3568bf75-034c-45f1-825c-7aff24cb4acb tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:49.679588 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3568bf75-034c-45f1-825c-7aff24cb4acb tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:49.680435 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3568bf75-034c-45f1-825c-7aff24cb4acb tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:49.680920 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3568bf75-034c-45f1-825c-7aff24cb4acb tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:49.816570 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-3568bf75-034c-45f1-825c-7aff24cb4acb tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action" status: 200 len: 27773 microversion: 2.20 time: 0.155175 Dec 16 15:06:49.817250 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 657/1323] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 15:06:49 2021] POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action => generated 27773 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:06:49.925627 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-f4c263dc-612d-469b-94c6-36e73d8341b3 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:06:49.926291 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-f4c263dc-612d-469b-94c6-36e73d8341b3 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:06:49.934815 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f4c263dc-612d-469b-94c6-36e73d8341b3 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:49.935325 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f4c263dc-612d-469b-94c6-36e73d8341b3 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:49.936174 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f4c263dc-612d-469b-94c6-36e73d8341b3 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:49.936673 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f4c263dc-612d-469b-94c6-36e73d8341b3 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:50.154361 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-f4c263dc-612d-469b-94c6-36e73d8341b3 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:06:50.163888 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-f4c263dc-612d-469b-94c6-36e73d8341b3 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.246471 Dec 16 15:06:50.164482 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 667/1324] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:06:49 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:06:50.834582 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-7201a47c-c80c-4b90-b3a8-5b68e8741408 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:06:50.835730 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-7201a47c-c80c-4b90-b3a8-5b68e8741408 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: 54869618-8ecd-4fac-8904-fe0b3bf2d3b5] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:06:50.844632 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7201a47c-c80c-4b90-b3a8-5b68e8741408 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:50.845152 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7201a47c-c80c-4b90-b3a8-5b68e8741408 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:50.846004 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7201a47c-c80c-4b90-b3a8-5b68e8741408 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:50.846550 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7201a47c-c80c-4b90-b3a8-5b68e8741408 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:50.997980 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-7201a47c-c80c-4b90-b3a8-5b68e8741408 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action" status: 200 len: 28196 microversion: 2.20 time: 0.172239 Dec 16 15:06:50.998702 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 658/1325] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 15:06:50 2021] POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action => generated 28196 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:06:51.185573 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-bba1f48d-4506-48cb-bcac-f109e164fb62 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:06:51.186270 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-bba1f48d-4506-48cb-bcac-f109e164fb62 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:06:51.195028 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-bba1f48d-4506-48cb-bcac-f109e164fb62 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:51.195534 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-bba1f48d-4506-48cb-bcac-f109e164fb62 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:51.196369 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-bba1f48d-4506-48cb-bcac-f109e164fb62 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:51.196862 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-bba1f48d-4506-48cb-bcac-f109e164fb62 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:51.416098 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-bba1f48d-4506-48cb-bcac-f109e164fb62 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:06:51.425774 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-bba1f48d-4506-48cb-bcac-f109e164fb62 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.247824 Dec 16 15:06:51.426596 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 668/1326] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:06:51 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:06:52.015637 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-4ea37d47-f3b7-46de-99dd-b825a8cac5f5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:06:52.017399 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-4ea37d47-f3b7-46de-99dd-b825a8cac5f5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: 54869618-8ecd-4fac-8904-fe0b3bf2d3b5] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:06:52.026232 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4ea37d47-f3b7-46de-99dd-b825a8cac5f5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:52.026748 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4ea37d47-f3b7-46de-99dd-b825a8cac5f5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:52.027596 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4ea37d47-f3b7-46de-99dd-b825a8cac5f5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:52.028089 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4ea37d47-f3b7-46de-99dd-b825a8cac5f5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:52.152858 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-4ea37d47-f3b7-46de-99dd-b825a8cac5f5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action" status: 200 len: 28196 microversion: 2.20 time: 0.145056 Dec 16 15:06:52.153497 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 659/1327] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 15:06:52 2021] POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action => generated 28196 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:06:52.448057 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-f54e5444-38ab-48a3-8abe-b430409cf6c0 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:06:52.448666 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-f54e5444-38ab-48a3-8abe-b430409cf6c0 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:06:52.456700 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f54e5444-38ab-48a3-8abe-b430409cf6c0 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:52.457211 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f54e5444-38ab-48a3-8abe-b430409cf6c0 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:52.458118 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f54e5444-38ab-48a3-8abe-b430409cf6c0 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:52.458936 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f54e5444-38ab-48a3-8abe-b430409cf6c0 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:52.683817 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-f54e5444-38ab-48a3-8abe-b430409cf6c0 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:06:52.694017 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-f54e5444-38ab-48a3-8abe-b430409cf6c0 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.253589 Dec 16 15:06:52.694653 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 669/1328] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:06:52 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:06:53.169472 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-8dfa6a6e-c2d2-4920-89dd-f6310af9cf1e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:06:53.170634 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-8dfa6a6e-c2d2-4920-89dd-f6310af9cf1e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: 54869618-8ecd-4fac-8904-fe0b3bf2d3b5] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:06:53.179159 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8dfa6a6e-c2d2-4920-89dd-f6310af9cf1e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:53.179673 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8dfa6a6e-c2d2-4920-89dd-f6310af9cf1e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:53.180518 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8dfa6a6e-c2d2-4920-89dd-f6310af9cf1e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:53.181016 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8dfa6a6e-c2d2-4920-89dd-f6310af9cf1e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:53.307071 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-8dfa6a6e-c2d2-4920-89dd-f6310af9cf1e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action" status: 200 len: 28196 microversion: 2.20 time: 0.145478 Dec 16 15:06:53.307689 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 660/1329] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 15:06:53 2021] POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action => generated 28196 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:06:53.716126 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-6143d0b6-abe5-4bcf-888b-d216718b34fc tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:06:53.716932 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-6143d0b6-abe5-4bcf-888b-d216718b34fc tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:06:53.725351 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6143d0b6-abe5-4bcf-888b-d216718b34fc tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:53.725858 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6143d0b6-abe5-4bcf-888b-d216718b34fc tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:53.726730 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6143d0b6-abe5-4bcf-888b-d216718b34fc tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:53.727222 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6143d0b6-abe5-4bcf-888b-d216718b34fc tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:53.941662 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-6143d0b6-abe5-4bcf-888b-d216718b34fc tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:06:53.950868 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-6143d0b6-abe5-4bcf-888b-d216718b34fc tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.242614 Dec 16 15:06:53.951459 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 670/1330] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:06:53 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:06:54.324799 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-95531c09-073b-44de-b383-a7539bac6fa9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:06:54.325932 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-95531c09-073b-44de-b383-a7539bac6fa9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: 54869618-8ecd-4fac-8904-fe0b3bf2d3b5] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:06:54.335469 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-95531c09-073b-44de-b383-a7539bac6fa9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:54.335985 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-95531c09-073b-44de-b383-a7539bac6fa9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:54.336854 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-95531c09-073b-44de-b383-a7539bac6fa9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:54.337356 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-95531c09-073b-44de-b383-a7539bac6fa9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:54.465338 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-95531c09-073b-44de-b383-a7539bac6fa9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action" status: 200 len: 28196 microversion: 2.20 time: 0.148986 Dec 16 15:06:54.466367 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 661/1331] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 15:06:54 2021] POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action => generated 28196 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:06:54.973755 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-5feeb10c-0597-48db-94b5-13406e124fce tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:06:54.974387 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-5feeb10c-0597-48db-94b5-13406e124fce tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:06:54.982223 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5feeb10c-0597-48db-94b5-13406e124fce tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:54.982726 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5feeb10c-0597-48db-94b5-13406e124fce tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:54.983563 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5feeb10c-0597-48db-94b5-13406e124fce tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:54.984054 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5feeb10c-0597-48db-94b5-13406e124fce tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:55.208582 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-5feeb10c-0597-48db-94b5-13406e124fce tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:06:55.217469 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-5feeb10c-0597-48db-94b5-13406e124fce tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.252683 Dec 16 15:06:55.218087 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 671/1332] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:06:54 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:06:55.481946 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-608890d6-1d45-4696-8163-93aab2ae9af7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:06:55.483160 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-608890d6-1d45-4696-8163-93aab2ae9af7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: 54869618-8ecd-4fac-8904-fe0b3bf2d3b5] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:06:55.491628 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-608890d6-1d45-4696-8163-93aab2ae9af7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:55.492136 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-608890d6-1d45-4696-8163-93aab2ae9af7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:55.493000 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-608890d6-1d45-4696-8163-93aab2ae9af7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:55.493492 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-608890d6-1d45-4696-8163-93aab2ae9af7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:55.620857 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-608890d6-1d45-4696-8163-93aab2ae9af7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action" status: 200 len: 28196 microversion: 2.20 time: 0.146910 Dec 16 15:06:55.621533 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 662/1333] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 15:06:55 2021] POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action => generated 28196 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:06:56.239968 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-5edb2fd3-7d35-4986-8e81-120d721a4870 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:06:56.240646 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-5edb2fd3-7d35-4986-8e81-120d721a4870 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:06:56.248517 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5edb2fd3-7d35-4986-8e81-120d721a4870 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:56.249034 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5edb2fd3-7d35-4986-8e81-120d721a4870 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:56.249875 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5edb2fd3-7d35-4986-8e81-120d721a4870 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:56.250399 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5edb2fd3-7d35-4986-8e81-120d721a4870 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:56.484070 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-5edb2fd3-7d35-4986-8e81-120d721a4870 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:06:56.493045 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-5edb2fd3-7d35-4986-8e81-120d721a4870 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.260706 Dec 16 15:06:56.493804 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 672/1334] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:06:56 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:06:56.638619 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-bd94e416-c7cd-4e82-b999-295cd12793b7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:06:56.639740 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-bd94e416-c7cd-4e82-b999-295cd12793b7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: 54869618-8ecd-4fac-8904-fe0b3bf2d3b5] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:06:56.648262 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-bd94e416-c7cd-4e82-b999-295cd12793b7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:56.648761 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-bd94e416-c7cd-4e82-b999-295cd12793b7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:56.649591 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-bd94e416-c7cd-4e82-b999-295cd12793b7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:56.650101 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-bd94e416-c7cd-4e82-b999-295cd12793b7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:56.770311 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-bd94e416-c7cd-4e82-b999-295cd12793b7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action" status: 200 len: 28196 microversion: 2.20 time: 0.139407 Dec 16 15:06:56.771666 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 663/1335] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 15:06:56 2021] POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action => generated 28196 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:06:57.515179 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-42e99633-062b-4aff-8736-1e07708baefb tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:06:57.515847 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-42e99633-062b-4aff-8736-1e07708baefb tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:06:57.524185 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-42e99633-062b-4aff-8736-1e07708baefb tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:57.524694 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-42e99633-062b-4aff-8736-1e07708baefb tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:57.525525 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-42e99633-062b-4aff-8736-1e07708baefb tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:57.526016 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-42e99633-062b-4aff-8736-1e07708baefb tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:57.736018 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-42e99633-062b-4aff-8736-1e07708baefb tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:06:57.744848 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-42e99633-062b-4aff-8736-1e07708baefb tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.237127 Dec 16 15:06:57.745444 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 673/1336] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:06:57 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:06:57.787177 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-aff37651-1758-4186-a643-7c0174b912a8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:06:57.788295 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-aff37651-1758-4186-a643-7c0174b912a8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: 54869618-8ecd-4fac-8904-fe0b3bf2d3b5] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:06:57.796730 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-aff37651-1758-4186-a643-7c0174b912a8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:57.797237 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-aff37651-1758-4186-a643-7c0174b912a8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:57.798079 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-aff37651-1758-4186-a643-7c0174b912a8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:57.798608 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-aff37651-1758-4186-a643-7c0174b912a8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:57.929997 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-aff37651-1758-4186-a643-7c0174b912a8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action" status: 200 len: 28196 microversion: 2.20 time: 0.150995 Dec 16 15:06:57.930807 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 664/1337] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 15:06:57 2021] POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action => generated 28196 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:06:58.767213 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-2580cacb-d1b7-4438-a223-c0e103be2a51 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:06:58.767812 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-2580cacb-d1b7-4438-a223-c0e103be2a51 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:06:58.775803 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2580cacb-d1b7-4438-a223-c0e103be2a51 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:58.776308 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2580cacb-d1b7-4438-a223-c0e103be2a51 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:58.777145 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2580cacb-d1b7-4438-a223-c0e103be2a51 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:58.777645 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2580cacb-d1b7-4438-a223-c0e103be2a51 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:58.948089 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-839bace3-155b-4e7c-a026-f9ab460e51be tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:06:58.949239 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-839bace3-155b-4e7c-a026-f9ab460e51be tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: 54869618-8ecd-4fac-8904-fe0b3bf2d3b5] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:06:58.958696 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-839bace3-155b-4e7c-a026-f9ab460e51be tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:58.959213 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-839bace3-155b-4e7c-a026-f9ab460e51be tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:58.960073 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-839bace3-155b-4e7c-a026-f9ab460e51be tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:06:58.960569 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-839bace3-155b-4e7c-a026-f9ab460e51be tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:06:59.000392 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-2580cacb-d1b7-4438-a223-c0e103be2a51 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:06:59.009433 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-2580cacb-d1b7-4438-a223-c0e103be2a51 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.249868 Dec 16 15:06:59.010363 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 674/1338] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:06:58 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:06:59.089130 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-839bace3-155b-4e7c-a026-f9ab460e51be tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action" status: 200 len: 28196 microversion: 2.20 time: 0.150134 Dec 16 15:06:59.089833 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 665/1339] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 15:06:58 2021] POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action => generated 28196 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 16 15:07:00.032094 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-af29ac9b-e383-444f-9d1e-a051f82a7583 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:07:00.032762 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-af29ac9b-e383-444f-9d1e-a051f82a7583 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:07:00.040757 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-af29ac9b-e383-444f-9d1e-a051f82a7583 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:00.041264 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-af29ac9b-e383-444f-9d1e-a051f82a7583 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:00.042115 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-af29ac9b-e383-444f-9d1e-a051f82a7583 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:00.042610 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-af29ac9b-e383-444f-9d1e-a051f82a7583 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:00.105375 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-444ea580-3016-4b64-b322-73c2e4441b27 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:07:00.106651 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-444ea580-3016-4b64-b322-73c2e4441b27 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: 54869618-8ecd-4fac-8904-fe0b3bf2d3b5] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:07:00.115188 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-444ea580-3016-4b64-b322-73c2e4441b27 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:00.115699 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-444ea580-3016-4b64-b322-73c2e4441b27 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:00.116548 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-444ea580-3016-4b64-b322-73c2e4441b27 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:00.117049 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-444ea580-3016-4b64-b322-73c2e4441b27 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:00.239134 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-444ea580-3016-4b64-b322-73c2e4441b27 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action" status: 200 len: 28196 microversion: 2.20 time: 0.141806 Dec 16 15:07:00.240318 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 666/1340] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 15:07:00 2021] POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action => generated 28196 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 16 15:07:00.267493 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-af29ac9b-e383-444f-9d1e-a051f82a7583 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:07:00.276789 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-af29ac9b-e383-444f-9d1e-a051f82a7583 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.252281 Dec 16 15:07:00.277667 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 675/1341] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:07:00 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:07:01.255907 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-699d10f1-74e0-4ed7-8138-052e16a8c671 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:07:01.257038 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-699d10f1-74e0-4ed7-8138-052e16a8c671 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: 54869618-8ecd-4fac-8904-fe0b3bf2d3b5] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:07:01.265522 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-699d10f1-74e0-4ed7-8138-052e16a8c671 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:01.266026 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-699d10f1-74e0-4ed7-8138-052e16a8c671 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:01.267403 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-699d10f1-74e0-4ed7-8138-052e16a8c671 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:01.267893 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-699d10f1-74e0-4ed7-8138-052e16a8c671 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:01.298663 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-56f2f23e-a64a-4722-80a7-fe424964c432 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:07:01.299333 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-56f2f23e-a64a-4722-80a7-fe424964c432 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:07:01.307182 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-56f2f23e-a64a-4722-80a7-fe424964c432 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:01.307684 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-56f2f23e-a64a-4722-80a7-fe424964c432 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:01.308522 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-56f2f23e-a64a-4722-80a7-fe424964c432 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:01.309010 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-56f2f23e-a64a-4722-80a7-fe424964c432 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:01.395043 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-699d10f1-74e0-4ed7-8138-052e16a8c671 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action" status: 200 len: 28196 microversion: 2.20 time: 0.147135 Dec 16 15:07:01.395768 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 667/1342] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 15:07:01 2021] POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action => generated 28196 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 16 15:07:01.545184 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-56f2f23e-a64a-4722-80a7-fe424964c432 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:07:01.555365 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-56f2f23e-a64a-4722-80a7-fe424964c432 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.264358 Dec 16 15:07:01.555955 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 676/1343] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:07:01 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:07:02.413672 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-c6a288af-8cc4-44d2-a8fc-6e67698931cf tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:07:02.414826 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-c6a288af-8cc4-44d2-a8fc-6e67698931cf tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: 54869618-8ecd-4fac-8904-fe0b3bf2d3b5] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:07:02.423991 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c6a288af-8cc4-44d2-a8fc-6e67698931cf tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:02.424514 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c6a288af-8cc4-44d2-a8fc-6e67698931cf tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:02.425322 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c6a288af-8cc4-44d2-a8fc-6e67698931cf tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:02.425827 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c6a288af-8cc4-44d2-a8fc-6e67698931cf tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:02.551996 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-c6a288af-8cc4-44d2-a8fc-6e67698931cf tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action" status: 200 len: 28196 microversion: 2.20 time: 0.147611 Dec 16 15:07:02.552808 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 668/1344] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 15:07:02 2021] POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action => generated 28196 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:07:02.576951 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-749f7b09-2b48-4e30-ab8c-950ac769385d tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:07:02.577619 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-749f7b09-2b48-4e30-ab8c-950ac769385d tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:07:02.586247 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-749f7b09-2b48-4e30-ab8c-950ac769385d tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:02.586825 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-749f7b09-2b48-4e30-ab8c-950ac769385d tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:02.587666 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-749f7b09-2b48-4e30-ab8c-950ac769385d tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:02.588361 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-749f7b09-2b48-4e30-ab8c-950ac769385d tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:02.809785 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-749f7b09-2b48-4e30-ab8c-950ac769385d tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:07:02.818899 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-749f7b09-2b48-4e30-ab8c-950ac769385d tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.249780 Dec 16 15:07:02.819563 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 677/1345] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:07:02 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:07:03.570877 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-4ed74991-47dc-4008-ae90-7b21debcd524 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:07:03.572039 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-4ed74991-47dc-4008-ae90-7b21debcd524 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: 54869618-8ecd-4fac-8904-fe0b3bf2d3b5] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:07:03.580729 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4ed74991-47dc-4008-ae90-7b21debcd524 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:03.581451 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4ed74991-47dc-4008-ae90-7b21debcd524 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:03.582505 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4ed74991-47dc-4008-ae90-7b21debcd524 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:03.583162 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4ed74991-47dc-4008-ae90-7b21debcd524 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:03.716687 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-4ed74991-47dc-4008-ae90-7b21debcd524 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action" status: 200 len: 28196 microversion: 2.20 time: 0.156099 Dec 16 15:07:03.717520 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 669/1346] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 15:07:03 2021] POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action => generated 28196 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:07:03.840841 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-714e0392-1b96-4b9e-9d81-650b75a1e73c tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:07:03.841516 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-714e0392-1b96-4b9e-9d81-650b75a1e73c tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:07:03.849292 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-714e0392-1b96-4b9e-9d81-650b75a1e73c tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:03.849798 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-714e0392-1b96-4b9e-9d81-650b75a1e73c tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:03.850707 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-714e0392-1b96-4b9e-9d81-650b75a1e73c tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:03.851154 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-714e0392-1b96-4b9e-9d81-650b75a1e73c tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:03.941753 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 15:07:03.942064 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: Thu Dec 16 15:07:03 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 (ip 10.222.0.45) !!! Dec 16 15:07:04.067857 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-714e0392-1b96-4b9e-9d81-650b75a1e73c tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:07:04.077203 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-714e0392-1b96-4b9e-9d81-650b75a1e73c tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.243835 Dec 16 15:07:04.078001 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 678/1347] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:07:03 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:07:04.733786 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-3ca7ac10-9ede-453a-a85f-991d6dd64ba9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:07:04.736058 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-3ca7ac10-9ede-453a-a85f-991d6dd64ba9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: 54869618-8ecd-4fac-8904-fe0b3bf2d3b5] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:07:04.745317 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3ca7ac10-9ede-453a-a85f-991d6dd64ba9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:04.745556 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3ca7ac10-9ede-453a-a85f-991d6dd64ba9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:04.746623 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3ca7ac10-9ede-453a-a85f-991d6dd64ba9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:04.747119 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3ca7ac10-9ede-453a-a85f-991d6dd64ba9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:04.912592 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-3ca7ac10-9ede-453a-a85f-991d6dd64ba9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action" status: 200 len: 28487 microversion: 2.20 time: 0.186653 Dec 16 15:07:04.913240 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 670/1348] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 15:07:04 2021] POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action => generated 28487 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:07:05.099459 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-d902b112-e7e6-44c1-a158-f6cc01c70fb1 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:07:05.100170 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-d902b112-e7e6-44c1-a158-f6cc01c70fb1 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:07:05.108362 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d902b112-e7e6-44c1-a158-f6cc01c70fb1 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:05.108909 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d902b112-e7e6-44c1-a158-f6cc01c70fb1 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:05.109750 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d902b112-e7e6-44c1-a158-f6cc01c70fb1 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:05.110798 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d902b112-e7e6-44c1-a158-f6cc01c70fb1 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:05.329304 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-d902b112-e7e6-44c1-a158-f6cc01c70fb1 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:07:05.338216 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-d902b112-e7e6-44c1-a158-f6cc01c70fb1 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.246618 Dec 16 15:07:05.339014 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 679/1349] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:07:05 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:07:05.930746 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-565e5081-4e9b-4d62-8e12-6d4aa802dc90 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:07:05.931883 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-565e5081-4e9b-4d62-8e12-6d4aa802dc90 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: 54869618-8ecd-4fac-8904-fe0b3bf2d3b5] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:07:05.940997 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-565e5081-4e9b-4d62-8e12-6d4aa802dc90 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:05.941513 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-565e5081-4e9b-4d62-8e12-6d4aa802dc90 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:05.942395 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-565e5081-4e9b-4d62-8e12-6d4aa802dc90 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:05.942998 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-565e5081-4e9b-4d62-8e12-6d4aa802dc90 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:06.066185 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-565e5081-4e9b-4d62-8e12-6d4aa802dc90 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action" status: 200 len: 28487 microversion: 2.20 time: 0.144493 Dec 16 15:07:06.066807 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 671/1350] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 15:07:05 2021] POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action => generated 28487 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:07:06.360034 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-7762e80d-ad91-4163-8aab-ce56e3d9d3e5 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:07:06.360703 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-7762e80d-ad91-4163-8aab-ce56e3d9d3e5 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:07:06.368679 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7762e80d-ad91-4163-8aab-ce56e3d9d3e5 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:06.369186 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7762e80d-ad91-4163-8aab-ce56e3d9d3e5 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:06.370023 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7762e80d-ad91-4163-8aab-ce56e3d9d3e5 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:06.370538 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7762e80d-ad91-4163-8aab-ce56e3d9d3e5 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:06.581714 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-7762e80d-ad91-4163-8aab-ce56e3d9d3e5 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:07:06.590637 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-7762e80d-ad91-4163-8aab-ce56e3d9d3e5 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.238125 Dec 16 15:07:06.591234 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 680/1351] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:07:06 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:07:07.083137 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-cd1af56b-aa59-4dd7-8a3a-e232c56d2b72 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:07:07.084290 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-cd1af56b-aa59-4dd7-8a3a-e232c56d2b72 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: 54869618-8ecd-4fac-8904-fe0b3bf2d3b5] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:07:07.093123 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cd1af56b-aa59-4dd7-8a3a-e232c56d2b72 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:07.093687 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cd1af56b-aa59-4dd7-8a3a-e232c56d2b72 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:07.094570 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cd1af56b-aa59-4dd7-8a3a-e232c56d2b72 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:07.095068 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cd1af56b-aa59-4dd7-8a3a-e232c56d2b72 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:07.230177 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-cd1af56b-aa59-4dd7-8a3a-e232c56d2b72 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action" status: 200 len: 28655 microversion: 2.20 time: 0.154998 Dec 16 15:07:07.230784 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 672/1352] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 15:07:07 2021] POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action => generated 28655 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:07:07.614011 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-60bfeddd-9823-4467-8874-308302aaa8ff tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:07:07.614707 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-60bfeddd-9823-4467-8874-308302aaa8ff tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:07:07.622511 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-60bfeddd-9823-4467-8874-308302aaa8ff tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:07.623048 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-60bfeddd-9823-4467-8874-308302aaa8ff tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:07.623863 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-60bfeddd-9823-4467-8874-308302aaa8ff tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:07.624357 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-60bfeddd-9823-4467-8874-308302aaa8ff tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:08.075474 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-60bfeddd-9823-4467-8874-308302aaa8ff tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:07:08.086923 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-60bfeddd-9823-4467-8874-308302aaa8ff tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.481245 Dec 16 15:07:08.088162 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 681/1353] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:07:07 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:07:08.246997 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-da05b42e-b75a-487c-81a1-e7f9e5175351 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:07:08.248027 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-da05b42e-b75a-487c-81a1-e7f9e5175351 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: 54869618-8ecd-4fac-8904-fe0b3bf2d3b5] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:07:08.257129 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-da05b42e-b75a-487c-81a1-e7f9e5175351 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:08.257639 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-da05b42e-b75a-487c-81a1-e7f9e5175351 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:08.258510 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-da05b42e-b75a-487c-81a1-e7f9e5175351 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:08.259008 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-da05b42e-b75a-487c-81a1-e7f9e5175351 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:08.392606 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-da05b42e-b75a-487c-81a1-e7f9e5175351 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action" status: 200 len: 28655 microversion: 2.20 time: 0.153827 Dec 16 15:07:08.393333 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 673/1354] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 15:07:08 2021] POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action => generated 28655 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:07:09.109891 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-88958387-8b60-4dc1-ad91-97f828a2dd87 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:07:09.110597 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-88958387-8b60-4dc1-ad91-97f828a2dd87 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:07:09.118335 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-88958387-8b60-4dc1-ad91-97f828a2dd87 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:09.118841 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-88958387-8b60-4dc1-ad91-97f828a2dd87 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:09.119675 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-88958387-8b60-4dc1-ad91-97f828a2dd87 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:09.120162 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-88958387-8b60-4dc1-ad91-97f828a2dd87 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:09.344222 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-88958387-8b60-4dc1-ad91-97f828a2dd87 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:07:09.358554 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-88958387-8b60-4dc1-ad91-97f828a2dd87 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.256209 Dec 16 15:07:09.359246 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 682/1355] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:07:09 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:07:09.409322 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-9998180a-a9b1-4339-a5b2-8cbefe5fb4a6 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:07:09.410481 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-9998180a-a9b1-4339-a5b2-8cbefe5fb4a6 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: 54869618-8ecd-4fac-8904-fe0b3bf2d3b5] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:07:09.419022 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9998180a-a9b1-4339-a5b2-8cbefe5fb4a6 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:09.419536 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9998180a-a9b1-4339-a5b2-8cbefe5fb4a6 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:09.420383 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9998180a-a9b1-4339-a5b2-8cbefe5fb4a6 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:09.420878 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9998180a-a9b1-4339-a5b2-8cbefe5fb4a6 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:09.543569 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-9998180a-a9b1-4339-a5b2-8cbefe5fb4a6 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action" status: 200 len: 28655 microversion: 2.20 time: 0.142200 Dec 16 15:07:09.544487 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 674/1356] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 15:07:09 2021] POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action => generated 28655 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:07:10.380937 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-d31dda9f-8297-45eb-9269-00b32b0d2cd6 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:07:10.381618 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-d31dda9f-8297-45eb-9269-00b32b0d2cd6 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:07:10.389593 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d31dda9f-8297-45eb-9269-00b32b0d2cd6 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:10.390056 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d31dda9f-8297-45eb-9269-00b32b0d2cd6 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:10.391455 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d31dda9f-8297-45eb-9269-00b32b0d2cd6 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:10.391952 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d31dda9f-8297-45eb-9269-00b32b0d2cd6 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:10.561019 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-0dcc5200-e227-4e23-a2fd-c0f39e4412a8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:07:10.562188 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-0dcc5200-e227-4e23-a2fd-c0f39e4412a8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: 54869618-8ecd-4fac-8904-fe0b3bf2d3b5] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:07:10.571669 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0dcc5200-e227-4e23-a2fd-c0f39e4412a8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:10.572186 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0dcc5200-e227-4e23-a2fd-c0f39e4412a8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:10.573038 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0dcc5200-e227-4e23-a2fd-c0f39e4412a8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:10.573541 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0dcc5200-e227-4e23-a2fd-c0f39e4412a8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:10.608135 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-d31dda9f-8297-45eb-9269-00b32b0d2cd6 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:07:10.617052 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-d31dda9f-8297-45eb-9269-00b32b0d2cd6 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.244104 Dec 16 15:07:10.617637 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 683/1357] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:07:10 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:07:10.696405 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-0dcc5200-e227-4e23-a2fd-c0f39e4412a8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action" status: 200 len: 28655 microversion: 2.20 time: 0.143489 Dec 16 15:07:10.700593 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 675/1358] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 15:07:10 2021] POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action => generated 28655 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 16 15:07:11.639349 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-5e1f6f50-9770-467e-a32d-9ed2caf1ea69 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:07:11.640020 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-5e1f6f50-9770-467e-a32d-9ed2caf1ea69 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:07:11.648557 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5e1f6f50-9770-467e-a32d-9ed2caf1ea69 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:11.649068 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5e1f6f50-9770-467e-a32d-9ed2caf1ea69 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:11.649910 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5e1f6f50-9770-467e-a32d-9ed2caf1ea69 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:11.650453 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5e1f6f50-9770-467e-a32d-9ed2caf1ea69 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:11.713690 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-36bccb43-baa2-446a-a99a-2c67db022544 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:07:11.714990 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-36bccb43-baa2-446a-a99a-2c67db022544 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: 54869618-8ecd-4fac-8904-fe0b3bf2d3b5] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:07:11.724221 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-36bccb43-baa2-446a-a99a-2c67db022544 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:11.724726 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-36bccb43-baa2-446a-a99a-2c67db022544 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:11.725564 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-36bccb43-baa2-446a-a99a-2c67db022544 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:11.726086 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-36bccb43-baa2-446a-a99a-2c67db022544 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:11.853061 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-36bccb43-baa2-446a-a99a-2c67db022544 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action" status: 200 len: 28655 microversion: 2.20 time: 0.147367 Dec 16 15:07:11.853854 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 676/1359] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 15:07:11 2021] POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action => generated 28655 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 16 15:07:11.870943 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-5e1f6f50-9770-467e-a32d-9ed2caf1ea69 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:07:11.879752 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-5e1f6f50-9770-467e-a32d-9ed2caf1ea69 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.248213 Dec 16 15:07:11.880327 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 684/1360] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:07:11 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:07:12.869332 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-63113f53-3f29-4b1f-b58b-c63c319e8fe5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:07:12.870490 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-63113f53-3f29-4b1f-b58b-c63c319e8fe5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: 54869618-8ecd-4fac-8904-fe0b3bf2d3b5] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:07:12.879538 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-63113f53-3f29-4b1f-b58b-c63c319e8fe5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:12.880047 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-63113f53-3f29-4b1f-b58b-c63c319e8fe5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:12.880892 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-63113f53-3f29-4b1f-b58b-c63c319e8fe5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:12.881505 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-63113f53-3f29-4b1f-b58b-c63c319e8fe5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:12.901526 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-5691d05a-965b-49b2-b942-50922fd79c5f tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:07:12.902253 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-5691d05a-965b-49b2-b942-50922fd79c5f tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:07:12.910223 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5691d05a-965b-49b2-b942-50922fd79c5f tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:12.910728 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5691d05a-965b-49b2-b942-50922fd79c5f tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:12.911562 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5691d05a-965b-49b2-b942-50922fd79c5f tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:12.912185 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5691d05a-965b-49b2-b942-50922fd79c5f tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:13.030198 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-63113f53-3f29-4b1f-b58b-c63c319e8fe5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action" status: 200 len: 28655 microversion: 2.20 time: 0.168772 Dec 16 15:07:13.031175 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 677/1361] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 15:07:12 2021] POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action => generated 28655 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:07:13.145239 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-5691d05a-965b-49b2-b942-50922fd79c5f tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:07:13.154017 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-5691d05a-965b-49b2-b942-50922fd79c5f tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.260231 Dec 16 15:07:13.154665 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 685/1362] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:07:12 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:07:14.047798 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-cc6c9139-c1f7-49a6-9542-f6aec00276aa tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:07:14.048939 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-cc6c9139-c1f7-49a6-9542-f6aec00276aa tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: 54869618-8ecd-4fac-8904-fe0b3bf2d3b5] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:07:14.057665 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cc6c9139-c1f7-49a6-9542-f6aec00276aa tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:14.058252 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cc6c9139-c1f7-49a6-9542-f6aec00276aa tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:14.059108 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cc6c9139-c1f7-49a6-9542-f6aec00276aa tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:14.059607 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cc6c9139-c1f7-49a6-9542-f6aec00276aa tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:14.176569 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-14e3ab1e-6757-4e69-8bd7-84fea97cf8dc tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:07:14.177158 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-14e3ab1e-6757-4e69-8bd7-84fea97cf8dc tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:07:14.185041 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-14e3ab1e-6757-4e69-8bd7-84fea97cf8dc tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:14.185550 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-14e3ab1e-6757-4e69-8bd7-84fea97cf8dc tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:14.186411 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-14e3ab1e-6757-4e69-8bd7-84fea97cf8dc tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:14.186902 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-14e3ab1e-6757-4e69-8bd7-84fea97cf8dc tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:14.188734 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-cc6c9139-c1f7-49a6-9542-f6aec00276aa tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action" status: 200 len: 28655 microversion: 2.20 time: 0.148884 Dec 16 15:07:14.189675 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 678/1363] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 15:07:14 2021] POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action => generated 28655 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 16 15:07:14.406224 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-14e3ab1e-6757-4e69-8bd7-84fea97cf8dc tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:07:14.416776 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-14e3ab1e-6757-4e69-8bd7-84fea97cf8dc tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.248568 Dec 16 15:07:14.417370 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 686/1364] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:07:14 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:07:15.205877 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-2f1d5519-12af-4dd2-aa76-46d91dca8ba1 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:07:15.207051 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-2f1d5519-12af-4dd2-aa76-46d91dca8ba1 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: 54869618-8ecd-4fac-8904-fe0b3bf2d3b5] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:07:15.215555 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2f1d5519-12af-4dd2-aa76-46d91dca8ba1 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:15.216055 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2f1d5519-12af-4dd2-aa76-46d91dca8ba1 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:15.216884 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2f1d5519-12af-4dd2-aa76-46d91dca8ba1 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:15.217371 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2f1d5519-12af-4dd2-aa76-46d91dca8ba1 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:15.343240 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-2f1d5519-12af-4dd2-aa76-46d91dca8ba1 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action" status: 200 len: 28655 microversion: 2.20 time: 0.145330 Dec 16 15:07:15.345030 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 679/1365] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 15:07:15 2021] POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action => generated 28655 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:07:15.439706 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-9ee5398a-c012-4497-b3ca-758e6880d861 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:07:15.440383 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-9ee5398a-c012-4497-b3ca-758e6880d861 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:07:15.448588 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9ee5398a-c012-4497-b3ca-758e6880d861 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:15.449096 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9ee5398a-c012-4497-b3ca-758e6880d861 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:15.449958 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9ee5398a-c012-4497-b3ca-758e6880d861 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:15.450545 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9ee5398a-c012-4497-b3ca-758e6880d861 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:15.672732 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-9ee5398a-c012-4497-b3ca-758e6880d861 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:07:15.681627 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-9ee5398a-c012-4497-b3ca-758e6880d861 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.250209 Dec 16 15:07:15.682243 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 687/1366] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:07:15 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:07:16.361610 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-d8da6a7e-00db-4368-9fc8-b23a9b340bfe tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:07:16.363383 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-d8da6a7e-00db-4368-9fc8-b23a9b340bfe tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: 54869618-8ecd-4fac-8904-fe0b3bf2d3b5] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:07:16.371976 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d8da6a7e-00db-4368-9fc8-b23a9b340bfe tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:16.372478 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d8da6a7e-00db-4368-9fc8-b23a9b340bfe tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:16.373882 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d8da6a7e-00db-4368-9fc8-b23a9b340bfe tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:16.374400 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d8da6a7e-00db-4368-9fc8-b23a9b340bfe tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:16.500726 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-d8da6a7e-00db-4368-9fc8-b23a9b340bfe tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action" status: 200 len: 28655 microversion: 2.20 time: 0.147586 Dec 16 15:07:16.501359 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 680/1367] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 15:07:16 2021] POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action => generated 28655 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:07:16.704076 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-9bbfcee5-0e80-4be8-93f9-9fa4dc88cdfc tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:07:16.704747 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-9bbfcee5-0e80-4be8-93f9-9fa4dc88cdfc tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:07:16.712669 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9bbfcee5-0e80-4be8-93f9-9fa4dc88cdfc tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:16.713185 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9bbfcee5-0e80-4be8-93f9-9fa4dc88cdfc tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:16.714024 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9bbfcee5-0e80-4be8-93f9-9fa4dc88cdfc tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:16.714549 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9bbfcee5-0e80-4be8-93f9-9fa4dc88cdfc tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:16.935105 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-9bbfcee5-0e80-4be8-93f9-9fa4dc88cdfc tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:07:16.944606 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-9bbfcee5-0e80-4be8-93f9-9fa4dc88cdfc tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.248341 Dec 16 15:07:16.945192 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 688/1368] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:07:16 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:07:17.518565 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-232ef885-081d-4147-a6ee-044456acb2ce tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:07:17.519631 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-232ef885-081d-4147-a6ee-044456acb2ce tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: 54869618-8ecd-4fac-8904-fe0b3bf2d3b5] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:07:17.528251 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-232ef885-081d-4147-a6ee-044456acb2ce tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:17.528764 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-232ef885-081d-4147-a6ee-044456acb2ce tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:17.529607 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-232ef885-081d-4147-a6ee-044456acb2ce tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:17.530133 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-232ef885-081d-4147-a6ee-044456acb2ce tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:17.658059 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-232ef885-081d-4147-a6ee-044456acb2ce tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action" status: 200 len: 28655 microversion: 2.20 time: 0.147758 Dec 16 15:07:17.658789 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 681/1369] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 15:07:17 2021] POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action => generated 28655 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:07:18.179178 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-487613ec-5b13-4e95-884c-f422cbf14b88 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:07:18.179849 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-487613ec-5b13-4e95-884c-f422cbf14b88 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:07:18.187740 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-487613ec-5b13-4e95-884c-f422cbf14b88 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:18.188242 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-487613ec-5b13-4e95-884c-f422cbf14b88 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:18.189081 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-487613ec-5b13-4e95-884c-f422cbf14b88 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:18.189563 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-487613ec-5b13-4e95-884c-f422cbf14b88 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:18.408580 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-487613ec-5b13-4e95-884c-f422cbf14b88 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:07:18.417613 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-487613ec-5b13-4e95-884c-f422cbf14b88 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.458756 Dec 16 15:07:18.418450 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 689/1370] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:07:17 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:07:18.675267 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-b826faba-1be2-4774-bd20-079b4b8088a5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:07:18.676374 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-b826faba-1be2-4774-bd20-079b4b8088a5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: 54869618-8ecd-4fac-8904-fe0b3bf2d3b5] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:07:18.685116 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b826faba-1be2-4774-bd20-079b4b8088a5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:18.685624 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b826faba-1be2-4774-bd20-079b4b8088a5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:18.686484 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b826faba-1be2-4774-bd20-079b4b8088a5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:18.686979 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b826faba-1be2-4774-bd20-079b4b8088a5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:18.813205 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-b826faba-1be2-4774-bd20-079b4b8088a5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action" status: 200 len: 28655 microversion: 2.20 time: 0.146087 Dec 16 15:07:18.814417 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 682/1371] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 15:07:18 2021] POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action => generated 28655 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:07:19.440289 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-ecb1d0b8-6c54-4cb8-a8c9-5e2844e76769 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:07:19.440962 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-ecb1d0b8-6c54-4cb8-a8c9-5e2844e76769 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:07:19.449335 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ecb1d0b8-6c54-4cb8-a8c9-5e2844e76769 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:19.449844 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ecb1d0b8-6c54-4cb8-a8c9-5e2844e76769 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:19.450709 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ecb1d0b8-6c54-4cb8-a8c9-5e2844e76769 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:19.451200 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ecb1d0b8-6c54-4cb8-a8c9-5e2844e76769 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:19.666804 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-ecb1d0b8-6c54-4cb8-a8c9-5e2844e76769 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:07:19.675768 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-ecb1d0b8-6c54-4cb8-a8c9-5e2844e76769 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.243832 Dec 16 15:07:19.676538 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 690/1372] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:07:19 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:07:19.830787 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-b343979d-5a1b-4cf2-9ecd-531fd904ae35 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:07:19.831927 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-b343979d-5a1b-4cf2-9ecd-531fd904ae35 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: 54869618-8ecd-4fac-8904-fe0b3bf2d3b5] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:07:19.840491 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b343979d-5a1b-4cf2-9ecd-531fd904ae35 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:19.840998 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b343979d-5a1b-4cf2-9ecd-531fd904ae35 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:19.841839 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b343979d-5a1b-4cf2-9ecd-531fd904ae35 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:19.842355 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b343979d-5a1b-4cf2-9ecd-531fd904ae35 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:19.979724 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-b343979d-5a1b-4cf2-9ecd-531fd904ae35 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action" status: 200 len: 28655 microversion: 2.20 time: 0.156915 Dec 16 15:07:19.980336 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 683/1373] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 15:07:19 2021] POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action => generated 28655 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:07:20.696834 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-745d4126-093c-451c-a6c0-30084c1e2d98 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:07:20.697505 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-745d4126-093c-451c-a6c0-30084c1e2d98 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:07:20.705907 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-745d4126-093c-451c-a6c0-30084c1e2d98 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:20.706442 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-745d4126-093c-451c-a6c0-30084c1e2d98 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:20.707273 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-745d4126-093c-451c-a6c0-30084c1e2d98 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:20.707788 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-745d4126-093c-451c-a6c0-30084c1e2d98 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:20.923556 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-745d4126-093c-451c-a6c0-30084c1e2d98 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:07:20.933856 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-745d4126-093c-451c-a6c0-30084c1e2d98 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.244906 Dec 16 15:07:20.934487 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 691/1374] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:07:20 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:07:20.996530 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-e4a9026f-819c-4c90-a3c0-0faacd9a0c49 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:07:21.001696 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-e4a9026f-819c-4c90-a3c0-0faacd9a0c49 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: 54869618-8ecd-4fac-8904-fe0b3bf2d3b5] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:07:21.006752 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e4a9026f-819c-4c90-a3c0-0faacd9a0c49 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:21.007263 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e4a9026f-819c-4c90-a3c0-0faacd9a0c49 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:21.008106 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e4a9026f-819c-4c90-a3c0-0faacd9a0c49 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:21.008603 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e4a9026f-819c-4c90-a3c0-0faacd9a0c49 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:21.153096 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-e4a9026f-819c-4c90-a3c0-0faacd9a0c49 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action" status: 200 len: 28655 microversion: 2.20 time: 0.164654 Dec 16 15:07:21.153716 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 684/1375] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 15:07:20 2021] POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action => generated 28655 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:07:21.959466 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-43d06e99-57d1-48a2-813e-651777b9345d tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:07:21.960231 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-43d06e99-57d1-48a2-813e-651777b9345d tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:07:21.968859 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-43d06e99-57d1-48a2-813e-651777b9345d tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:21.969366 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-43d06e99-57d1-48a2-813e-651777b9345d tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:21.970761 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-43d06e99-57d1-48a2-813e-651777b9345d tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:21.971260 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-43d06e99-57d1-48a2-813e-651777b9345d tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:22.171043 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-45d9cccd-99cc-4b8e-8e04-df909095fbb2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:07:22.172183 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-45d9cccd-99cc-4b8e-8e04-df909095fbb2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: 54869618-8ecd-4fac-8904-fe0b3bf2d3b5] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:07:22.179628 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-43d06e99-57d1-48a2-813e-651777b9345d tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:07:22.180775 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-45d9cccd-99cc-4b8e-8e04-df909095fbb2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:22.181283 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-45d9cccd-99cc-4b8e-8e04-df909095fbb2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:22.182259 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-45d9cccd-99cc-4b8e-8e04-df909095fbb2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:22.182648 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-45d9cccd-99cc-4b8e-8e04-df909095fbb2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:22.188599 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-43d06e99-57d1-48a2-813e-651777b9345d tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.239218 Dec 16 15:07:22.189198 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 692/1376] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:07:21 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:07:22.313026 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-45d9cccd-99cc-4b8e-8e04-df909095fbb2 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action" status: 200 len: 28655 microversion: 2.20 time: 0.151053 Dec 16 15:07:22.317292 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 685/1377] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 15:07:22 2021] POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action => generated 28655 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 16 15:07:23.210882 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-2026aea4-a541-421c-937c-edbd741893d2 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:07:23.211558 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-2026aea4-a541-421c-937c-edbd741893d2 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:07:23.224708 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2026aea4-a541-421c-937c-edbd741893d2 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:23.225388 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2026aea4-a541-421c-937c-edbd741893d2 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:23.226585 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2026aea4-a541-421c-937c-edbd741893d2 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:23.227078 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2026aea4-a541-421c-937c-edbd741893d2 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:23.329357 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-3f0092dc-8e0c-4aa0-9b92-668c555c160b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:07:23.330521 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-3f0092dc-8e0c-4aa0-9b92-668c555c160b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: 54869618-8ecd-4fac-8904-fe0b3bf2d3b5] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:07:23.339211 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3f0092dc-8e0c-4aa0-9b92-668c555c160b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:23.339924 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3f0092dc-8e0c-4aa0-9b92-668c555c160b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:23.340921 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3f0092dc-8e0c-4aa0-9b92-668c555c160b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:23.341591 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3f0092dc-8e0c-4aa0-9b92-668c555c160b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:23.455147 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-2026aea4-a541-421c-937c-edbd741893d2 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:07:23.465926 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-2026aea4-a541-421c-937c-edbd741893d2 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.262670 Dec 16 15:07:23.466846 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 693/1378] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:07:23 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:07:23.481059 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-3f0092dc-8e0c-4aa0-9b92-668c555c160b tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action" status: 200 len: 28655 microversion: 2.20 time: 0.159534 Dec 16 15:07:23.486069 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 686/1379] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 15:07:23 2021] POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action => generated 28655 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 16 15:07:24.488531 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-e86e704e-ed2d-4da8-b317-0ba6a52c4f10 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:07:24.489212 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-e86e704e-ed2d-4da8-b317-0ba6a52c4f10 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:07:24.497174 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e86e704e-ed2d-4da8-b317-0ba6a52c4f10 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:24.497904 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e86e704e-ed2d-4da8-b317-0ba6a52c4f10 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:24.498314 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-bbe29772-8a40-48b5-a3b6-921876dc0da1 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:07:24.499304 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e86e704e-ed2d-4da8-b317-0ba6a52c4f10 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:24.499597 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-bbe29772-8a40-48b5-a3b6-921876dc0da1 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: 54869618-8ecd-4fac-8904-fe0b3bf2d3b5] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:07:24.500129 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e86e704e-ed2d-4da8-b317-0ba6a52c4f10 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:24.508791 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-bbe29772-8a40-48b5-a3b6-921876dc0da1 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:24.509224 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-bbe29772-8a40-48b5-a3b6-921876dc0da1 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:24.510084 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-bbe29772-8a40-48b5-a3b6-921876dc0da1 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:24.510744 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-bbe29772-8a40-48b5-a3b6-921876dc0da1 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:24.656334 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-bbe29772-8a40-48b5-a3b6-921876dc0da1 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action" status: 200 len: 28655 microversion: 2.20 time: 0.166174 Dec 16 15:07:24.658836 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 687/1380] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 15:07:24 2021] POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action => generated 28655 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:07:24.743965 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-e86e704e-ed2d-4da8-b317-0ba6a52c4f10 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:07:24.753333 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-e86e704e-ed2d-4da8-b317-0ba6a52c4f10 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.272419 Dec 16 15:07:24.753925 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 694/1381] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:07:24 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:07:25.675002 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-da2ad8e0-e1e8-4798-a698-570a191ed032 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:07:25.676220 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-da2ad8e0-e1e8-4798-a698-570a191ed032 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: 54869618-8ecd-4fac-8904-fe0b3bf2d3b5] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:07:25.685020 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-da2ad8e0-e1e8-4798-a698-570a191ed032 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:25.685525 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-da2ad8e0-e1e8-4798-a698-570a191ed032 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:25.686521 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-da2ad8e0-e1e8-4798-a698-570a191ed032 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:25.686939 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-da2ad8e0-e1e8-4798-a698-570a191ed032 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:25.777816 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-a96f16f5-31cb-4aad-91c3-a86e68fe583f tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:07:25.777816 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-a96f16f5-31cb-4aad-91c3-a86e68fe583f tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:07:25.785488 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a96f16f5-31cb-4aad-91c3-a86e68fe583f tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:25.785993 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a96f16f5-31cb-4aad-91c3-a86e68fe583f tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:25.786863 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a96f16f5-31cb-4aad-91c3-a86e68fe583f tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:25.787354 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a96f16f5-31cb-4aad-91c3-a86e68fe583f tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:25.817200 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-da2ad8e0-e1e8-4798-a698-570a191ed032 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action" status: 200 len: 28655 microversion: 2.20 time: 0.151256 Dec 16 15:07:25.821650 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 688/1382] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 15:07:25 2021] POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action => generated 28655 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:07:26.014841 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-a96f16f5-31cb-4aad-91c3-a86e68fe583f tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:07:26.025057 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-a96f16f5-31cb-4aad-91c3-a86e68fe583f tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.256803 Dec 16 15:07:26.025649 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 695/1383] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:07:25 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:07:26.833701 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-b5634d8c-8295-4100-b9e9-84158218d11a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:07:26.834969 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-b5634d8c-8295-4100-b9e9-84158218d11a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: 54869618-8ecd-4fac-8904-fe0b3bf2d3b5] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:07:26.843716 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b5634d8c-8295-4100-b9e9-84158218d11a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:26.844262 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b5634d8c-8295-4100-b9e9-84158218d11a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:26.845122 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b5634d8c-8295-4100-b9e9-84158218d11a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:26.845622 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b5634d8c-8295-4100-b9e9-84158218d11a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:26.974316 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-b5634d8c-8295-4100-b9e9-84158218d11a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action" status: 200 len: 28655 microversion: 2.20 time: 0.148762 Dec 16 15:07:26.974951 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 689/1384] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 15:07:26 2021] POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action => generated 28655 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:07:27.047685 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-d0b55f75-f97d-4823-b179-f45f65f546ea tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:07:27.048982 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-d0b55f75-f97d-4823-b179-f45f65f546ea tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:07:27.056789 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d0b55f75-f97d-4823-b179-f45f65f546ea tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:27.057296 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d0b55f75-f97d-4823-b179-f45f65f546ea tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:27.058154 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d0b55f75-f97d-4823-b179-f45f65f546ea tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:27.058645 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d0b55f75-f97d-4823-b179-f45f65f546ea tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:27.278028 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-d0b55f75-f97d-4823-b179-f45f65f546ea tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:07:27.287598 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-d0b55f75-f97d-4823-b179-f45f65f546ea tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.247663 Dec 16 15:07:27.288182 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 696/1385] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:07:27 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:07:27.991007 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-8985d6b8-53c3-4cc2-9fd9-18094d4c7855 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:07:27.992232 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-8985d6b8-53c3-4cc2-9fd9-18094d4c7855 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: 54869618-8ecd-4fac-8904-fe0b3bf2d3b5] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:07:28.001016 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8985d6b8-53c3-4cc2-9fd9-18094d4c7855 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:28.001605 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8985d6b8-53c3-4cc2-9fd9-18094d4c7855 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:28.002559 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8985d6b8-53c3-4cc2-9fd9-18094d4c7855 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:28.003151 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8985d6b8-53c3-4cc2-9fd9-18094d4c7855 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:28.132032 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-8985d6b8-53c3-4cc2-9fd9-18094d4c7855 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action" status: 200 len: 28655 microversion: 2.20 time: 0.149779 Dec 16 15:07:28.132814 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 690/1386] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 15:07:27 2021] POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action => generated 28655 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:07:28.308887 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-69daca8b-6f21-4f19-b9c9-d3774d3c7785 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:07:28.309548 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-69daca8b-6f21-4f19-b9c9-d3774d3c7785 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:07:28.318345 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-69daca8b-6f21-4f19-b9c9-d3774d3c7785 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:28.318845 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-69daca8b-6f21-4f19-b9c9-d3774d3c7785 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:28.319672 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-69daca8b-6f21-4f19-b9c9-d3774d3c7785 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:28.320154 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-69daca8b-6f21-4f19-b9c9-d3774d3c7785 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:28.545717 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-69daca8b-6f21-4f19-b9c9-d3774d3c7785 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:07:28.555139 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-69daca8b-6f21-4f19-b9c9-d3774d3c7785 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.253860 Dec 16 15:07:28.555728 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 697/1387] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:07:28 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:07:29.149229 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-308f0c51-2f74-4c7a-813e-ac4a33edf1b9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:07:29.150449 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-308f0c51-2f74-4c7a-813e-ac4a33edf1b9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: 54869618-8ecd-4fac-8904-fe0b3bf2d3b5] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:07:29.159694 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-308f0c51-2f74-4c7a-813e-ac4a33edf1b9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:29.160207 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-308f0c51-2f74-4c7a-813e-ac4a33edf1b9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:29.161052 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-308f0c51-2f74-4c7a-813e-ac4a33edf1b9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:29.161557 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-308f0c51-2f74-4c7a-813e-ac4a33edf1b9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:29.286982 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-308f0c51-2f74-4c7a-813e-ac4a33edf1b9 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action" status: 200 len: 28655 microversion: 2.20 time: 0.146119 Dec 16 15:07:29.287659 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 691/1388] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 15:07:29 2021] POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action => generated 28655 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:07:29.577205 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-f204999e-07f9-4ca8-aec4-4556856e7219 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:07:29.577875 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-f204999e-07f9-4ca8-aec4-4556856e7219 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:07:29.585725 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f204999e-07f9-4ca8-aec4-4556856e7219 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:29.586305 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f204999e-07f9-4ca8-aec4-4556856e7219 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:29.587141 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f204999e-07f9-4ca8-aec4-4556856e7219 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:29.587635 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f204999e-07f9-4ca8-aec4-4556856e7219 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:29.805895 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-f204999e-07f9-4ca8-aec4-4556856e7219 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:07:29.815367 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-f204999e-07f9-4ca8-aec4-4556856e7219 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.245808 Dec 16 15:07:29.815968 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 698/1389] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:07:29 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:07:30.303210 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-fcc4692d-eae6-4768-870e-975b18c63f4a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:07:30.304386 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-fcc4692d-eae6-4768-870e-975b18c63f4a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: 54869618-8ecd-4fac-8904-fe0b3bf2d3b5] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:07:30.313099 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fcc4692d-eae6-4768-870e-975b18c63f4a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:30.313610 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fcc4692d-eae6-4768-870e-975b18c63f4a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:30.314487 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fcc4692d-eae6-4768-870e-975b18c63f4a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:30.314992 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fcc4692d-eae6-4768-870e-975b18c63f4a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:30.440068 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-fcc4692d-eae6-4768-870e-975b18c63f4a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action" status: 200 len: 28655 microversion: 2.20 time: 0.144884 Dec 16 15:07:30.441049 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 692/1390] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 15:07:30 2021] POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action => generated 28655 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:07:30.838207 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-676be983-f8c5-48d6-aa9d-da472ab59db6 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:07:30.838876 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-676be983-f8c5-48d6-aa9d-da472ab59db6 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:07:30.846692 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-676be983-f8c5-48d6-aa9d-da472ab59db6 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:30.847227 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-676be983-f8c5-48d6-aa9d-da472ab59db6 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:30.848033 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-676be983-f8c5-48d6-aa9d-da472ab59db6 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:30.848518 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-676be983-f8c5-48d6-aa9d-da472ab59db6 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:31.068949 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-676be983-f8c5-48d6-aa9d-da472ab59db6 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:07:31.077812 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-676be983-f8c5-48d6-aa9d-da472ab59db6 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.247320 Dec 16 15:07:31.078407 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 699/1391] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:07:30 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:07:31.456793 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-e64afe33-14b7-4a11-b19a-f9243308225a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:07:31.457954 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-e64afe33-14b7-4a11-b19a-f9243308225a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: 54869618-8ecd-4fac-8904-fe0b3bf2d3b5] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:07:31.466497 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e64afe33-14b7-4a11-b19a-f9243308225a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:31.467003 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e64afe33-14b7-4a11-b19a-f9243308225a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:31.467851 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e64afe33-14b7-4a11-b19a-f9243308225a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:31.468342 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e64afe33-14b7-4a11-b19a-f9243308225a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:31.590895 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-e64afe33-14b7-4a11-b19a-f9243308225a tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action" status: 200 len: 28655 microversion: 2.20 time: 0.142279 Dec 16 15:07:31.591796 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 693/1392] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 15:07:31 2021] POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action => generated 28655 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:07:32.100291 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-d005312e-a8ae-4530-b3b7-8f6b34127bcb tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:07:32.100944 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-d005312e-a8ae-4530-b3b7-8f6b34127bcb tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:07:32.108846 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d005312e-a8ae-4530-b3b7-8f6b34127bcb tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:32.109360 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d005312e-a8ae-4530-b3b7-8f6b34127bcb tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:32.110256 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d005312e-a8ae-4530-b3b7-8f6b34127bcb tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:32.110751 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d005312e-a8ae-4530-b3b7-8f6b34127bcb tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:32.325466 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-d005312e-a8ae-4530-b3b7-8f6b34127bcb tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:07:32.336112 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-d005312e-a8ae-4530-b3b7-8f6b34127bcb tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.244135 Dec 16 15:07:32.347326 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 700/1393] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:07:32 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:07:32.607464 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-41f31d7f-7e51-496d-adb7-36fd7a6aae61 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:07:32.608602 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-41f31d7f-7e51-496d-adb7-36fd7a6aae61 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: 54869618-8ecd-4fac-8904-fe0b3bf2d3b5] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:07:32.617664 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-41f31d7f-7e51-496d-adb7-36fd7a6aae61 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:32.618226 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-41f31d7f-7e51-496d-adb7-36fd7a6aae61 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:32.619069 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-41f31d7f-7e51-496d-adb7-36fd7a6aae61 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:32.619574 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-41f31d7f-7e51-496d-adb7-36fd7a6aae61 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:32.748544 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-41f31d7f-7e51-496d-adb7-36fd7a6aae61 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action" status: 200 len: 28655 microversion: 2.20 time: 0.149165 Dec 16 15:07:32.749275 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 694/1394] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 15:07:32 2021] POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action => generated 28655 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:07:33.363667 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-283315a8-eea2-45ae-957b-3b43b6d8d199 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:07:33.364332 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-283315a8-eea2-45ae-957b-3b43b6d8d199 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:07:33.372347 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-283315a8-eea2-45ae-957b-3b43b6d8d199 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:33.372852 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-283315a8-eea2-45ae-957b-3b43b6d8d199 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:33.373695 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-283315a8-eea2-45ae-957b-3b43b6d8d199 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:33.374208 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-283315a8-eea2-45ae-957b-3b43b6d8d199 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:33.591691 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-283315a8-eea2-45ae-957b-3b43b6d8d199 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:07:33.600761 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-283315a8-eea2-45ae-957b-3b43b6d8d199 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.245670 Dec 16 15:07:33.601359 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 701/1395] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:07:33 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:07:33.765687 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-fe4d274d-5119-41e5-a936-3a37a9d1d599 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:07:33.766864 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-fe4d274d-5119-41e5-a936-3a37a9d1d599 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: 54869618-8ecd-4fac-8904-fe0b3bf2d3b5] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:07:33.775454 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fe4d274d-5119-41e5-a936-3a37a9d1d599 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:33.775915 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fe4d274d-5119-41e5-a936-3a37a9d1d599 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:33.776753 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fe4d274d-5119-41e5-a936-3a37a9d1d599 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:33.777246 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fe4d274d-5119-41e5-a936-3a37a9d1d599 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:34.036739 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-fe4d274d-5119-41e5-a936-3a37a9d1d599 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action" status: 200 len: 28655 microversion: 2.20 time: 0.278992 Dec 16 15:07:34.037351 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 695/1396] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 15:07:33 2021] POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action => generated 28655 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:07:34.623489 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-c3af85d9-c28c-45e2-9035-e001db20b2e0 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:07:34.624159 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-c3af85d9-c28c-45e2-9035-e001db20b2e0 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:07:34.632105 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c3af85d9-c28c-45e2-9035-e001db20b2e0 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:34.632626 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c3af85d9-c28c-45e2-9035-e001db20b2e0 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:34.633435 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c3af85d9-c28c-45e2-9035-e001db20b2e0 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:34.633921 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c3af85d9-c28c-45e2-9035-e001db20b2e0 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:34.847684 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-c3af85d9-c28c-45e2-9035-e001db20b2e0 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:07:34.856479 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-c3af85d9-c28c-45e2-9035-e001db20b2e0 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.240857 Dec 16 15:07:34.857077 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 702/1397] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:07:34 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:07:35.053428 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-a3bf6547-b8fb-4a46-97c7-f2f8a5b2a073 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:07:35.054568 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-a3bf6547-b8fb-4a46-97c7-f2f8a5b2a073 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: 54869618-8ecd-4fac-8904-fe0b3bf2d3b5] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:07:35.063015 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a3bf6547-b8fb-4a46-97c7-f2f8a5b2a073 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:35.063516 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a3bf6547-b8fb-4a46-97c7-f2f8a5b2a073 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:35.064346 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a3bf6547-b8fb-4a46-97c7-f2f8a5b2a073 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:35.064835 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a3bf6547-b8fb-4a46-97c7-f2f8a5b2a073 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:35.189486 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-a3bf6547-b8fb-4a46-97c7-f2f8a5b2a073 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action" status: 200 len: 28655 microversion: 2.20 time: 0.144062 Dec 16 15:07:35.190123 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 696/1398] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 15:07:35 2021] POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action => generated 28655 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:07:35.877479 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-cf687f6f-34e0-4f0e-9ab1-ef1d69b7dc87 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:07:35.878229 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-cf687f6f-34e0-4f0e-9ab1-ef1d69b7dc87 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:07:35.886085 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cf687f6f-34e0-4f0e-9ab1-ef1d69b7dc87 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:35.886583 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cf687f6f-34e0-4f0e-9ab1-ef1d69b7dc87 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:35.887423 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cf687f6f-34e0-4f0e-9ab1-ef1d69b7dc87 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:35.887920 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cf687f6f-34e0-4f0e-9ab1-ef1d69b7dc87 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:36.116050 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-cf687f6f-34e0-4f0e-9ab1-ef1d69b7dc87 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:07:36.124797 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-cf687f6f-34e0-4f0e-9ab1-ef1d69b7dc87 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.254943 Dec 16 15:07:36.125373 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 703/1399] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:07:35 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:07:36.206343 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-74ce911f-6438-46b9-894b-2087630c93de tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:07:36.207477 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-74ce911f-6438-46b9-894b-2087630c93de tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: 54869618-8ecd-4fac-8904-fe0b3bf2d3b5] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:07:36.216008 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-74ce911f-6438-46b9-894b-2087630c93de tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:36.216510 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-74ce911f-6438-46b9-894b-2087630c93de tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:36.217344 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-74ce911f-6438-46b9-894b-2087630c93de tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:36.217834 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-74ce911f-6438-46b9-894b-2087630c93de tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:36.342614 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-74ce911f-6438-46b9-894b-2087630c93de tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action" status: 200 len: 28655 microversion: 2.20 time: 0.144956 Dec 16 15:07:36.344435 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 697/1400] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 15:07:36 2021] POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action => generated 28655 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:07:37.147514 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-36235428-ab75-440b-855b-b27c8351b62e tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:07:37.148180 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-36235428-ab75-440b-855b-b27c8351b62e tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:07:37.156105 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-36235428-ab75-440b-855b-b27c8351b62e tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:37.156616 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-36235428-ab75-440b-855b-b27c8351b62e tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:37.158069 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-36235428-ab75-440b-855b-b27c8351b62e tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:37.158569 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-36235428-ab75-440b-855b-b27c8351b62e tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:37.360414 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-c26f4836-ebb3-44d0-9bf9-1eaa4c6ee730 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:07:37.361606 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-c26f4836-ebb3-44d0-9bf9-1eaa4c6ee730 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: 54869618-8ecd-4fac-8904-fe0b3bf2d3b5] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:07:37.370439 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c26f4836-ebb3-44d0-9bf9-1eaa4c6ee730 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:37.370935 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c26f4836-ebb3-44d0-9bf9-1eaa4c6ee730 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:37.372002 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c26f4836-ebb3-44d0-9bf9-1eaa4c6ee730 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:37.372485 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c26f4836-ebb3-44d0-9bf9-1eaa4c6ee730 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:37.376004 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-36235428-ab75-440b-855b-b27c8351b62e tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:07:37.385233 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-36235428-ab75-440b-855b-b27c8351b62e tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.245797 Dec 16 15:07:37.385824 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 704/1401] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:07:37 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:07:37.519095 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-c26f4836-ebb3-44d0-9bf9-1eaa4c6ee730 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action" status: 200 len: 30130 microversion: 2.20 time: 0.167135 Dec 16 15:07:37.519792 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 698/1402] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 15:07:37 2021] POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action => generated 30130 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:07:38.409056 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-2bdde8f8-9441-4ae0-a9fa-4b681ececb5a tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:07:38.409725 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-2bdde8f8-9441-4ae0-a9fa-4b681ececb5a tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:07:38.417542 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2bdde8f8-9441-4ae0-a9fa-4b681ececb5a tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:38.418084 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2bdde8f8-9441-4ae0-a9fa-4b681ececb5a tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:38.418919 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2bdde8f8-9441-4ae0-a9fa-4b681ececb5a tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:38.419412 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2bdde8f8-9441-4ae0-a9fa-4b681ececb5a tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:38.536614 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-f84375da-0c6b-4837-b18d-5bdde6a194b7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:07:38.537680 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-f84375da-0c6b-4837-b18d-5bdde6a194b7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: 54869618-8ecd-4fac-8904-fe0b3bf2d3b5] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:07:38.546327 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f84375da-0c6b-4837-b18d-5bdde6a194b7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:38.546755 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f84375da-0c6b-4837-b18d-5bdde6a194b7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:38.548141 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f84375da-0c6b-4837-b18d-5bdde6a194b7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:38.548652 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f84375da-0c6b-4837-b18d-5bdde6a194b7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:38.640641 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-2bdde8f8-9441-4ae0-a9fa-4b681ececb5a tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:07:38.649909 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-2bdde8f8-9441-4ae0-a9fa-4b681ececb5a tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.248680 Dec 16 15:07:38.650533 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 705/1403] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:07:38 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:07:38.690287 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-f84375da-0c6b-4837-b18d-5bdde6a194b7 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action" status: 200 len: 32137 microversion: 2.20 time: 0.161853 Dec 16 15:07:38.691004 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 699/1404] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 15:07:38 2021] POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action => generated 32137 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 16 15:07:39.671559 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-cb829611-9103-47ad-97a0-3c8e426317ae tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:07:39.672201 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-cb829611-9103-47ad-97a0-3c8e426317ae tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:07:39.680036 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cb829611-9103-47ad-97a0-3c8e426317ae tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:39.680543 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cb829611-9103-47ad-97a0-3c8e426317ae tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:39.681372 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cb829611-9103-47ad-97a0-3c8e426317ae tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:39.681857 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cb829611-9103-47ad-97a0-3c8e426317ae tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:39.708751 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-b6f2409b-d67a-4136-ae6c-140f83424980 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:07:39.709890 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-b6f2409b-d67a-4136-ae6c-140f83424980 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: 54869618-8ecd-4fac-8904-fe0b3bf2d3b5] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:07:39.718592 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b6f2409b-d67a-4136-ae6c-140f83424980 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:39.719101 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b6f2409b-d67a-4136-ae6c-140f83424980 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:39.719952 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b6f2409b-d67a-4136-ae6c-140f83424980 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:39.720443 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b6f2409b-d67a-4136-ae6c-140f83424980 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:39.856647 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-b6f2409b-d67a-4136-ae6c-140f83424980 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action" status: 200 len: 33501 microversion: 2.20 time: 0.156162 Dec 16 15:07:39.856890 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 700/1405] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 15:07:39 2021] POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action => generated 33501 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 16 15:07:39.904415 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-cb829611-9103-47ad-97a0-3c8e426317ae tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:07:39.913831 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-cb829611-9103-47ad-97a0-3c8e426317ae tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.250017 Dec 16 15:07:39.914465 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 706/1406] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:07:39 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:07:40.873313 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-824a84ba-7783-46ed-b9db-412987377fff tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:07:40.874473 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-824a84ba-7783-46ed-b9db-412987377fff tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: 54869618-8ecd-4fac-8904-fe0b3bf2d3b5] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:07:40.883014 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-824a84ba-7783-46ed-b9db-412987377fff tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:40.883525 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-824a84ba-7783-46ed-b9db-412987377fff tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:40.884361 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-824a84ba-7783-46ed-b9db-412987377fff tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:40.884850 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-824a84ba-7783-46ed-b9db-412987377fff tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:40.936960 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-b9ed0805-5137-4abb-a912-a8be684f27a1 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:07:40.937645 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-b9ed0805-5137-4abb-a912-a8be684f27a1 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:07:40.945733 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b9ed0805-5137-4abb-a912-a8be684f27a1 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:40.946336 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b9ed0805-5137-4abb-a912-a8be684f27a1 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:40.947189 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b9ed0805-5137-4abb-a912-a8be684f27a1 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:40.947868 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b9ed0805-5137-4abb-a912-a8be684f27a1 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:41.034339 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-824a84ba-7783-46ed-b9db-412987377fff tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action" status: 200 len: 34606 microversion: 2.20 time: 0.168915 Dec 16 15:07:41.035299 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 701/1407] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 15:07:40 2021] POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action => generated 34606 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:07:41.170976 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-b9ed0805-5137-4abb-a912-a8be684f27a1 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:07:41.181226 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-b9ed0805-5137-4abb-a912-a8be684f27a1 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.251409 Dec 16 15:07:41.182085 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 707/1408] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:07:40 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:07:42.052445 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-cc44f00d-3ed1-498d-b46c-f9e3c4713be5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:07:42.053569 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-cc44f00d-3ed1-498d-b46c-f9e3c4713be5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: 54869618-8ecd-4fac-8904-fe0b3bf2d3b5] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:07:42.062188 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cc44f00d-3ed1-498d-b46c-f9e3c4713be5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:42.062694 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cc44f00d-3ed1-498d-b46c-f9e3c4713be5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:42.063536 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cc44f00d-3ed1-498d-b46c-f9e3c4713be5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:42.064029 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cc44f00d-3ed1-498d-b46c-f9e3c4713be5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:42.203551 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-cc44f00d-3ed1-498d-b46c-f9e3c4713be5 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action" status: 200 len: 35665 microversion: 2.20 time: 0.159745 Dec 16 15:07:42.204271 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 702/1409] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 15:07:42 2021] POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action => generated 35665 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:07:42.206755 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-00e7437f-123a-4ecc-86bd-e5a3b0755052 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:07:42.207423 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-00e7437f-123a-4ecc-86bd-e5a3b0755052 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:07:42.215356 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-00e7437f-123a-4ecc-86bd-e5a3b0755052 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:42.215863 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-00e7437f-123a-4ecc-86bd-e5a3b0755052 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:42.216693 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-00e7437f-123a-4ecc-86bd-e5a3b0755052 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:42.217182 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-00e7437f-123a-4ecc-86bd-e5a3b0755052 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:42.440051 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-00e7437f-123a-4ecc-86bd-e5a3b0755052 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:07:42.449294 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-00e7437f-123a-4ecc-86bd-e5a3b0755052 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.250662 Dec 16 15:07:42.449885 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 708/1410] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:07:42 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:07:43.221588 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-6e9248d8-ef98-433e-8fb0-9bbb2de04954 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:07:43.222680 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-6e9248d8-ef98-433e-8fb0-9bbb2de04954 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: 54869618-8ecd-4fac-8904-fe0b3bf2d3b5] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:07:43.231215 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6e9248d8-ef98-433e-8fb0-9bbb2de04954 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:43.231726 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6e9248d8-ef98-433e-8fb0-9bbb2de04954 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:43.232567 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6e9248d8-ef98-433e-8fb0-9bbb2de04954 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:43.233056 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6e9248d8-ef98-433e-8fb0-9bbb2de04954 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:43.396562 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-6e9248d8-ef98-433e-8fb0-9bbb2de04954 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action" status: 200 len: 37280 microversion: 2.20 time: 0.183748 Dec 16 15:07:43.397291 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 703/1411] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 15:07:43 2021] POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action => generated 37280 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:07:43.471666 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-33b5ab34-fd13-4ef3-b231-95d277b0303a tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:07:43.472372 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-33b5ab34-fd13-4ef3-b231-95d277b0303a tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:07:43.480181 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-33b5ab34-fd13-4ef3-b231-95d277b0303a tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:43.480697 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-33b5ab34-fd13-4ef3-b231-95d277b0303a tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:43.481527 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-33b5ab34-fd13-4ef3-b231-95d277b0303a tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:43.482013 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-33b5ab34-fd13-4ef3-b231-95d277b0303a tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:43.691679 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-33b5ab34-fd13-4ef3-b231-95d277b0303a tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:07:43.700898 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-33b5ab34-fd13-4ef3-b231-95d277b0303a tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.237016 Dec 16 15:07:43.701616 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 709/1412] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:07:43 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:07:44.414027 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-97a971d3-c816-4584-af5c-2f85817cbbef tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:07:44.415183 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-97a971d3-c816-4584-af5c-2f85817cbbef tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: 54869618-8ecd-4fac-8904-fe0b3bf2d3b5] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:07:44.424217 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-97a971d3-c816-4584-af5c-2f85817cbbef tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:44.424732 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-97a971d3-c816-4584-af5c-2f85817cbbef tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:44.425589 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-97a971d3-c816-4584-af5c-2f85817cbbef tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:44.426113 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-97a971d3-c816-4584-af5c-2f85817cbbef tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:44.566858 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-97a971d3-c816-4584-af5c-2f85817cbbef tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action" status: 200 len: 38211 microversion: 2.20 time: 0.161286 Dec 16 15:07:44.567830 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 704/1413] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 15:07:44 2021] POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action => generated 38211 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:07:44.724416 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-e1884257-4fcd-41c6-9e87-5f7c4a887b68 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:07:44.725441 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-e1884257-4fcd-41c6-9e87-5f7c4a887b68 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:07:44.733614 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e1884257-4fcd-41c6-9e87-5f7c4a887b68 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:44.734160 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e1884257-4fcd-41c6-9e87-5f7c4a887b68 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:44.735007 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e1884257-4fcd-41c6-9e87-5f7c4a887b68 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:44.735501 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e1884257-4fcd-41c6-9e87-5f7c4a887b68 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:44.954649 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-e1884257-4fcd-41c6-9e87-5f7c4a887b68 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:07:44.964168 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-e1884257-4fcd-41c6-9e87-5f7c4a887b68 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.247998 Dec 16 15:07:44.964901 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 710/1414] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:07:44 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:07:45.584597 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-6066cefa-ded2-4dde-ae03-a97de7c42d6d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:07:45.585734 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-6066cefa-ded2-4dde-ae03-a97de7c42d6d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: 54869618-8ecd-4fac-8904-fe0b3bf2d3b5] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:07:45.594436 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6066cefa-ded2-4dde-ae03-a97de7c42d6d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:45.594895 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6066cefa-ded2-4dde-ae03-a97de7c42d6d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:45.595742 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6066cefa-ded2-4dde-ae03-a97de7c42d6d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:45.596234 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6066cefa-ded2-4dde-ae03-a97de7c42d6d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:45.733100 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-6066cefa-ded2-4dde-ae03-a97de7c42d6d tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action" status: 200 len: 38211 microversion: 2.20 time: 0.156572 Dec 16 15:07:45.733816 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 705/1415] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 15:07:45 2021] POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action => generated 38211 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:07:45.985937 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-a4f8a703-fb39-4a57-a95b-406d4226e883 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:07:45.987266 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-a4f8a703-fb39-4a57-a95b-406d4226e883 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:07:45.995031 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a4f8a703-fb39-4a57-a95b-406d4226e883 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:45.995529 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a4f8a703-fb39-4a57-a95b-406d4226e883 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:45.996355 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a4f8a703-fb39-4a57-a95b-406d4226e883 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:45.996883 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a4f8a703-fb39-4a57-a95b-406d4226e883 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:46.212874 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-a4f8a703-fb39-4a57-a95b-406d4226e883 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:07:46.222322 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-a4f8a703-fb39-4a57-a95b-406d4226e883 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.244457 Dec 16 15:07:46.222919 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 711/1416] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:07:45 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:07:46.750575 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-6d44c79a-42c8-46c0-ace0-3945e18fffc4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:07:46.751891 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-6d44c79a-42c8-46c0-ace0-3945e18fffc4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: 54869618-8ecd-4fac-8904-fe0b3bf2d3b5] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:07:46.760872 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6d44c79a-42c8-46c0-ace0-3945e18fffc4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:46.761388 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6d44c79a-42c8-46c0-ace0-3945e18fffc4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:46.778197 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6d44c79a-42c8-46c0-ace0-3945e18fffc4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:46.778197 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6d44c79a-42c8-46c0-ace0-3945e18fffc4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:46.889941 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-6d44c79a-42c8-46c0-ace0-3945e18fffc4 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action" status: 200 len: 38211 microversion: 2.20 time: 0.147242 Dec 16 15:07:46.890687 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 706/1417] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 15:07:46 2021] POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action => generated 38211 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:07:47.244518 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-d9d86752-e212-42c4-8b49-566cff027638 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:07:47.245231 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-d9d86752-e212-42c4-8b49-566cff027638 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:07:47.253140 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d9d86752-e212-42c4-8b49-566cff027638 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:47.253647 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d9d86752-e212-42c4-8b49-566cff027638 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:47.254504 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d9d86752-e212-42c4-8b49-566cff027638 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:47.254997 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d9d86752-e212-42c4-8b49-566cff027638 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:47.466392 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-d9d86752-e212-42c4-8b49-566cff027638 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:07:47.475713 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-d9d86752-e212-42c4-8b49-566cff027638 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.238772 Dec 16 15:07:47.476313 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 712/1418] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:07:47 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:07:47.907192 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-0c3d9c06-5b3d-4b74-9dc5-c955ccd18bc3 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:07:47.908359 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-0c3d9c06-5b3d-4b74-9dc5-c955ccd18bc3 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: 54869618-8ecd-4fac-8904-fe0b3bf2d3b5] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:07:47.916844 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0c3d9c06-5b3d-4b74-9dc5-c955ccd18bc3 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:47.917348 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0c3d9c06-5b3d-4b74-9dc5-c955ccd18bc3 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:47.918224 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0c3d9c06-5b3d-4b74-9dc5-c955ccd18bc3 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:47.918714 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0c3d9c06-5b3d-4b74-9dc5-c955ccd18bc3 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:48.050606 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-0c3d9c06-5b3d-4b74-9dc5-c955ccd18bc3 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action" status: 200 len: 38214 microversion: 2.20 time: 0.151888 Dec 16 15:07:48.051219 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 707/1419] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 15:07:47 2021] POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action => generated 38214 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:07:48.498438 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-78fb9d77-1368-431a-9673-7a2154d4df89 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:07:48.499174 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-78fb9d77-1368-431a-9673-7a2154d4df89 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:07:48.506977 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-78fb9d77-1368-431a-9673-7a2154d4df89 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:48.507486 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-78fb9d77-1368-431a-9673-7a2154d4df89 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:48.508307 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-78fb9d77-1368-431a-9673-7a2154d4df89 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:48.508788 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-78fb9d77-1368-431a-9673-7a2154d4df89 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:48.725037 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-78fb9d77-1368-431a-9673-7a2154d4df89 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:07:48.733806 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-78fb9d77-1368-431a-9673-7a2154d4df89 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.242989 Dec 16 15:07:48.734466 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 713/1420] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:07:48 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:07:49.068055 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-c8a69630-d7fe-461f-a57a-16ed74de7b42 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:07:49.069173 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-c8a69630-d7fe-461f-a57a-16ed74de7b42 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: 54869618-8ecd-4fac-8904-fe0b3bf2d3b5] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:07:49.077695 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c8a69630-d7fe-461f-a57a-16ed74de7b42 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:49.078231 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c8a69630-d7fe-461f-a57a-16ed74de7b42 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:49.079066 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c8a69630-d7fe-461f-a57a-16ed74de7b42 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:49.079551 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c8a69630-d7fe-461f-a57a-16ed74de7b42 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:49.218117 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-c8a69630-d7fe-461f-a57a-16ed74de7b42 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action" status: 200 len: 38354 microversion: 2.20 time: 0.158959 Dec 16 15:07:49.218782 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 708/1421] 10.222.0.45 () {62 vars in 1309 bytes} [Thu Dec 16 15:07:49 2021] POST /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/action => generated 38354 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:07:49.234165 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-2ede2cfd-706f-452e-8caa-81a7afdbdb8f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:07:49.235214 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-2ede2cfd-706f-452e-8caa-81a7afdbdb8f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: 54869618-8ecd-4fac-8904-fe0b3bf2d3b5] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:07:49.242993 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2ede2cfd-706f-452e-8caa-81a7afdbdb8f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:49.243497 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2ede2cfd-706f-452e-8caa-81a7afdbdb8f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:49.244327 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2ede2cfd-706f-452e-8caa-81a7afdbdb8f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:49.244814 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2ede2cfd-706f-452e-8caa-81a7afdbdb8f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:49.311241 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-2ede2cfd-706f-452e-8caa-81a7afdbdb8f tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/ips" status: 200 len: 151 microversion: 2.20 time: 0.085479 Dec 16 15:07:49.311871 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 714/1422] 10.222.0.45 () {60 vars in 1279 bytes} [Thu Dec 16 15:07:49 2021] GET /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5/ips => generated 151 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:07:49.757436 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-b82b2084-f491-4ac8-abaa-1416880d0348 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:07:49.758225 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-b82b2084-f491-4ac8-abaa-1416880d0348 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:07:49.767659 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b82b2084-f491-4ac8-abaa-1416880d0348 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:49.768213 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b82b2084-f491-4ac8-abaa-1416880d0348 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:49.769051 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b82b2084-f491-4ac8-abaa-1416880d0348 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:49.769532 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b82b2084-f491-4ac8-abaa-1416880d0348 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:50.004149 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-b82b2084-f491-4ac8-abaa-1416880d0348 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:07:50.013058 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-b82b2084-f491-4ac8-abaa-1416880d0348 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1563 microversion: 2.1 time: 0.264646 Dec 16 15:07:50.013638 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 709/1423] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:07:49 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1563 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:07:51.693540 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-ac3e7dcd-a506-4421-84fe-0f063d78be7f tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:07:51.694764 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-ac3e7dcd-a506-4421-84fe-0f063d78be7f tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:07:51.696133 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [req-ec97e27e-19de-424c-92e2-b110bf298b93 req-b5379cc2-20d4-45bd-bcbd-55517fd64e76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60bfc41e-721c-45aa-a6fb-93f9213cf050", "tag": "2a20087b-09a5-411d-bbb0-eb5a2ee789c2"}]} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:07:51.700724 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:07:51.700724 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: warnings.warn(msg) Dec 16 15:07:51.703071 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ac3e7dcd-a506-4421-84fe-0f063d78be7f tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:51.704256 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ac3e7dcd-a506-4421-84fe-0f063d78be7f tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:51.705182 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ac3e7dcd-a506-4421-84fe-0f063d78be7f tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:51.705750 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ac3e7dcd-a506-4421-84fe-0f063d78be7f tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:51.711159 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-ec97e27e-19de-424c-92e2-b110bf298b93 req-b5379cc2-20d4-45bd-bcbd-55517fd64e76 service nova] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:51.711881 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-ec97e27e-19de-424c-92e2-b110bf298b93 req-b5379cc2-20d4-45bd-bcbd-55517fd64e76 service nova] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:51.728836 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.compute.server_external_events [req-ec97e27e-19de-424c-92e2-b110bf298b93 req-b5379cc2-20d4-45bd-bcbd-55517fd64e76 service nova] Creating event network-changed:2a20087b-09a5-411d-bbb0-eb5a2ee789c2 for instance 60bfc41e-721c-45aa-a6fb-93f9213cf050 on hv-cinder-82189 Dec 16 15:07:51.734009 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [req-ec97e27e-19de-424c-92e2-b110bf298b93 req-b5379cc2-20d4-45bd-bcbd-55517fd64e76 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046551 Dec 16 15:07:51.734680 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 710/1424] 10.222.0.45 () {64 vars in 1308 bytes} [Thu Dec 16 15:07:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:07:51.774987 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-ac3e7dcd-a506-4421-84fe-0f063d78be7f tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Going to try to terminate instance {{(pid=101356) delete /opt/stack/nova/nova/compute/api.py:2496}} Dec 16 15:07:51.980304 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-ac3e7dcd-a506-4421-84fe-0f063d78be7f tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "DELETE /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 204 len: 0 microversion: 2.1 time: 0.293788 Dec 16 15:07:51.982197 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 715/1425] 10.222.0.45 () {58 vars in 1229 bytes} [Thu Dec 16 15:07:51 2021] DELETE /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 16 15:07:51.999175 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-86aabd62-caad-4601-8e6a-ab14ef687d14 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:07:52.000282 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-86aabd62-caad-4601-8e6a-ab14ef687d14 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:07:52.009318 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-86aabd62-caad-4601-8e6a-ab14ef687d14 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:52.010117 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-86aabd62-caad-4601-8e6a-ab14ef687d14 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:52.011184 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-86aabd62-caad-4601-8e6a-ab14ef687d14 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:52.011808 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-86aabd62-caad-4601-8e6a-ab14ef687d14 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:52.511198 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-86aabd62-caad-4601-8e6a-ab14ef687d14 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:07:52.522837 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-86aabd62-caad-4601-8e6a-ab14ef687d14 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1569 microversion: 2.1 time: 0.532300 Dec 16 15:07:52.524540 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 711/1426] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:07:51 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1569 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:07:53.547511 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-5df1417f-fc12-46f9-b1ca-1f35d2ef90c6 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:07:53.548294 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-5df1417f-fc12-46f9-b1ca-1f35d2ef90c6 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:07:53.556235 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5df1417f-fc12-46f9-b1ca-1f35d2ef90c6 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:53.556751 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5df1417f-fc12-46f9-b1ca-1f35d2ef90c6 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:53.557607 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5df1417f-fc12-46f9-b1ca-1f35d2ef90c6 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:53.558134 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5df1417f-fc12-46f9-b1ca-1f35d2ef90c6 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:53.819992 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-5df1417f-fc12-46f9-b1ca-1f35d2ef90c6 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:07:53.838287 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-5df1417f-fc12-46f9-b1ca-1f35d2ef90c6 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1450 microversion: 2.1 time: 0.299527 Dec 16 15:07:53.848976 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 716/1427] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:07:53 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1450 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:07:53.909704 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [req-b50b9c4b-2334-47b2-a293-42c3d4db0000 req-5a7c3135-0a01-4594-a52f-007bbc2d3b4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60bfc41e-721c-45aa-a6fb-93f9213cf050", "name": "network-vif-deleted", "tag": "2a20087b-09a5-411d-bbb0-eb5a2ee789c2"}]} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:07:53.914592 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:07:53.914592 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: warnings.warn(msg) Dec 16 15:07:53.925838 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-b50b9c4b-2334-47b2-a293-42c3d4db0000 req-5a7c3135-0a01-4594-a52f-007bbc2d3b4e service nova] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:53.926464 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-b50b9c4b-2334-47b2-a293-42c3d4db0000 req-5a7c3135-0a01-4594-a52f-007bbc2d3b4e service nova] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:53.948418 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.compute.server_external_events [req-b50b9c4b-2334-47b2-a293-42c3d4db0000 req-5a7c3135-0a01-4594-a52f-007bbc2d3b4e service nova] Creating event network-vif-deleted:2a20087b-09a5-411d-bbb0-eb5a2ee789c2 for instance 60bfc41e-721c-45aa-a6fb-93f9213cf050 on hv-cinder-82189 Dec 16 15:07:53.955169 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [req-b50b9c4b-2334-47b2-a293-42c3d4db0000 req-5a7c3135-0a01-4594-a52f-007bbc2d3b4e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053530 Dec 16 15:07:53.955840 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 712/1428] 10.222.0.45 () {64 vars in 1308 bytes} [Thu Dec 16 15:07:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:07:54.861975 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-14708322-237f-49e9-ace7-4c3da7a04f34 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:07:54.862670 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-14708322-237f-49e9-ace7-4c3da7a04f34 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:07:54.870724 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-14708322-237f-49e9-ace7-4c3da7a04f34 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:54.871232 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-14708322-237f-49e9-ace7-4c3da7a04f34 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:54.872065 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-14708322-237f-49e9-ace7-4c3da7a04f34 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:54.872558 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-14708322-237f-49e9-ace7-4c3da7a04f34 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:55.007316 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-14708322-237f-49e9-ace7-4c3da7a04f34 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:07:55.016959 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-14708322-237f-49e9-ace7-4c3da7a04f34 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1219 microversion: 2.1 time: 0.163049 Dec 16 15:07:55.017552 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 717/1429] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:07:54 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1219 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:07:56.040881 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-5e2c8549-470a-4e09-99f7-b617c149c8ba tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:07:56.041659 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-5e2c8549-470a-4e09-99f7-b617c149c8ba tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:07:56.049843 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5e2c8549-470a-4e09-99f7-b617c149c8ba tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:56.050390 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5e2c8549-470a-4e09-99f7-b617c149c8ba tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:56.051306 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5e2c8549-470a-4e09-99f7-b617c149c8ba tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:56.051751 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5e2c8549-470a-4e09-99f7-b617c149c8ba tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:56.228551 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-5e2c8549-470a-4e09-99f7-b617c149c8ba tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:07:56.237404 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-5e2c8549-470a-4e09-99f7-b617c149c8ba tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1219 microversion: 2.1 time: 0.205814 Dec 16 15:07:56.238007 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 713/1430] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:07:56 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1219 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:07:57.259917 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-1fd63896-4471-4b59-92b2-56065804c324 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:07:57.260593 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-1fd63896-4471-4b59-92b2-56065804c324 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:07:57.269008 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1fd63896-4471-4b59-92b2-56065804c324 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:57.269510 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1fd63896-4471-4b59-92b2-56065804c324 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:57.270376 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1fd63896-4471-4b59-92b2-56065804c324 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:57.270867 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1fd63896-4471-4b59-92b2-56065804c324 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:57.405829 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-1fd63896-4471-4b59-92b2-56065804c324 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:07:57.416083 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-1fd63896-4471-4b59-92b2-56065804c324 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1219 microversion: 2.1 time: 0.164732 Dec 16 15:07:57.416696 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 718/1431] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:07:57 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1219 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:07:58.438030 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-e0692537-1f50-4a17-aa46-444f6d2a9d17 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:07:58.438804 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-e0692537-1f50-4a17-aa46-444f6d2a9d17 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:07:58.448078 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e0692537-1f50-4a17-aa46-444f6d2a9d17 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:58.448597 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e0692537-1f50-4a17-aa46-444f6d2a9d17 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:58.449939 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e0692537-1f50-4a17-aa46-444f6d2a9d17 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:58.449939 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e0692537-1f50-4a17-aa46-444f6d2a9d17 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:58.589681 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-e0692537-1f50-4a17-aa46-444f6d2a9d17 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:07:58.599274 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-e0692537-1f50-4a17-aa46-444f6d2a9d17 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1219 microversion: 2.1 time: 0.169267 Dec 16 15:07:58.599880 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 714/1432] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:07:58 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1219 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:07:59.620690 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-f19fbe8f-a5b9-43a3-9b0f-01af40b4b9a0 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:07:59.621477 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-f19fbe8f-a5b9-43a3-9b0f-01af40b4b9a0 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:07:59.630054 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f19fbe8f-a5b9-43a3-9b0f-01af40b4b9a0 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:59.630588 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f19fbe8f-a5b9-43a3-9b0f-01af40b4b9a0 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:59.631421 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f19fbe8f-a5b9-43a3-9b0f-01af40b4b9a0 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:07:59.631908 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f19fbe8f-a5b9-43a3-9b0f-01af40b4b9a0 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:07:59.763904 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-f19fbe8f-a5b9-43a3-9b0f-01af40b4b9a0 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:07:59.773103 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-f19fbe8f-a5b9-43a3-9b0f-01af40b4b9a0 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1219 microversion: 2.1 time: 0.160037 Dec 16 15:07:59.773715 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 719/1433] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:07:59 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1219 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:08:00.794886 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-d2f86a3c-4d9b-42c6-859c-0bdce24a9c03 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:08:00.795613 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-d2f86a3c-4d9b-42c6-859c-0bdce24a9c03 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:08:00.804060 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d2f86a3c-4d9b-42c6-859c-0bdce24a9c03 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:00.804596 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d2f86a3c-4d9b-42c6-859c-0bdce24a9c03 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:00.805420 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d2f86a3c-4d9b-42c6-859c-0bdce24a9c03 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:00.805918 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d2f86a3c-4d9b-42c6-859c-0bdce24a9c03 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:00.931721 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-d2f86a3c-4d9b-42c6-859c-0bdce24a9c03 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:08:00.940676 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-d2f86a3c-4d9b-42c6-859c-0bdce24a9c03 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1219 microversion: 2.1 time: 0.153606 Dec 16 15:08:00.941262 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 715/1434] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:08:00 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1219 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:08:01.962184 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-c06146f6-106c-43a7-b012-c29ca59798cd tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:08:01.962873 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-c06146f6-106c-43a7-b012-c29ca59798cd tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:08:01.970745 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c06146f6-106c-43a7-b012-c29ca59798cd tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:01.971257 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c06146f6-106c-43a7-b012-c29ca59798cd tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:01.972097 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c06146f6-106c-43a7-b012-c29ca59798cd tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:01.972600 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c06146f6-106c-43a7-b012-c29ca59798cd tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:02.100756 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-c06146f6-106c-43a7-b012-c29ca59798cd tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:08:02.110516 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-c06146f6-106c-43a7-b012-c29ca59798cd tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1219 microversion: 2.1 time: 0.155004 Dec 16 15:08:02.110686 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 720/1435] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:08:01 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1219 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:08:03.131814 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-8a1163df-2337-40ab-899a-5a7fa994686d tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:08:03.132542 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-8a1163df-2337-40ab-899a-5a7fa994686d tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:08:03.140440 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8a1163df-2337-40ab-899a-5a7fa994686d tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:03.140953 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8a1163df-2337-40ab-899a-5a7fa994686d tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:03.141798 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8a1163df-2337-40ab-899a-5a7fa994686d tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:03.142328 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8a1163df-2337-40ab-899a-5a7fa994686d tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:03.273641 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-8a1163df-2337-40ab-899a-5a7fa994686d tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:08:03.283099 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-8a1163df-2337-40ab-899a-5a7fa994686d tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1219 microversion: 2.1 time: 0.159121 Dec 16 15:08:03.283693 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 716/1436] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:08:03 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1219 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:08:04.304199 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-c39588af-86ea-4b53-85d4-93ccc19eba2e tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:08:04.304908 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-c39588af-86ea-4b53-85d4-93ccc19eba2e tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:08:04.312653 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c39588af-86ea-4b53-85d4-93ccc19eba2e tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:04.313133 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c39588af-86ea-4b53-85d4-93ccc19eba2e tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:04.313960 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c39588af-86ea-4b53-85d4-93ccc19eba2e tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:04.314473 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c39588af-86ea-4b53-85d4-93ccc19eba2e tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:04.444491 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-c39588af-86ea-4b53-85d4-93ccc19eba2e tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:08:04.455758 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-c39588af-86ea-4b53-85d4-93ccc19eba2e tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1219 microversion: 2.1 time: 0.159157 Dec 16 15:08:04.456398 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 721/1437] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:08:04 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1219 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:08:05.476976 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-ff00d2d5-52f6-42a7-a922-8f2719231821 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:08:05.477721 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-ff00d2d5-52f6-42a7-a922-8f2719231821 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:08:05.486016 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ff00d2d5-52f6-42a7-a922-8f2719231821 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:05.486556 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ff00d2d5-52f6-42a7-a922-8f2719231821 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:05.487415 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ff00d2d5-52f6-42a7-a922-8f2719231821 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:05.487915 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ff00d2d5-52f6-42a7-a922-8f2719231821 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:05.618078 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-ff00d2d5-52f6-42a7-a922-8f2719231821 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:08:05.627180 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-ff00d2d5-52f6-42a7-a922-8f2719231821 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1219 microversion: 2.1 time: 0.158228 Dec 16 15:08:05.627777 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 717/1438] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:08:05 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1219 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:08:06.649106 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-b7ff2746-16f0-429d-b529-3978098433a3 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:08:06.649781 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-b7ff2746-16f0-429d-b529-3978098433a3 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:08:06.657638 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b7ff2746-16f0-429d-b529-3978098433a3 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:06.658176 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b7ff2746-16f0-429d-b529-3978098433a3 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:06.659025 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b7ff2746-16f0-429d-b529-3978098433a3 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:06.659520 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b7ff2746-16f0-429d-b529-3978098433a3 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:06.797601 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-b7ff2746-16f0-429d-b529-3978098433a3 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:08:06.806666 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-b7ff2746-16f0-429d-b529-3978098433a3 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1219 microversion: 2.1 time: 0.165758 Dec 16 15:08:06.807261 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 722/1439] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:08:06 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1219 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:08:07.829489 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-6cbea29b-5243-4ca7-8c4c-1db6b2ddfe9c tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:08:07.830193 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-6cbea29b-5243-4ca7-8c4c-1db6b2ddfe9c tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:08:07.838562 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6cbea29b-5243-4ca7-8c4c-1db6b2ddfe9c tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:07.839077 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6cbea29b-5243-4ca7-8c4c-1db6b2ddfe9c tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:07.839951 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6cbea29b-5243-4ca7-8c4c-1db6b2ddfe9c tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:07.840426 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6cbea29b-5243-4ca7-8c4c-1db6b2ddfe9c tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:07.968708 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-6cbea29b-5243-4ca7-8c4c-1db6b2ddfe9c tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:08:07.978271 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-6cbea29b-5243-4ca7-8c4c-1db6b2ddfe9c tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1219 microversion: 2.1 time: 0.156980 Dec 16 15:08:07.978866 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 718/1440] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:08:07 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1219 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:08:08.999883 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-818fab97-1420-4e98-b4d9-8654aab2e46f tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:08:09.000563 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-818fab97-1420-4e98-b4d9-8654aab2e46f tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:08:09.008330 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-818fab97-1420-4e98-b4d9-8654aab2e46f tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:09.008841 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-818fab97-1420-4e98-b4d9-8654aab2e46f tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:09.009680 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-818fab97-1420-4e98-b4d9-8654aab2e46f tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:09.010207 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-818fab97-1420-4e98-b4d9-8654aab2e46f tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:09.140213 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-818fab97-1420-4e98-b4d9-8654aab2e46f tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:08:09.148993 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-818fab97-1420-4e98-b4d9-8654aab2e46f tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1219 microversion: 2.1 time: 0.156620 Dec 16 15:08:09.149585 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 723/1441] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:08:08 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1219 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:08:10.171005 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-e80a4b85-c2fb-46f9-80a2-a2476d46f400 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:08:10.171691 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-e80a4b85-c2fb-46f9-80a2-a2476d46f400 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:08:10.179673 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e80a4b85-c2fb-46f9-80a2-a2476d46f400 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:10.180189 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e80a4b85-c2fb-46f9-80a2-a2476d46f400 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:10.181046 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e80a4b85-c2fb-46f9-80a2-a2476d46f400 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:10.181544 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e80a4b85-c2fb-46f9-80a2-a2476d46f400 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:10.186586 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-0f31daae-629e-4450-8c54-c2b0643e14e9 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:08:10.187737 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-0f31daae-629e-4450-8c54-c2b0643e14e9 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:08:10.195814 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0f31daae-629e-4450-8c54-c2b0643e14e9 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:10.196323 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0f31daae-629e-4450-8c54-c2b0643e14e9 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:10.197169 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0f31daae-629e-4450-8c54-c2b0643e14e9 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:10.197664 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0f31daae-629e-4450-8c54-c2b0643e14e9 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:10.270307 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-0f31daae-629e-4450-8c54-c2b0643e14e9 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091170 Dec 16 15:08:10.270861 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 724/1442] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:08:10 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:08:10.311060 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-e80a4b85-c2fb-46f9-80a2-a2476d46f400 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:08:10.320091 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-e80a4b85-c2fb-46f9-80a2-a2476d46f400 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1219 microversion: 2.1 time: 0.156954 Dec 16 15:08:10.320677 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 719/1443] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:08:10 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1219 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:08:11.287221 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-f7c27e4e-beab-4014-a23f-f58112767982 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:08:11.288280 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-f7c27e4e-beab-4014-a23f-f58112767982 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:08:11.296162 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f7c27e4e-beab-4014-a23f-f58112767982 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:11.296682 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f7c27e4e-beab-4014-a23f-f58112767982 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:11.298184 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f7c27e4e-beab-4014-a23f-f58112767982 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:11.298690 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f7c27e4e-beab-4014-a23f-f58112767982 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:11.342787 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-a22da1a9-89f2-4948-89c1-9fdc33100a17 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:08:11.343853 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-a22da1a9-89f2-4948-89c1-9fdc33100a17 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:08:11.351896 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a22da1a9-89f2-4948-89c1-9fdc33100a17 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:11.352403 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a22da1a9-89f2-4948-89c1-9fdc33100a17 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:11.353407 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a22da1a9-89f2-4948-89c1-9fdc33100a17 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:11.353896 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a22da1a9-89f2-4948-89c1-9fdc33100a17 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:11.370309 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-f7c27e4e-beab-4014-a23f-f58112767982 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091454 Dec 16 15:08:11.371137 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 725/1444] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:08:11 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:08:11.484251 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-a22da1a9-89f2-4948-89c1-9fdc33100a17 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:08:11.500078 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-a22da1a9-89f2-4948-89c1-9fdc33100a17 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1219 microversion: 2.1 time: 0.158834 Dec 16 15:08:11.500078 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 720/1445] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:08:11 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1219 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:08:12.386822 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-7b433516-1d4d-4662-9af2-ea1eb932ae7b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:08:12.387806 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-7b433516-1d4d-4662-9af2-ea1eb932ae7b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:08:12.395660 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7b433516-1d4d-4662-9af2-ea1eb932ae7b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:12.396169 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7b433516-1d4d-4662-9af2-ea1eb932ae7b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:12.397008 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7b433516-1d4d-4662-9af2-ea1eb932ae7b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:12.397501 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7b433516-1d4d-4662-9af2-ea1eb932ae7b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:12.470742 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-7b433516-1d4d-4662-9af2-ea1eb932ae7b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091767 Dec 16 15:08:12.471355 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 726/1446] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:08:12 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:08:12.519688 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-66dcebeb-afa4-4d37-952b-36e2cd8c62da tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:08:12.520398 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-66dcebeb-afa4-4d37-952b-36e2cd8c62da tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:08:12.528324 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-66dcebeb-afa4-4d37-952b-36e2cd8c62da tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:12.528833 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-66dcebeb-afa4-4d37-952b-36e2cd8c62da tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:12.530015 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-66dcebeb-afa4-4d37-952b-36e2cd8c62da tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:12.530979 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-66dcebeb-afa4-4d37-952b-36e2cd8c62da tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:12.671894 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-66dcebeb-afa4-4d37-952b-36e2cd8c62da tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:08:12.681246 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-66dcebeb-afa4-4d37-952b-36e2cd8c62da tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1219 microversion: 2.1 time: 0.169462 Dec 16 15:08:12.681829 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 721/1447] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:08:12 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1219 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:08:13.486781 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-2c7ef7e4-f269-4f02-9091-2db9fa6b5557 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:08:13.487765 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-2c7ef7e4-f269-4f02-9091-2db9fa6b5557 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:08:13.495671 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2c7ef7e4-f269-4f02-9091-2db9fa6b5557 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:13.496174 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2c7ef7e4-f269-4f02-9091-2db9fa6b5557 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:13.497009 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2c7ef7e4-f269-4f02-9091-2db9fa6b5557 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:13.497500 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2c7ef7e4-f269-4f02-9091-2db9fa6b5557 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:13.568731 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-2c7ef7e4-f269-4f02-9091-2db9fa6b5557 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089725 Dec 16 15:08:13.569336 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 727/1448] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:08:13 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:08:13.704062 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-8b438f3e-a84b-4314-8bad-d9f12c25f296 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:08:13.704739 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-8b438f3e-a84b-4314-8bad-d9f12c25f296 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:08:13.712726 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8b438f3e-a84b-4314-8bad-d9f12c25f296 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:13.713240 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8b438f3e-a84b-4314-8bad-d9f12c25f296 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:13.714116 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8b438f3e-a84b-4314-8bad-d9f12c25f296 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:13.714619 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8b438f3e-a84b-4314-8bad-d9f12c25f296 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:13.842236 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-8b438f3e-a84b-4314-8bad-d9f12c25f296 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:08:13.850914 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-8b438f3e-a84b-4314-8bad-d9f12c25f296 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1219 microversion: 2.1 time: 0.155407 Dec 16 15:08:13.851495 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 722/1449] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:08:13 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1219 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:08:14.585626 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-fec23582-758a-4358-bc03-3015a29d92a6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:08:14.586701 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-fec23582-758a-4358-bc03-3015a29d92a6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:08:14.595240 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fec23582-758a-4358-bc03-3015a29d92a6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:14.595745 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fec23582-758a-4358-bc03-3015a29d92a6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:14.596694 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fec23582-758a-4358-bc03-3015a29d92a6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:14.597188 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fec23582-758a-4358-bc03-3015a29d92a6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:14.669692 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-fec23582-758a-4358-bc03-3015a29d92a6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092561 Dec 16 15:08:14.670263 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 728/1450] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:08:14 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:08:14.873119 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-ee7fe305-54b7-4130-8cb2-baf37eb973df tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:08:14.873791 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-ee7fe305-54b7-4130-8cb2-baf37eb973df tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:08:14.882364 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ee7fe305-54b7-4130-8cb2-baf37eb973df tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:14.882875 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ee7fe305-54b7-4130-8cb2-baf37eb973df tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:14.883722 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ee7fe305-54b7-4130-8cb2-baf37eb973df tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:14.884214 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ee7fe305-54b7-4130-8cb2-baf37eb973df tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:15.018322 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-ee7fe305-54b7-4130-8cb2-baf37eb973df tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:08:15.028691 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-ee7fe305-54b7-4130-8cb2-baf37eb973df tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1219 microversion: 2.1 time: 0.163259 Dec 16 15:08:15.029307 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 723/1451] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:08:14 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1219 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:08:15.685306 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-dee168ce-1aa5-40b4-84a1-5917df0e7c15 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:08:15.686388 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-dee168ce-1aa5-40b4-84a1-5917df0e7c15 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:08:15.694797 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-dee168ce-1aa5-40b4-84a1-5917df0e7c15 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:15.695307 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-dee168ce-1aa5-40b4-84a1-5917df0e7c15 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:15.696163 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-dee168ce-1aa5-40b4-84a1-5917df0e7c15 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:15.696660 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-dee168ce-1aa5-40b4-84a1-5917df0e7c15 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:15.772170 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-dee168ce-1aa5-40b4-84a1-5917df0e7c15 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094863 Dec 16 15:08:15.772813 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 729/1452] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:08:15 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:08:16.051583 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-d2da8813-cdc8-4426-8522-37dc2be7d48f tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:08:16.052167 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-d2da8813-cdc8-4426-8522-37dc2be7d48f tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:08:16.060577 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d2da8813-cdc8-4426-8522-37dc2be7d48f tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:16.061083 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d2da8813-cdc8-4426-8522-37dc2be7d48f tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:16.061938 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d2da8813-cdc8-4426-8522-37dc2be7d48f tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:16.062464 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d2da8813-cdc8-4426-8522-37dc2be7d48f tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:16.193244 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-d2da8813-cdc8-4426-8522-37dc2be7d48f tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:08:16.202477 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-d2da8813-cdc8-4426-8522-37dc2be7d48f tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1219 microversion: 2.1 time: 0.158541 Dec 16 15:08:16.203074 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 724/1453] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:08:16 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1219 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:08:16.787454 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-0760d595-5319-499d-b360-41d0816773af tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:08:16.788503 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-0760d595-5319-499d-b360-41d0816773af tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:08:16.796461 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0760d595-5319-499d-b360-41d0816773af tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:16.797460 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0760d595-5319-499d-b360-41d0816773af tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:16.798352 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0760d595-5319-499d-b360-41d0816773af tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:16.798839 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0760d595-5319-499d-b360-41d0816773af tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:16.873877 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-0760d595-5319-499d-b360-41d0816773af tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094248 Dec 16 15:08:16.874539 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 730/1454] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:08:16 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:08:17.225553 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-982f6029-9e48-4651-8062-87ee7cae0982 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:08:17.226304 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-982f6029-9e48-4651-8062-87ee7cae0982 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:08:17.234086 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-982f6029-9e48-4651-8062-87ee7cae0982 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:17.235167 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-982f6029-9e48-4651-8062-87ee7cae0982 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:17.236060 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-982f6029-9e48-4651-8062-87ee7cae0982 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:17.236544 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-982f6029-9e48-4651-8062-87ee7cae0982 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:17.369199 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-982f6029-9e48-4651-8062-87ee7cae0982 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:08:17.378370 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-982f6029-9e48-4651-8062-87ee7cae0982 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1219 microversion: 2.1 time: 0.161062 Dec 16 15:08:17.379353 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 725/1455] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:08:17 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1219 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:08:17.891225 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-42a751c0-8fcf-4025-bdd3-b24e653c28c7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:08:17.892279 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-42a751c0-8fcf-4025-bdd3-b24e653c28c7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:08:17.900155 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-42a751c0-8fcf-4025-bdd3-b24e653c28c7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:17.900677 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-42a751c0-8fcf-4025-bdd3-b24e653c28c7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:17.901514 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-42a751c0-8fcf-4025-bdd3-b24e653c28c7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:17.902016 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-42a751c0-8fcf-4025-bdd3-b24e653c28c7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:17.973724 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-42a751c0-8fcf-4025-bdd3-b24e653c28c7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090751 Dec 16 15:08:17.975255 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 731/1456] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:08:17 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:08:18.399083 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-cf55ee89-2ca4-4d0e-8fb1-a0313cffe919 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:08:18.399755 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-cf55ee89-2ca4-4d0e-8fb1-a0313cffe919 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:08:18.407640 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cf55ee89-2ca4-4d0e-8fb1-a0313cffe919 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:18.408153 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cf55ee89-2ca4-4d0e-8fb1-a0313cffe919 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:18.408993 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cf55ee89-2ca4-4d0e-8fb1-a0313cffe919 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:18.409482 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cf55ee89-2ca4-4d0e-8fb1-a0313cffe919 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:18.538683 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-cf55ee89-2ca4-4d0e-8fb1-a0313cffe919 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:08:18.548018 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-cf55ee89-2ca4-4d0e-8fb1-a0313cffe919 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1219 microversion: 2.1 time: 0.156678 Dec 16 15:08:18.548610 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 726/1457] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:08:18 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1219 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:08:18.990760 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-8bebfd31-857c-4511-a26b-ef0bd6367c84 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:08:18.991823 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-8bebfd31-857c-4511-a26b-ef0bd6367c84 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:08:18.999894 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8bebfd31-857c-4511-a26b-ef0bd6367c84 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:19.000403 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8bebfd31-857c-4511-a26b-ef0bd6367c84 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:19.001257 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8bebfd31-857c-4511-a26b-ef0bd6367c84 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:19.001753 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8bebfd31-857c-4511-a26b-ef0bd6367c84 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:19.073923 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-8bebfd31-857c-4511-a26b-ef0bd6367c84 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091699 Dec 16 15:08:19.074596 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 732/1458] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:08:18 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:08:19.569163 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-6936bd4c-1ccb-4e2c-b932-7c632fe4e7ee tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:08:19.569834 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-6936bd4c-1ccb-4e2c-b932-7c632fe4e7ee tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:08:19.577648 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6936bd4c-1ccb-4e2c-b932-7c632fe4e7ee tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:19.578212 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6936bd4c-1ccb-4e2c-b932-7c632fe4e7ee tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:19.579053 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6936bd4c-1ccb-4e2c-b932-7c632fe4e7ee tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:19.579544 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6936bd4c-1ccb-4e2c-b932-7c632fe4e7ee tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:19.706571 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-6936bd4c-1ccb-4e2c-b932-7c632fe4e7ee tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:08:19.715727 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-6936bd4c-1ccb-4e2c-b932-7c632fe4e7ee tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1219 microversion: 2.1 time: 0.154519 Dec 16 15:08:19.716342 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 727/1459] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:08:19 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1219 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:08:20.090300 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-82b066c8-2779-4372-ad72-a44cf0e08403 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:08:20.091387 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-82b066c8-2779-4372-ad72-a44cf0e08403 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:08:20.099780 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-82b066c8-2779-4372-ad72-a44cf0e08403 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:20.100285 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-82b066c8-2779-4372-ad72-a44cf0e08403 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:20.101118 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-82b066c8-2779-4372-ad72-a44cf0e08403 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:20.101610 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-82b066c8-2779-4372-ad72-a44cf0e08403 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:20.171262 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-82b066c8-2779-4372-ad72-a44cf0e08403 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088927 Dec 16 15:08:20.171877 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 733/1460] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:08:20 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:08:20.737354 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-e3995e9b-6e36-4988-adee-a0e55a8a01ba tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:08:20.738147 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-e3995e9b-6e36-4988-adee-a0e55a8a01ba tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:08:20.745862 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e3995e9b-6e36-4988-adee-a0e55a8a01ba tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:20.746412 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e3995e9b-6e36-4988-adee-a0e55a8a01ba tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:20.747266 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e3995e9b-6e36-4988-adee-a0e55a8a01ba tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:20.747762 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e3995e9b-6e36-4988-adee-a0e55a8a01ba tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:20.879043 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-e3995e9b-6e36-4988-adee-a0e55a8a01ba tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:08:20.886263 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-e3995e9b-6e36-4988-adee-a0e55a8a01ba tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1219 microversion: 2.1 time: 0.157292 Dec 16 15:08:20.886845 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 728/1461] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:08:20 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1219 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:08:21.187502 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-3907080e-c43d-4344-9452-964e2ec6cc5e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:08:21.188546 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-3907080e-c43d-4344-9452-964e2ec6cc5e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:08:21.196691 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3907080e-c43d-4344-9452-964e2ec6cc5e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:21.197203 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3907080e-c43d-4344-9452-964e2ec6cc5e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:21.198084 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3907080e-c43d-4344-9452-964e2ec6cc5e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:21.198556 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3907080e-c43d-4344-9452-964e2ec6cc5e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:21.285471 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-3907080e-c43d-4344-9452-964e2ec6cc5e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.105961 Dec 16 15:08:21.286087 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 734/1462] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:08:21 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:08:21.910647 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-b2cc6790-6639-413b-ab21-c574364005dc tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:08:21.911316 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-b2cc6790-6639-413b-ab21-c574364005dc tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:08:21.920187 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b2cc6790-6639-413b-ab21-c574364005dc tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:21.920696 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b2cc6790-6639-413b-ab21-c574364005dc tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:21.921549 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b2cc6790-6639-413b-ab21-c574364005dc tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:21.922059 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b2cc6790-6639-413b-ab21-c574364005dc tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:22.061312 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-b2cc6790-6639-413b-ab21-c574364005dc tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:08:22.071578 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-b2cc6790-6639-413b-ab21-c574364005dc tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1219 microversion: 2.1 time: 0.171412 Dec 16 15:08:22.072190 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 729/1463] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:08:21 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1219 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:08:22.301399 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-fba33199-fb2c-4299-8099-d0e2fdf011e9 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:08:22.302486 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-fba33199-fb2c-4299-8099-d0e2fdf011e9 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:08:22.310467 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fba33199-fb2c-4299-8099-d0e2fdf011e9 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:22.310973 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fba33199-fb2c-4299-8099-d0e2fdf011e9 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:22.311819 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fba33199-fb2c-4299-8099-d0e2fdf011e9 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:22.312923 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fba33199-fb2c-4299-8099-d0e2fdf011e9 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:22.386496 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-fba33199-fb2c-4299-8099-d0e2fdf011e9 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093242 Dec 16 15:08:22.387142 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 735/1464] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:08:22 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:08:23.094911 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-8137d6ad-ed43-4397-9b9b-938e3cd28625 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:08:23.095582 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-8137d6ad-ed43-4397-9b9b-938e3cd28625 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:08:23.103420 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8137d6ad-ed43-4397-9b9b-938e3cd28625 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:23.103922 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8137d6ad-ed43-4397-9b9b-938e3cd28625 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:23.104765 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8137d6ad-ed43-4397-9b9b-938e3cd28625 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:23.105253 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8137d6ad-ed43-4397-9b9b-938e3cd28625 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:23.231755 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-8137d6ad-ed43-4397-9b9b-938e3cd28625 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:08:23.240744 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-8137d6ad-ed43-4397-9b9b-938e3cd28625 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1219 microversion: 2.1 time: 0.154004 Dec 16 15:08:23.241252 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 730/1465] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:08:23 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1219 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:08:23.402920 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-9730db01-0075-406b-990b-d7c885f98f38 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:08:23.404009 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-9730db01-0075-406b-990b-d7c885f98f38 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:08:23.412088 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9730db01-0075-406b-990b-d7c885f98f38 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:23.412595 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9730db01-0075-406b-990b-d7c885f98f38 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:23.413443 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9730db01-0075-406b-990b-d7c885f98f38 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:23.413935 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9730db01-0075-406b-990b-d7c885f98f38 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:23.486836 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-9730db01-0075-406b-990b-d7c885f98f38 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091846 Dec 16 15:08:23.487463 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 736/1466] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:08:23 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:08:24.262939 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-7a681ffc-a35e-4cd9-beba-69f3786c0ebd tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:08:24.263708 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-7a681ffc-a35e-4cd9-beba-69f3786c0ebd tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:08:24.273369 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7a681ffc-a35e-4cd9-beba-69f3786c0ebd tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:24.273884 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7a681ffc-a35e-4cd9-beba-69f3786c0ebd tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:24.274779 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7a681ffc-a35e-4cd9-beba-69f3786c0ebd tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:24.275278 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7a681ffc-a35e-4cd9-beba-69f3786c0ebd tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:24.415981 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-7a681ffc-a35e-4cd9-beba-69f3786c0ebd tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:08:24.425488 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-7a681ffc-a35e-4cd9-beba-69f3786c0ebd tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1219 microversion: 2.1 time: 0.170264 Dec 16 15:08:24.426201 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 731/1467] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:08:24 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1219 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:08:24.503995 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-6c6239e4-88dc-4c41-9146-33830202408c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:08:24.505048 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-6c6239e4-88dc-4c41-9146-33830202408c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:08:24.513086 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6c6239e4-88dc-4c41-9146-33830202408c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:24.513597 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6c6239e4-88dc-4c41-9146-33830202408c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:24.514511 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6c6239e4-88dc-4c41-9146-33830202408c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:24.515015 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6c6239e4-88dc-4c41-9146-33830202408c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:24.587924 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-6c6239e4-88dc-4c41-9146-33830202408c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092540 Dec 16 15:08:24.588558 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 737/1468] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:08:24 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:08:25.447934 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-cd7c46da-7bc8-41c5-9239-6eb35bbba683 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:08:25.448544 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-cd7c46da-7bc8-41c5-9239-6eb35bbba683 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:08:25.456934 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cd7c46da-7bc8-41c5-9239-6eb35bbba683 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:25.457443 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cd7c46da-7bc8-41c5-9239-6eb35bbba683 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:25.458306 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cd7c46da-7bc8-41c5-9239-6eb35bbba683 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:25.458797 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cd7c46da-7bc8-41c5-9239-6eb35bbba683 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:25.587122 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-cd7c46da-7bc8-41c5-9239-6eb35bbba683 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:08:25.595969 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-cd7c46da-7bc8-41c5-9239-6eb35bbba683 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1219 microversion: 2.1 time: 0.155975 Dec 16 15:08:25.596551 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 732/1469] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:08:25 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1219 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:08:25.604766 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-2cd7605e-a452-4cce-9655-4a34ff9d937c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:08:25.605814 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-2cd7605e-a452-4cce-9655-4a34ff9d937c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:08:25.613538 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2cd7605e-a452-4cce-9655-4a34ff9d937c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:25.614076 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2cd7605e-a452-4cce-9655-4a34ff9d937c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:25.614915 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2cd7605e-a452-4cce-9655-4a34ff9d937c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:25.615408 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2cd7605e-a452-4cce-9655-4a34ff9d937c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:25.690141 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-2cd7605e-a452-4cce-9655-4a34ff9d937c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093081 Dec 16 15:08:25.690751 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 738/1470] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:08:25 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 15:08:26.617696 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-cb77f439-803e-4364-8b77-4c1db90a01ec tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:08:26.618388 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-cb77f439-803e-4364-8b77-4c1db90a01ec tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:08:26.626385 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cb77f439-803e-4364-8b77-4c1db90a01ec tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:26.626897 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cb77f439-803e-4364-8b77-4c1db90a01ec tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:26.627749 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cb77f439-803e-4364-8b77-4c1db90a01ec tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:26.628247 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cb77f439-803e-4364-8b77-4c1db90a01ec tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:26.706941 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-0d515284-79c9-4e0f-ac35-8172596b760a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:08:26.708130 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-0d515284-79c9-4e0f-ac35-8172596b760a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:08:26.716286 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0d515284-79c9-4e0f-ac35-8172596b760a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:26.716805 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0d515284-79c9-4e0f-ac35-8172596b760a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:26.717665 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0d515284-79c9-4e0f-ac35-8172596b760a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:26.718185 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0d515284-79c9-4e0f-ac35-8172596b760a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:26.795619 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-0d515284-79c9-4e0f-ac35-8172596b760a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096949 Dec 16 15:08:26.796282 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 739/1471] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:08:26 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:08:26.938496 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-cb77f439-803e-4364-8b77-4c1db90a01ec tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:08:26.947890 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-cb77f439-803e-4364-8b77-4c1db90a01ec tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1219 microversion: 2.1 time: 0.338014 Dec 16 15:08:26.948502 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 733/1472] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:08:26 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1219 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:08:27.812114 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-9ec588bb-24be-4d48-ac7e-1d22a3c40bbc tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:08:27.813152 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-9ec588bb-24be-4d48-ac7e-1d22a3c40bbc tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:08:27.821345 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9ec588bb-24be-4d48-ac7e-1d22a3c40bbc tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:27.821850 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9ec588bb-24be-4d48-ac7e-1d22a3c40bbc tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:27.822717 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9ec588bb-24be-4d48-ac7e-1d22a3c40bbc tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:27.823205 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9ec588bb-24be-4d48-ac7e-1d22a3c40bbc tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:27.899437 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-9ec588bb-24be-4d48-ac7e-1d22a3c40bbc tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095261 Dec 16 15:08:27.900075 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 740/1473] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:08:27 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:08:27.970254 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-606d4525-726c-4ee6-b1d3-d26df2fb1c95 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:08:27.970932 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-606d4525-726c-4ee6-b1d3-d26df2fb1c95 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:08:27.978852 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-606d4525-726c-4ee6-b1d3-d26df2fb1c95 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:27.979372 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-606d4525-726c-4ee6-b1d3-d26df2fb1c95 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:27.980232 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-606d4525-726c-4ee6-b1d3-d26df2fb1c95 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:27.980728 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-606d4525-726c-4ee6-b1d3-d26df2fb1c95 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:28.112875 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-606d4525-726c-4ee6-b1d3-d26df2fb1c95 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:08:28.123450 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-606d4525-726c-4ee6-b1d3-d26df2fb1c95 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1219 microversion: 2.1 time: 0.161577 Dec 16 15:08:28.124143 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 734/1474] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:08:27 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1219 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:08:28.915810 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-433e4dea-3397-4f0e-9e88-d6296caf1c32 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:08:28.916855 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-433e4dea-3397-4f0e-9e88-d6296caf1c32 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:08:28.925409 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-433e4dea-3397-4f0e-9e88-d6296caf1c32 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:28.925934 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-433e4dea-3397-4f0e-9e88-d6296caf1c32 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:28.926867 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-433e4dea-3397-4f0e-9e88-d6296caf1c32 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:28.927800 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-433e4dea-3397-4f0e-9e88-d6296caf1c32 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:28.999349 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-433e4dea-3397-4f0e-9e88-d6296caf1c32 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091411 Dec 16 15:08:29.000590 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 741/1475] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:08:28 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:08:29.146049 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-5785202a-79e4-4390-a890-860f7654cb9a tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:08:29.147186 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-5785202a-79e4-4390-a890-860f7654cb9a tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:08:29.155150 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5785202a-79e4-4390-a890-860f7654cb9a tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:29.155668 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5785202a-79e4-4390-a890-860f7654cb9a tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:29.157043 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5785202a-79e4-4390-a890-860f7654cb9a tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:29.157546 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5785202a-79e4-4390-a890-860f7654cb9a tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:29.287504 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-5785202a-79e4-4390-a890-860f7654cb9a tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:08:29.296420 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-5785202a-79e4-4390-a890-860f7654cb9a tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1219 microversion: 2.1 time: 0.158866 Dec 16 15:08:29.297611 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 735/1476] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:08:29 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1219 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:08:30.016006 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-f7d29cbd-6933-4ef7-95b0-4dc38534b4e3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:08:30.017086 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-f7d29cbd-6933-4ef7-95b0-4dc38534b4e3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:08:30.025330 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f7d29cbd-6933-4ef7-95b0-4dc38534b4e3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:30.025923 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f7d29cbd-6933-4ef7-95b0-4dc38534b4e3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:30.026845 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f7d29cbd-6933-4ef7-95b0-4dc38534b4e3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:30.027323 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f7d29cbd-6933-4ef7-95b0-4dc38534b4e3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:30.107382 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-f7d29cbd-6933-4ef7-95b0-4dc38534b4e3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.099390 Dec 16 15:08:30.108037 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 742/1477] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:08:30 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:08:30.318824 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-d705c480-c7bc-4022-8ff0-5c4c27b7a260 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:08:30.319495 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-d705c480-c7bc-4022-8ff0-5c4c27b7a260 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:08:30.327403 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d705c480-c7bc-4022-8ff0-5c4c27b7a260 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:30.328408 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d705c480-c7bc-4022-8ff0-5c4c27b7a260 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:30.329249 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d705c480-c7bc-4022-8ff0-5c4c27b7a260 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:30.329748 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d705c480-c7bc-4022-8ff0-5c4c27b7a260 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:30.458009 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-d705c480-c7bc-4022-8ff0-5c4c27b7a260 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:08:30.466962 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-d705c480-c7bc-4022-8ff0-5c4c27b7a260 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1219 microversion: 2.1 time: 0.156047 Dec 16 15:08:30.467553 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 736/1478] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:08:30 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1219 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:08:31.123739 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-598b78c7-0fdd-48b2-98d5-93329314b691 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:08:31.125429 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-598b78c7-0fdd-48b2-98d5-93329314b691 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:08:31.134078 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-598b78c7-0fdd-48b2-98d5-93329314b691 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:31.134590 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-598b78c7-0fdd-48b2-98d5-93329314b691 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:31.135434 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-598b78c7-0fdd-48b2-98d5-93329314b691 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:31.136034 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-598b78c7-0fdd-48b2-98d5-93329314b691 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:31.209240 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-598b78c7-0fdd-48b2-98d5-93329314b691 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093344 Dec 16 15:08:31.209880 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 743/1479] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:08:31 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:08:31.490282 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-e29d2739-641a-47a1-b5b7-63ebce8eb428 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:08:31.490965 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-e29d2739-641a-47a1-b5b7-63ebce8eb428 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:08:31.499380 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e29d2739-641a-47a1-b5b7-63ebce8eb428 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:31.499994 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e29d2739-641a-47a1-b5b7-63ebce8eb428 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:31.500853 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e29d2739-641a-47a1-b5b7-63ebce8eb428 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:31.501350 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e29d2739-641a-47a1-b5b7-63ebce8eb428 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:31.636411 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-e29d2739-641a-47a1-b5b7-63ebce8eb428 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:08:31.645684 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-e29d2739-641a-47a1-b5b7-63ebce8eb428 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1219 microversion: 2.1 time: 0.164084 Dec 16 15:08:31.646245 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 737/1480] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:08:31 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1219 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:08:32.225594 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-d875fb96-0146-4115-826a-018e67ba68c0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:08:32.226623 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-d875fb96-0146-4115-826a-018e67ba68c0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:08:32.234580 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d875fb96-0146-4115-826a-018e67ba68c0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:32.235090 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d875fb96-0146-4115-826a-018e67ba68c0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:32.235989 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d875fb96-0146-4115-826a-018e67ba68c0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:32.236488 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d875fb96-0146-4115-826a-018e67ba68c0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:32.314904 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-d875fb96-0146-4115-826a-018e67ba68c0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097285 Dec 16 15:08:32.315544 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 744/1481] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:08:32 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:08:32.667484 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-75906c5a-2649-4753-a29e-cb8f831dfaa3 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:08:32.668228 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-75906c5a-2649-4753-a29e-cb8f831dfaa3 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:08:32.676701 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-75906c5a-2649-4753-a29e-cb8f831dfaa3 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:32.677208 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-75906c5a-2649-4753-a29e-cb8f831dfaa3 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:32.678074 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-75906c5a-2649-4753-a29e-cb8f831dfaa3 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:32.678571 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-75906c5a-2649-4753-a29e-cb8f831dfaa3 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:32.807838 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-75906c5a-2649-4753-a29e-cb8f831dfaa3 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:08:32.818895 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-75906c5a-2649-4753-a29e-cb8f831dfaa3 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1219 microversion: 2.1 time: 0.157860 Dec 16 15:08:32.818895 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 738/1482] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:08:32 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1219 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:08:33.332041 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-cb63cf1b-8b7d-424b-867e-a76a541fe8a7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:08:33.333085 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-cb63cf1b-8b7d-424b-867e-a76a541fe8a7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:08:33.341041 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cb63cf1b-8b7d-424b-867e-a76a541fe8a7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:33.341548 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cb63cf1b-8b7d-424b-867e-a76a541fe8a7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:33.342422 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cb63cf1b-8b7d-424b-867e-a76a541fe8a7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:33.342919 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cb63cf1b-8b7d-424b-867e-a76a541fe8a7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:33.418073 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-cb63cf1b-8b7d-424b-867e-a76a541fe8a7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094439 Dec 16 15:08:33.418697 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 745/1483] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:08:33 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:08:33.841160 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-a9a1c9d5-fb2c-4a4d-9e6d-0a10a327ba8d tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:08:33.841842 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-a9a1c9d5-fb2c-4a4d-9e6d-0a10a327ba8d tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:08:33.850493 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a9a1c9d5-fb2c-4a4d-9e6d-0a10a327ba8d tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:33.851005 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a9a1c9d5-fb2c-4a4d-9e6d-0a10a327ba8d tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:33.851865 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a9a1c9d5-fb2c-4a4d-9e6d-0a10a327ba8d tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:33.852360 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a9a1c9d5-fb2c-4a4d-9e6d-0a10a327ba8d tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:33.981997 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-a9a1c9d5-fb2c-4a4d-9e6d-0a10a327ba8d tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:08:33.991498 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-a9a1c9d5-fb2c-4a4d-9e6d-0a10a327ba8d tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1219 microversion: 2.1 time: 0.158171 Dec 16 15:08:33.992077 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 739/1484] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:08:33 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1219 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:08:34.434837 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-f80e90a1-ab11-44c6-894f-c4f07ec44a29 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:08:34.435882 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-f80e90a1-ab11-44c6-894f-c4f07ec44a29 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:08:34.444565 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f80e90a1-ab11-44c6-894f-c4f07ec44a29 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:34.445072 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f80e90a1-ab11-44c6-894f-c4f07ec44a29 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:34.445910 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f80e90a1-ab11-44c6-894f-c4f07ec44a29 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:34.446439 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f80e90a1-ab11-44c6-894f-c4f07ec44a29 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:34.658839 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-f80e90a1-ab11-44c6-894f-c4f07ec44a29 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.231682 Dec 16 15:08:34.659380 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 746/1485] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:08:34 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:08:35.012619 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-8a3a5dda-918e-40b2-b576-fd4a89c91de5 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:08:35.013290 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-8a3a5dda-918e-40b2-b576-fd4a89c91de5 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:08:35.021136 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8a3a5dda-918e-40b2-b576-fd4a89c91de5 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:35.021839 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8a3a5dda-918e-40b2-b576-fd4a89c91de5 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:35.022722 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8a3a5dda-918e-40b2-b576-fd4a89c91de5 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:35.023219 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8a3a5dda-918e-40b2-b576-fd4a89c91de5 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:35.154912 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-8a3a5dda-918e-40b2-b576-fd4a89c91de5 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:08:35.164509 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-8a3a5dda-918e-40b2-b576-fd4a89c91de5 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1219 microversion: 2.1 time: 0.159552 Dec 16 15:08:35.167521 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 740/1486] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:08:35 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1219 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:08:35.675037 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-3d8cea2d-8b19-4d66-93f2-d3098e34ddea tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:08:35.676095 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-3d8cea2d-8b19-4d66-93f2-d3098e34ddea tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:08:35.684034 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3d8cea2d-8b19-4d66-93f2-d3098e34ddea tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:35.684542 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3d8cea2d-8b19-4d66-93f2-d3098e34ddea tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:35.685393 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3d8cea2d-8b19-4d66-93f2-d3098e34ddea tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:35.685883 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3d8cea2d-8b19-4d66-93f2-d3098e34ddea tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:35.756997 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-3d8cea2d-8b19-4d66-93f2-d3098e34ddea tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089738 Dec 16 15:08:35.757616 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 747/1487] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:08:35 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:08:36.187594 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-d397cb79-b999-40fd-bebe-39007d04fc8a tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:08:36.188782 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-d397cb79-b999-40fd-bebe-39007d04fc8a tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:08:36.197026 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d397cb79-b999-40fd-bebe-39007d04fc8a tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:36.197531 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d397cb79-b999-40fd-bebe-39007d04fc8a tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:36.198403 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d397cb79-b999-40fd-bebe-39007d04fc8a tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:36.198901 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d397cb79-b999-40fd-bebe-39007d04fc8a tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:36.335362 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-d397cb79-b999-40fd-bebe-39007d04fc8a tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:08:36.357049 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-d397cb79-b999-40fd-bebe-39007d04fc8a tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1219 microversion: 2.1 time: 0.177645 Dec 16 15:08:36.357971 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 741/1488] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:08:36 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1219 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:08:36.773516 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-0f824c67-0f35-41e7-aa18-da227db835f1 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:08:36.774601 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-0f824c67-0f35-41e7-aa18-da227db835f1 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:08:36.782484 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0f824c67-0f35-41e7-aa18-da227db835f1 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:36.782988 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0f824c67-0f35-41e7-aa18-da227db835f1 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:36.783812 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0f824c67-0f35-41e7-aa18-da227db835f1 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:36.784295 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0f824c67-0f35-41e7-aa18-da227db835f1 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:36.855624 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-0f824c67-0f35-41e7-aa18-da227db835f1 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090463 Dec 16 15:08:36.856215 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 748/1489] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:08:36 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:08:37.379435 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-a5d3b018-33a8-4bb2-85fb-da7fb55fd6ad tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:08:37.380164 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-a5d3b018-33a8-4bb2-85fb-da7fb55fd6ad tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:08:37.388400 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a5d3b018-33a8-4bb2-85fb-da7fb55fd6ad tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:37.388915 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a5d3b018-33a8-4bb2-85fb-da7fb55fd6ad tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:37.389771 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a5d3b018-33a8-4bb2-85fb-da7fb55fd6ad tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:37.390299 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a5d3b018-33a8-4bb2-85fb-da7fb55fd6ad tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:37.522287 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-a5d3b018-33a8-4bb2-85fb-da7fb55fd6ad tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:08:37.531025 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-a5d3b018-33a8-4bb2-85fb-da7fb55fd6ad tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1219 microversion: 2.1 time: 0.159793 Dec 16 15:08:37.531613 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 742/1490] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:08:37 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1219 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:08:37.871766 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-95012d04-7c54-4b07-9e84-b02e1d16c1aa tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:08:37.872799 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-95012d04-7c54-4b07-9e84-b02e1d16c1aa tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:08:37.880596 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-95012d04-7c54-4b07-9e84-b02e1d16c1aa tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:37.881095 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-95012d04-7c54-4b07-9e84-b02e1d16c1aa tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:37.881917 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-95012d04-7c54-4b07-9e84-b02e1d16c1aa tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:37.882425 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-95012d04-7c54-4b07-9e84-b02e1d16c1aa tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:37.959919 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-95012d04-7c54-4b07-9e84-b02e1d16c1aa tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095483 Dec 16 15:08:37.960986 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 749/1491] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:08:37 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:08:38.553045 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-c4b2eea4-49c1-4271-9eaf-10c8abc61a45 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:08:38.553857 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-c4b2eea4-49c1-4271-9eaf-10c8abc61a45 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:08:38.562249 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c4b2eea4-49c1-4271-9eaf-10c8abc61a45 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:38.562868 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c4b2eea4-49c1-4271-9eaf-10c8abc61a45 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:38.563740 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c4b2eea4-49c1-4271-9eaf-10c8abc61a45 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:38.564394 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c4b2eea4-49c1-4271-9eaf-10c8abc61a45 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:38.695736 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-c4b2eea4-49c1-4271-9eaf-10c8abc61a45 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:08:38.705268 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-c4b2eea4-49c1-4271-9eaf-10c8abc61a45 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1219 microversion: 2.1 time: 0.159894 Dec 16 15:08:38.705902 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 743/1492] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:08:38 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1219 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:08:38.978982 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-421c5fcb-3c48-48a9-ba40-280d97c69325 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:08:38.980026 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-421c5fcb-3c48-48a9-ba40-280d97c69325 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:08:38.988089 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-421c5fcb-3c48-48a9-ba40-280d97c69325 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:38.988590 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-421c5fcb-3c48-48a9-ba40-280d97c69325 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:38.989446 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-421c5fcb-3c48-48a9-ba40-280d97c69325 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:38.989933 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-421c5fcb-3c48-48a9-ba40-280d97c69325 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:39.074820 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-421c5fcb-3c48-48a9-ba40-280d97c69325 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.103551 Dec 16 15:08:39.075465 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 750/1493] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:08:38 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:08:39.728133 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-070cec56-5838-4d7a-84f4-c709839fd890 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:08:39.728844 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-070cec56-5838-4d7a-84f4-c709839fd890 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:08:39.737648 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-070cec56-5838-4d7a-84f4-c709839fd890 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:39.738180 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-070cec56-5838-4d7a-84f4-c709839fd890 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:39.739039 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-070cec56-5838-4d7a-84f4-c709839fd890 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:39.739524 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-070cec56-5838-4d7a-84f4-c709839fd890 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:39.997952 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-070cec56-5838-4d7a-84f4-c709839fd890 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:08:40.007448 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-070cec56-5838-4d7a-84f4-c709839fd890 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1219 microversion: 2.1 time: 0.288261 Dec 16 15:08:40.008041 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 744/1494] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:08:39 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1219 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:08:40.091127 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-d56efe38-e327-41ed-b91b-0fa31814e605 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:08:40.092219 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-d56efe38-e327-41ed-b91b-0fa31814e605 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:08:40.100011 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d56efe38-e327-41ed-b91b-0fa31814e605 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:40.100524 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d56efe38-e327-41ed-b91b-0fa31814e605 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:40.101360 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d56efe38-e327-41ed-b91b-0fa31814e605 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:40.101858 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d56efe38-e327-41ed-b91b-0fa31814e605 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:40.172746 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-d56efe38-e327-41ed-b91b-0fa31814e605 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089472 Dec 16 15:08:40.173893 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 751/1495] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:08:40 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:08:41.029436 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-02c0e793-2a83-45ce-80d8-14356b016444 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:08:41.030080 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-02c0e793-2a83-45ce-80d8-14356b016444 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:08:41.037950 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-02c0e793-2a83-45ce-80d8-14356b016444 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:41.038493 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-02c0e793-2a83-45ce-80d8-14356b016444 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:41.039349 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-02c0e793-2a83-45ce-80d8-14356b016444 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:41.039846 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-02c0e793-2a83-45ce-80d8-14356b016444 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:41.180396 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-02c0e793-2a83-45ce-80d8-14356b016444 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:08:41.188695 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-84c10523-6b74-4d19-89b1-95dc2ece0b2e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:08:41.189248 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-02c0e793-2a83-45ce-80d8-14356b016444 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1219 microversion: 2.1 time: 0.167910 Dec 16 15:08:41.189724 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-84c10523-6b74-4d19-89b1-95dc2ece0b2e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:08:41.189831 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 745/1496] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:08:41 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1219 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:08:41.197725 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-84c10523-6b74-4d19-89b1-95dc2ece0b2e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:41.198286 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-84c10523-6b74-4d19-89b1-95dc2ece0b2e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:41.199120 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-84c10523-6b74-4d19-89b1-95dc2ece0b2e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:41.199616 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-84c10523-6b74-4d19-89b1-95dc2ece0b2e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:41.274351 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-84c10523-6b74-4d19-89b1-95dc2ece0b2e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093270 Dec 16 15:08:41.274960 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 752/1497] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:08:41 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:08:42.211445 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-42f8acdb-fa1e-4ac4-949f-259c496c7902 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:08:42.212137 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-42f8acdb-fa1e-4ac4-949f-259c496c7902 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:08:42.220015 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-42f8acdb-fa1e-4ac4-949f-259c496c7902 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:42.220517 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-42f8acdb-fa1e-4ac4-949f-259c496c7902 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:42.221342 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-42f8acdb-fa1e-4ac4-949f-259c496c7902 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:42.221826 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-42f8acdb-fa1e-4ac4-949f-259c496c7902 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:42.290163 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-76f50248-0ad9-4182-8f53-54bfa49968f7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:08:42.291218 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-76f50248-0ad9-4182-8f53-54bfa49968f7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:08:42.300349 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-76f50248-0ad9-4182-8f53-54bfa49968f7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:42.300862 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-76f50248-0ad9-4182-8f53-54bfa49968f7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:42.301721 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-76f50248-0ad9-4182-8f53-54bfa49968f7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:42.302267 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-76f50248-0ad9-4182-8f53-54bfa49968f7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:42.352680 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-42f8acdb-fa1e-4ac4-949f-259c496c7902 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:08:42.361844 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-42f8acdb-fa1e-4ac4-949f-259c496c7902 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1219 microversion: 2.1 time: 0.158645 Dec 16 15:08:42.362470 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 746/1498] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:08:42 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1219 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:08:42.377708 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-76f50248-0ad9-4182-8f53-54bfa49968f7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096056 Dec 16 15:08:42.378371 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 753/1499] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:08:42 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 15:08:43.384176 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-489a6fe2-2ecd-4f2d-b0f0-5f6cffa72783 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:08:43.385578 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-489a6fe2-2ecd-4f2d-b0f0-5f6cffa72783 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:08:43.394122 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-489a6fe2-2ecd-4f2d-b0f0-5f6cffa72783 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:43.394554 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-a109b004-a217-4477-83e8-4a1bc4557193 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:08:43.394707 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-489a6fe2-2ecd-4f2d-b0f0-5f6cffa72783 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:43.395490 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-489a6fe2-2ecd-4f2d-b0f0-5f6cffa72783 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:43.395624 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-a109b004-a217-4477-83e8-4a1bc4557193 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:08:43.395977 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-489a6fe2-2ecd-4f2d-b0f0-5f6cffa72783 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:43.403390 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a109b004-a217-4477-83e8-4a1bc4557193 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:43.403905 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a109b004-a217-4477-83e8-4a1bc4557193 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:43.404747 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a109b004-a217-4477-83e8-4a1bc4557193 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:43.405250 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a109b004-a217-4477-83e8-4a1bc4557193 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:43.477729 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-a109b004-a217-4477-83e8-4a1bc4557193 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091436 Dec 16 15:08:43.478658 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 754/1500] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:08:43 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:08:43.526589 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-489a6fe2-2ecd-4f2d-b0f0-5f6cffa72783 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:08:43.544295 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-489a6fe2-2ecd-4f2d-b0f0-5f6cffa72783 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1219 microversion: 2.1 time: 0.168221 Dec 16 15:08:43.544900 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 747/1501] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:08:43 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1219 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:08:44.494664 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-e3e9c27a-480f-431e-9bda-92a4f6a0c40b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:08:44.495712 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-e3e9c27a-480f-431e-9bda-92a4f6a0c40b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:08:44.504628 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e3e9c27a-480f-431e-9bda-92a4f6a0c40b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:44.505128 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e3e9c27a-480f-431e-9bda-92a4f6a0c40b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:44.505972 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e3e9c27a-480f-431e-9bda-92a4f6a0c40b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:44.506486 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e3e9c27a-480f-431e-9bda-92a4f6a0c40b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:44.566885 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-33e5f47c-137f-48fd-9e2e-4e33b93e123b tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:08:44.567477 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-33e5f47c-137f-48fd-9e2e-4e33b93e123b tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:08:44.575226 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-33e5f47c-137f-48fd-9e2e-4e33b93e123b tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:44.575736 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-33e5f47c-137f-48fd-9e2e-4e33b93e123b tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:44.576570 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-33e5f47c-137f-48fd-9e2e-4e33b93e123b tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:44.577059 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-33e5f47c-137f-48fd-9e2e-4e33b93e123b tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:44.579624 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-e3e9c27a-480f-431e-9bda-92a4f6a0c40b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092720 Dec 16 15:08:44.580260 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 755/1502] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:08:44 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:08:44.703965 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-33e5f47c-137f-48fd-9e2e-4e33b93e123b tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:08:44.713039 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-33e5f47c-137f-48fd-9e2e-4e33b93e123b tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1219 microversion: 2.1 time: 0.154685 Dec 16 15:08:44.713653 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 748/1503] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:08:44 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1219 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:08:45.595800 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-6b8c52c8-cc78-4b10-bd1b-e103c2c189ae tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:08:45.596883 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-6b8c52c8-cc78-4b10-bd1b-e103c2c189ae tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:08:45.604879 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6b8c52c8-cc78-4b10-bd1b-e103c2c189ae tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:45.605387 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6b8c52c8-cc78-4b10-bd1b-e103c2c189ae tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:45.606254 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6b8c52c8-cc78-4b10-bd1b-e103c2c189ae tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:45.606744 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6b8c52c8-cc78-4b10-bd1b-e103c2c189ae tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:45.681515 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-6b8c52c8-cc78-4b10-bd1b-e103c2c189ae tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093902 Dec 16 15:08:45.682079 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 756/1504] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:08:45 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:08:45.734838 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-3c10517e-d50b-4607-b794-02d276a9f503 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:08:45.735515 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-3c10517e-d50b-4607-b794-02d276a9f503 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:08:45.744068 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3c10517e-d50b-4607-b794-02d276a9f503 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:45.744581 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3c10517e-d50b-4607-b794-02d276a9f503 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:45.745427 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3c10517e-d50b-4607-b794-02d276a9f503 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:45.745921 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3c10517e-d50b-4607-b794-02d276a9f503 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:45.872324 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-3c10517e-d50b-4607-b794-02d276a9f503 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:08:45.881064 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-3c10517e-d50b-4607-b794-02d276a9f503 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1219 microversion: 2.1 time: 0.154172 Dec 16 15:08:45.881652 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 749/1505] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:08:45 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1219 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:08:46.698413 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-c7876d67-be91-4543-9c5b-30f1888ad8d2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:08:46.699613 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-c7876d67-be91-4543-9c5b-30f1888ad8d2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:08:46.708088 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c7876d67-be91-4543-9c5b-30f1888ad8d2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:46.708599 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c7876d67-be91-4543-9c5b-30f1888ad8d2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:46.709440 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c7876d67-be91-4543-9c5b-30f1888ad8d2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:46.709934 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c7876d67-be91-4543-9c5b-30f1888ad8d2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:46.788288 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-c7876d67-be91-4543-9c5b-30f1888ad8d2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.098159 Dec 16 15:08:46.788942 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 757/1506] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:08:46 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:08:46.902786 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-36826668-0ef1-46cb-8b60-72d3bbb222dd tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:08:46.903450 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-36826668-0ef1-46cb-8b60-72d3bbb222dd tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:08:46.911843 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-36826668-0ef1-46cb-8b60-72d3bbb222dd tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:46.912350 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-36826668-0ef1-46cb-8b60-72d3bbb222dd tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:46.913184 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-36826668-0ef1-46cb-8b60-72d3bbb222dd tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:46.913677 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-36826668-0ef1-46cb-8b60-72d3bbb222dd tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:47.049146 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-36826668-0ef1-46cb-8b60-72d3bbb222dd tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:08:47.058096 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-36826668-0ef1-46cb-8b60-72d3bbb222dd tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1219 microversion: 2.1 time: 0.163130 Dec 16 15:08:47.058662 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 750/1507] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:08:46 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1219 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:08:47.805332 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-00ef534e-99b7-42ea-80cb-5cd2c49e4a75 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:08:47.806393 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-00ef534e-99b7-42ea-80cb-5cd2c49e4a75 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:08:47.814791 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-00ef534e-99b7-42ea-80cb-5cd2c49e4a75 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:47.815294 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-00ef534e-99b7-42ea-80cb-5cd2c49e4a75 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:47.816367 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-00ef534e-99b7-42ea-80cb-5cd2c49e4a75 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:47.816855 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-00ef534e-99b7-42ea-80cb-5cd2c49e4a75 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:47.892546 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-00ef534e-99b7-42ea-80cb-5cd2c49e4a75 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095379 Dec 16 15:08:47.893304 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 758/1508] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:08:47 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:08:48.081779 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-e7615b9f-f908-46af-a3f2-225b3c39833a tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:08:48.082894 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-e7615b9f-f908-46af-a3f2-225b3c39833a tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:08:48.086206 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 15:08:48.086349 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: Thu Dec 16 15:08:48 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 (ip 10.222.0.45) !!! Dec 16 15:08:48.107929 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e7615b9f-f908-46af-a3f2-225b3c39833a tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:48.108446 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e7615b9f-f908-46af-a3f2-225b3c39833a tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:48.109305 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e7615b9f-f908-46af-a3f2-225b3c39833a tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:48.109799 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e7615b9f-f908-46af-a3f2-225b3c39833a tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:48.238969 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-e7615b9f-f908-46af-a3f2-225b3c39833a tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:08:48.249048 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-e7615b9f-f908-46af-a3f2-225b3c39833a tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1219 microversion: 2.1 time: 0.175813 Dec 16 15:08:48.249637 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 751/1509] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:08:48 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1219 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:08:48.909608 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-623b26d9-11e7-4422-8300-923c3ed2f575 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:08:48.910618 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-623b26d9-11e7-4422-8300-923c3ed2f575 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:08:48.918906 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-623b26d9-11e7-4422-8300-923c3ed2f575 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:48.919424 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-623b26d9-11e7-4422-8300-923c3ed2f575 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:48.920292 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-623b26d9-11e7-4422-8300-923c3ed2f575 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:48.920793 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-623b26d9-11e7-4422-8300-923c3ed2f575 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:48.993961 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-623b26d9-11e7-4422-8300-923c3ed2f575 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092717 Dec 16 15:08:48.994616 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 759/1510] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:08:48 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:08:49.270782 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-edbf7f87-b4a7-42f3-a8b6-447405f70006 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:08:49.271380 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-edbf7f87-b4a7-42f3-a8b6-447405f70006 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:08:49.279214 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-edbf7f87-b4a7-42f3-a8b6-447405f70006 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:49.279725 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-edbf7f87-b4a7-42f3-a8b6-447405f70006 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:49.280569 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-edbf7f87-b4a7-42f3-a8b6-447405f70006 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:49.281068 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-edbf7f87-b4a7-42f3-a8b6-447405f70006 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:49.414251 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-edbf7f87-b4a7-42f3-a8b6-447405f70006 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:08:49.423843 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-edbf7f87-b4a7-42f3-a8b6-447405f70006 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1219 microversion: 2.1 time: 0.160178 Dec 16 15:08:49.424537 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 752/1511] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:08:49 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1219 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:08:50.010621 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-2e2a2b53-cc57-4e42-8939-e01bf2de2eb8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:08:50.011666 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-2e2a2b53-cc57-4e42-8939-e01bf2de2eb8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:08:50.020012 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2e2a2b53-cc57-4e42-8939-e01bf2de2eb8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:50.020516 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2e2a2b53-cc57-4e42-8939-e01bf2de2eb8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:50.021351 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2e2a2b53-cc57-4e42-8939-e01bf2de2eb8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:50.021846 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2e2a2b53-cc57-4e42-8939-e01bf2de2eb8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:50.119567 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-2e2a2b53-cc57-4e42-8939-e01bf2de2eb8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.116599 Dec 16 15:08:50.120177 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 760/1512] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:08:50 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:08:50.446819 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-43553563-215f-4c08-8cef-0b57ea5288e7 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:08:50.447492 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-43553563-215f-4c08-8cef-0b57ea5288e7 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:08:50.455924 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-43553563-215f-4c08-8cef-0b57ea5288e7 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:50.456426 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-43553563-215f-4c08-8cef-0b57ea5288e7 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:50.457370 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-43553563-215f-4c08-8cef-0b57ea5288e7 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:50.457721 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-43553563-215f-4c08-8cef-0b57ea5288e7 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:50.591310 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-43553563-215f-4c08-8cef-0b57ea5288e7 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:08:50.600681 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-43553563-215f-4c08-8cef-0b57ea5288e7 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1219 microversion: 2.1 time: 0.163167 Dec 16 15:08:50.601290 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 753/1513] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:08:50 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1219 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:08:51.144285 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-6dab95d2-000f-40d4-ac14-7a104d89eb96 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:08:51.146277 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-6dab95d2-000f-40d4-ac14-7a104d89eb96 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:08:51.159918 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6dab95d2-000f-40d4-ac14-7a104d89eb96 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:51.160743 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6dab95d2-000f-40d4-ac14-7a104d89eb96 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:51.162156 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6dab95d2-000f-40d4-ac14-7a104d89eb96 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:51.162965 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6dab95d2-000f-40d4-ac14-7a104d89eb96 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:51.310270 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-6dab95d2-000f-40d4-ac14-7a104d89eb96 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.180055 Dec 16 15:08:51.311162 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 761/1514] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:08:51 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:08:51.624117 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-277fdb52-c3de-4381-8bea-993390b21597 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:08:51.624778 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-277fdb52-c3de-4381-8bea-993390b21597 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:08:51.634311 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-277fdb52-c3de-4381-8bea-993390b21597 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:51.635362 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-277fdb52-c3de-4381-8bea-993390b21597 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:51.636274 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-277fdb52-c3de-4381-8bea-993390b21597 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:51.636978 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-277fdb52-c3de-4381-8bea-993390b21597 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:51.774163 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-277fdb52-c3de-4381-8bea-993390b21597 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:08:51.783650 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-277fdb52-c3de-4381-8bea-993390b21597 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1219 microversion: 2.1 time: 0.167293 Dec 16 15:08:51.784255 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 754/1515] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:08:51 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1219 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:08:52.327246 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-2c53fedb-b58e-43a9-8e72-f27aab42d427 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:08:52.328288 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-2c53fedb-b58e-43a9-8e72-f27aab42d427 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:08:52.336953 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2c53fedb-b58e-43a9-8e72-f27aab42d427 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:52.337455 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2c53fedb-b58e-43a9-8e72-f27aab42d427 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:52.338351 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2c53fedb-b58e-43a9-8e72-f27aab42d427 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:52.338836 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2c53fedb-b58e-43a9-8e72-f27aab42d427 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:52.409400 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-2c53fedb-b58e-43a9-8e72-f27aab42d427 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089801 Dec 16 15:08:52.410014 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 762/1516] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:08:52 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:08:52.805482 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-8c6e8c7a-07de-4c4e-96d1-604a731421ae tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:08:52.806205 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-8c6e8c7a-07de-4c4e-96d1-604a731421ae tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:08:52.813960 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8c6e8c7a-07de-4c4e-96d1-604a731421ae tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:52.814510 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8c6e8c7a-07de-4c4e-96d1-604a731421ae tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:52.815937 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8c6e8c7a-07de-4c4e-96d1-604a731421ae tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:52.816689 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8c6e8c7a-07de-4c4e-96d1-604a731421ae tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:52.949715 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-8c6e8c7a-07de-4c4e-96d1-604a731421ae tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:08:52.958910 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-8c6e8c7a-07de-4c4e-96d1-604a731421ae tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1219 microversion: 2.1 time: 0.161599 Dec 16 15:08:52.959604 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 755/1517] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:08:52 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1219 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:08:53.425083 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-09350ccc-fa49-49b9-890c-4cd57215ca3b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:08:53.426212 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-09350ccc-fa49-49b9-890c-4cd57215ca3b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:08:53.434033 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-09350ccc-fa49-49b9-890c-4cd57215ca3b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:53.434586 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-09350ccc-fa49-49b9-890c-4cd57215ca3b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:53.435431 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-09350ccc-fa49-49b9-890c-4cd57215ca3b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:53.435918 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-09350ccc-fa49-49b9-890c-4cd57215ca3b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:53.508151 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-09350ccc-fa49-49b9-890c-4cd57215ca3b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091232 Dec 16 15:08:53.508771 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 763/1518] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:08:53 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:08:54.000718 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-ac9eecfa-872a-4287-a2cc-e1592c72040e tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:08:54.001898 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-ac9eecfa-872a-4287-a2cc-e1592c72040e tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:08:54.013062 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ac9eecfa-872a-4287-a2cc-e1592c72040e tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:54.013660 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ac9eecfa-872a-4287-a2cc-e1592c72040e tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:54.014649 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ac9eecfa-872a-4287-a2cc-e1592c72040e tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:54.015152 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ac9eecfa-872a-4287-a2cc-e1592c72040e tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:54.159022 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-ac9eecfa-872a-4287-a2cc-e1592c72040e tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d92824869e49fca069e536bc80b2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482e5876a2f84b6ca5fc8e3537c2e971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:08:54.172136 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-ac9eecfa-872a-4287-a2cc-e1592c72040e tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 200 len: 1219 microversion: 2.1 time: 0.198082 Dec 16 15:08:54.172769 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 756/1519] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:08:53 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 1219 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:08:54.524546 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-183a827d-7ccc-4cc4-892c-144b79219b9a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:08:54.525595 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-183a827d-7ccc-4cc4-892c-144b79219b9a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:08:54.533548 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-183a827d-7ccc-4cc4-892c-144b79219b9a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:54.534632 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-183a827d-7ccc-4cc4-892c-144b79219b9a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:54.535606 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-183a827d-7ccc-4cc4-892c-144b79219b9a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:54.536100 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-183a827d-7ccc-4cc4-892c-144b79219b9a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:54.613509 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-183a827d-7ccc-4cc4-892c-144b79219b9a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096824 Dec 16 15:08:54.614162 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 764/1520] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:08:54 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:08:55.195510 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-f82ca661-40ca-44d7-9bf6-3cc930857758 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:08:55.196186 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-f82ca661-40ca-44d7-9bf6-3cc930857758 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] [instance: 60bfc41e-721c-45aa-a6fb-93f9213cf050] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:08:55.204189 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f82ca661-40ca-44d7-9bf6-3cc930857758 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:55.204701 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f82ca661-40ca-44d7-9bf6-3cc930857758 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:55.206064 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f82ca661-40ca-44d7-9bf6-3cc930857758 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:55.206595 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f82ca661-40ca-44d7-9bf6-3cc930857758 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:55.261973 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.wsgi [None req-f82ca661-40ca-44d7-9bf6-3cc930857758 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] HTTP exception thrown: Instance 60bfc41e-721c-45aa-a6fb-93f9213cf050 could not be found. Dec 16 15:08:55.262688 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-f82ca661-40ca-44d7-9bf6-3cc930857758 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Returning 404 to user: Instance 60bfc41e-721c-45aa-a6fb-93f9213cf050 could not be found. {{(pid=101355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:941}} Dec 16 15:08:55.263606 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-f82ca661-40ca-44d7-9bf6-3cc930857758 tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050" status: 404 len: 111 microversion: 2.1 time: 0.076270 Dec 16 15:08:55.264228 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 757/1521] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:08:55 2021] GET /compute/v2.1/servers/60bfc41e-721c-45aa-a6fb-93f9213cf050 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 15:08:55.639724 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-09e84006-72c5-4e6d-9032-c0ae91f7a6e8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:08:55.641903 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-09e84006-72c5-4e6d-9032-c0ae91f7a6e8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:08:55.647480 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-2a37995b-24ad-41e5-8ac1-3eb8beb56d6b tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] Calling method '.version_select at 0x7f14f720b7b8>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:08:55.651007 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-09e84006-72c5-4e6d-9032-c0ae91f7a6e8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:55.651513 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-09e84006-72c5-4e6d-9032-c0ae91f7a6e8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:55.652401 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-09e84006-72c5-4e6d-9032-c0ae91f7a6e8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:55.652893 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-09e84006-72c5-4e6d-9032-c0ae91f7a6e8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:55.702756 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-2a37995b-24ad-41e5-8ac1-3eb8beb56d6b tempest-TestShelveInstance-2019255670 tempest-TestShelveInstance-2019255670-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-476918611" status: 202 len: 0 microversion: 2.1 time: 0.063619 Dec 16 15:08:55.703398 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 758/1522] 10.222.0.45 () {58 vars in 1241 bytes} [Thu Dec 16 15:08:55 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-476918611 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 16 15:08:55.726286 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-09e84006-72c5-4e6d-9032-c0ae91f7a6e8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.103711 Dec 16 15:08:55.726901 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 765/1523] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:08:55 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:08:56.742851 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-d74136ef-9d70-43bb-bc3a-b26c56407ebd tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:08:56.744471 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-d74136ef-9d70-43bb-bc3a-b26c56407ebd tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:08:56.753537 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d74136ef-9d70-43bb-bc3a-b26c56407ebd tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:56.754067 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d74136ef-9d70-43bb-bc3a-b26c56407ebd tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:56.754940 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d74136ef-9d70-43bb-bc3a-b26c56407ebd tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:56.755444 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d74136ef-9d70-43bb-bc3a-b26c56407ebd tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:56.833280 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-d74136ef-9d70-43bb-bc3a-b26c56407ebd tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.098798 Dec 16 15:08:56.833906 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 759/1524] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:08:56 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:08:57.850387 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-494acde0-a712-432e-a907-5ff319e1aadf tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:08:57.851456 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-494acde0-a712-432e-a907-5ff319e1aadf tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:08:57.859529 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-494acde0-a712-432e-a907-5ff319e1aadf tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:57.860050 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-494acde0-a712-432e-a907-5ff319e1aadf tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:57.860904 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-494acde0-a712-432e-a907-5ff319e1aadf tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:57.861400 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-494acde0-a712-432e-a907-5ff319e1aadf tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:57.939591 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-494acde0-a712-432e-a907-5ff319e1aadf tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097780 Dec 16 15:08:57.940260 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 766/1525] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:08:57 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:08:58.956504 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-e3642db2-bab9-472b-9bc7-1c90e75cc993 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:08:58.957559 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-e3642db2-bab9-472b-9bc7-1c90e75cc993 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:08:58.965622 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e3642db2-bab9-472b-9bc7-1c90e75cc993 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:58.966189 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e3642db2-bab9-472b-9bc7-1c90e75cc993 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:58.967054 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e3642db2-bab9-472b-9bc7-1c90e75cc993 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:08:58.967551 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e3642db2-bab9-472b-9bc7-1c90e75cc993 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:08:59.047735 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-e3642db2-bab9-472b-9bc7-1c90e75cc993 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.099310 Dec 16 15:08:59.048355 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 760/1526] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:08:58 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:09:00.067730 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-fd7c9296-f383-471f-a1e5-6a4aa9a8b0de tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:09:00.073593 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-fd7c9296-f383-471f-a1e5-6a4aa9a8b0de tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:09:00.079107 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 15:09:00.079394 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: Thu Dec 16 15:09:00 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments (ip 10.222.0.45) !!! Dec 16 15:09:00.095788 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fd7c9296-f383-471f-a1e5-6a4aa9a8b0de tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:09:00.096494 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fd7c9296-f383-471f-a1e5-6a4aa9a8b0de tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:09:00.097680 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fd7c9296-f383-471f-a1e5-6a4aa9a8b0de tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:09:00.098443 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fd7c9296-f383-471f-a1e5-6a4aa9a8b0de tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:09:00.192684 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-fd7c9296-f383-471f-a1e5-6a4aa9a8b0de tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.135976 Dec 16 15:09:00.193537 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 767/1527] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:09:00 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:09:01.215369 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-8923fa70-bebb-48ad-8b34-19e250781bf1 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:09:01.216582 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-8923fa70-bebb-48ad-8b34-19e250781bf1 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:09:01.227065 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8923fa70-bebb-48ad-8b34-19e250781bf1 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:09:01.227589 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8923fa70-bebb-48ad-8b34-19e250781bf1 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:09:01.228699 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8923fa70-bebb-48ad-8b34-19e250781bf1 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:09:01.229348 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8923fa70-bebb-48ad-8b34-19e250781bf1 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:09:01.319442 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-8923fa70-bebb-48ad-8b34-19e250781bf1 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.115640 Dec 16 15:09:01.323905 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 761/1528] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:09:01 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:09:02.341688 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-6f1ffd43-3bd1-4bb8-b0cc-e76a6473c37e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:09:02.341688 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-6f1ffd43-3bd1-4bb8-b0cc-e76a6473c37e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:09:02.347788 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6f1ffd43-3bd1-4bb8-b0cc-e76a6473c37e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:09:02.348520 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6f1ffd43-3bd1-4bb8-b0cc-e76a6473c37e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:09:02.350411 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6f1ffd43-3bd1-4bb8-b0cc-e76a6473c37e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:09:02.350771 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6f1ffd43-3bd1-4bb8-b0cc-e76a6473c37e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:09:02.473908 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-6f1ffd43-3bd1-4bb8-b0cc-e76a6473c37e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.145777 Dec 16 15:09:02.475056 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 768/1529] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:09:02 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:09:03.494225 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-719cef4a-c32a-4f9a-b18a-5642db09b7d9 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:09:03.496125 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-719cef4a-c32a-4f9a-b18a-5642db09b7d9 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:09:03.508749 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-719cef4a-c32a-4f9a-b18a-5642db09b7d9 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:09:03.509239 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-719cef4a-c32a-4f9a-b18a-5642db09b7d9 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:09:03.510132 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-719cef4a-c32a-4f9a-b18a-5642db09b7d9 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:09:03.510627 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-719cef4a-c32a-4f9a-b18a-5642db09b7d9 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:09:03.607970 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-719cef4a-c32a-4f9a-b18a-5642db09b7d9 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.123362 Dec 16 15:09:03.608599 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 762/1530] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:09:03 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:09:04.627819 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-0e26e8c6-4a12-4887-9e80-3a1e0ea1127f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:09:04.628904 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-0e26e8c6-4a12-4887-9e80-3a1e0ea1127f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:09:04.637394 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0e26e8c6-4a12-4887-9e80-3a1e0ea1127f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:09:04.637911 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0e26e8c6-4a12-4887-9e80-3a1e0ea1127f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:09:04.638801 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0e26e8c6-4a12-4887-9e80-3a1e0ea1127f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:09:04.639291 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0e26e8c6-4a12-4887-9e80-3a1e0ea1127f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:09:04.714647 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-0e26e8c6-4a12-4887-9e80-3a1e0ea1127f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.098051 Dec 16 15:09:04.715222 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 769/1531] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:09:04 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:09:05.730634 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-7488dda3-e6bd-4fa3-8f49-b22ec0ef7820 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:09:05.731679 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-7488dda3-e6bd-4fa3-8f49-b22ec0ef7820 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:09:05.741443 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7488dda3-e6bd-4fa3-8f49-b22ec0ef7820 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:09:05.741956 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7488dda3-e6bd-4fa3-8f49-b22ec0ef7820 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:09:05.742885 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7488dda3-e6bd-4fa3-8f49-b22ec0ef7820 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:09:05.743385 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7488dda3-e6bd-4fa3-8f49-b22ec0ef7820 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:09:05.891359 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-7488dda3-e6bd-4fa3-8f49-b22ec0ef7820 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.168610 Dec 16 15:09:05.892202 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 763/1532] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:09:05 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:09:06.907585 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-0158811c-dc4b-40bc-a994-ebd8c5cbe598 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:09:06.909149 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-0158811c-dc4b-40bc-a994-ebd8c5cbe598 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:09:06.916961 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0158811c-dc4b-40bc-a994-ebd8c5cbe598 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:09:06.917473 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0158811c-dc4b-40bc-a994-ebd8c5cbe598 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:09:06.918366 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0158811c-dc4b-40bc-a994-ebd8c5cbe598 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:09:06.918864 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0158811c-dc4b-40bc-a994-ebd8c5cbe598 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:09:06.994399 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-0158811c-dc4b-40bc-a994-ebd8c5cbe598 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094588 Dec 16 15:09:06.995222 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 770/1533] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:09:06 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:09:08.011005 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-473c6577-271e-44ba-b601-32c9f045d0a4 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:09:08.012063 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-473c6577-271e-44ba-b601-32c9f045d0a4 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:09:08.020613 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-473c6577-271e-44ba-b601-32c9f045d0a4 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:09:08.021133 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-473c6577-271e-44ba-b601-32c9f045d0a4 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:09:08.021996 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-473c6577-271e-44ba-b601-32c9f045d0a4 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:09:08.022532 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-473c6577-271e-44ba-b601-32c9f045d0a4 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:09:08.096174 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-473c6577-271e-44ba-b601-32c9f045d0a4 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093138 Dec 16 15:09:08.097002 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 764/1534] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:09:08 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:09:09.112711 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-d88b9d06-8c10-4ac5-a1c8-4c154794ffaf tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:09:09.113747 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-d88b9d06-8c10-4ac5-a1c8-4c154794ffaf tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:09:09.121739 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d88b9d06-8c10-4ac5-a1c8-4c154794ffaf tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:09:09.122235 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d88b9d06-8c10-4ac5-a1c8-4c154794ffaf tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:09:09.123070 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d88b9d06-8c10-4ac5-a1c8-4c154794ffaf tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:09:09.123593 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d88b9d06-8c10-4ac5-a1c8-4c154794ffaf tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:09:09.198879 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-d88b9d06-8c10-4ac5-a1c8-4c154794ffaf tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094509 Dec 16 15:09:09.199522 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 771/1535] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:09:09 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:09:10.215705 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-312613d4-a08a-4980-8f32-8b1a6d2c8402 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:09:10.216685 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-312613d4-a08a-4980-8f32-8b1a6d2c8402 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:09:10.225262 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-312613d4-a08a-4980-8f32-8b1a6d2c8402 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:09:10.225774 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-312613d4-a08a-4980-8f32-8b1a6d2c8402 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:09:10.226684 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-312613d4-a08a-4980-8f32-8b1a6d2c8402 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:09:10.227183 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-312613d4-a08a-4980-8f32-8b1a6d2c8402 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:09:10.305118 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-312613d4-a08a-4980-8f32-8b1a6d2c8402 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097321 Dec 16 15:09:10.306081 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 765/1536] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:09:10 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:09:11.321762 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-ad6b67dd-650d-4aca-a5e2-5c44c9516570 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:09:11.322849 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-ad6b67dd-650d-4aca-a5e2-5c44c9516570 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:09:11.335984 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ad6b67dd-650d-4aca-a5e2-5c44c9516570 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:09:11.335984 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ad6b67dd-650d-4aca-a5e2-5c44c9516570 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:09:11.335984 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ad6b67dd-650d-4aca-a5e2-5c44c9516570 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:09:11.335984 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ad6b67dd-650d-4aca-a5e2-5c44c9516570 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:09:11.407120 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-ad6b67dd-650d-4aca-a5e2-5c44c9516570 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093925 Dec 16 15:09:11.407784 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 772/1537] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:09:11 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:09:12.423683 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-0a49ce99-2668-4598-aa9e-76c13a08bdd9 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:09:12.424824 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-0a49ce99-2668-4598-aa9e-76c13a08bdd9 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:09:12.433327 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0a49ce99-2668-4598-aa9e-76c13a08bdd9 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:09:12.433842 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0a49ce99-2668-4598-aa9e-76c13a08bdd9 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:09:12.434753 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0a49ce99-2668-4598-aa9e-76c13a08bdd9 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:09:12.435251 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0a49ce99-2668-4598-aa9e-76c13a08bdd9 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:09:12.510156 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-0a49ce99-2668-4598-aa9e-76c13a08bdd9 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094624 Dec 16 15:09:12.510781 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 766/1538] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:09:12 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:09:13.526795 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-af2e5070-ecac-4783-8c5e-b034dfab6e10 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:09:13.527748 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-af2e5070-ecac-4783-8c5e-b034dfab6e10 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:09:13.535676 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-af2e5070-ecac-4783-8c5e-b034dfab6e10 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:09:13.536175 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-af2e5070-ecac-4783-8c5e-b034dfab6e10 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:09:13.537014 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-af2e5070-ecac-4783-8c5e-b034dfab6e10 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:09:13.537505 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-af2e5070-ecac-4783-8c5e-b034dfab6e10 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:09:13.618914 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-af2e5070-ecac-4783-8c5e-b034dfab6e10 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.099856 Dec 16 15:09:13.619592 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 773/1539] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:09:13 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:09:14.638634 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-89bfa2f8-e1e5-4274-b0fb-3ddcb2851e3f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:09:14.639576 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-89bfa2f8-e1e5-4274-b0fb-3ddcb2851e3f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:09:14.647453 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-89bfa2f8-e1e5-4274-b0fb-3ddcb2851e3f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:09:14.647958 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-89bfa2f8-e1e5-4274-b0fb-3ddcb2851e3f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:09:14.648802 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-89bfa2f8-e1e5-4274-b0fb-3ddcb2851e3f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:09:14.649290 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-89bfa2f8-e1e5-4274-b0fb-3ddcb2851e3f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:09:14.725299 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-89bfa2f8-e1e5-4274-b0fb-3ddcb2851e3f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095570 Dec 16 15:09:14.730643 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 767/1540] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:09:14 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 15:09:15.742980 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-ac9fee4b-f169-496a-91fb-1b8a0413d7e5 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:09:15.744065 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-ac9fee4b-f169-496a-91fb-1b8a0413d7e5 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:09:15.752809 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ac9fee4b-f169-496a-91fb-1b8a0413d7e5 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:09:15.753253 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ac9fee4b-f169-496a-91fb-1b8a0413d7e5 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:09:15.754170 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ac9fee4b-f169-496a-91fb-1b8a0413d7e5 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:09:15.754672 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ac9fee4b-f169-496a-91fb-1b8a0413d7e5 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:09:15.829759 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-ac9fee4b-f169-496a-91fb-1b8a0413d7e5 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094836 Dec 16 15:09:15.830423 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 774/1541] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:09:15 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:09:16.850233 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-2f5bc4cd-4b2c-4a86-9919-eb63f47d6a85 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:09:16.851280 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-2f5bc4cd-4b2c-4a86-9919-eb63f47d6a85 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:09:16.859467 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2f5bc4cd-4b2c-4a86-9919-eb63f47d6a85 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:09:16.859986 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2f5bc4cd-4b2c-4a86-9919-eb63f47d6a85 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:09:16.860898 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2f5bc4cd-4b2c-4a86-9919-eb63f47d6a85 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:09:16.861398 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2f5bc4cd-4b2c-4a86-9919-eb63f47d6a85 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:09:16.935048 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-2f5bc4cd-4b2c-4a86-9919-eb63f47d6a85 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096436 Dec 16 15:09:16.935677 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 768/1542] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:09:16 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:09:17.951817 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-e2f2078f-ed43-43f7-96c6-50e27161effd tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:09:17.952872 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-e2f2078f-ed43-43f7-96c6-50e27161effd tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:09:17.961048 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e2f2078f-ed43-43f7-96c6-50e27161effd tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:09:17.961552 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e2f2078f-ed43-43f7-96c6-50e27161effd tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:09:17.962436 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e2f2078f-ed43-43f7-96c6-50e27161effd tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:09:17.962930 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e2f2078f-ed43-43f7-96c6-50e27161effd tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:09:18.041097 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-e2f2078f-ed43-43f7-96c6-50e27161effd tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097088 Dec 16 15:09:18.041797 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 775/1543] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:09:17 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:09:19.057683 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-b173f41f-7753-46dd-bf89-62fce142b386 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:09:19.058695 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-b173f41f-7753-46dd-bf89-62fce142b386 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:09:19.067251 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b173f41f-7753-46dd-bf89-62fce142b386 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:09:19.067767 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b173f41f-7753-46dd-bf89-62fce142b386 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:09:19.068643 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b173f41f-7753-46dd-bf89-62fce142b386 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:09:19.069140 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b173f41f-7753-46dd-bf89-62fce142b386 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:09:19.143974 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-b173f41f-7753-46dd-bf89-62fce142b386 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094281 Dec 16 15:09:19.144609 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 769/1544] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:09:19 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:09:20.160810 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-51771fc5-9455-4765-b623-671b017244e8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:09:20.161911 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-51771fc5-9455-4765-b623-671b017244e8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:09:20.169871 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-51771fc5-9455-4765-b623-671b017244e8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:09:20.170410 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-51771fc5-9455-4765-b623-671b017244e8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:09:20.171263 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-51771fc5-9455-4765-b623-671b017244e8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:09:20.171758 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-51771fc5-9455-4765-b623-671b017244e8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:09:20.244892 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-51771fc5-9455-4765-b623-671b017244e8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092505 Dec 16 15:09:20.245522 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 776/1545] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:09:20 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:09:21.261891 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-f04f34d9-3557-40ff-b57b-535320bcd012 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:09:21.262888 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-f04f34d9-3557-40ff-b57b-535320bcd012 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:09:21.270768 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f04f34d9-3557-40ff-b57b-535320bcd012 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:09:21.271281 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f04f34d9-3557-40ff-b57b-535320bcd012 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:09:21.272132 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f04f34d9-3557-40ff-b57b-535320bcd012 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:09:21.272626 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f04f34d9-3557-40ff-b57b-535320bcd012 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:09:21.345968 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-f04f34d9-3557-40ff-b57b-535320bcd012 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091889 Dec 16 15:09:21.346530 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 770/1546] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:09:21 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:09:22.362969 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-0d99137d-38d6-4316-95f4-3ecfabdaa1f1 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:09:22.364020 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-0d99137d-38d6-4316-95f4-3ecfabdaa1f1 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:09:22.367268 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c006f2bf-d7e6-4bb8-aace-c3797b4b538d] AMQP server on 10.222.0.45:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 15:09:22.372776 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0d99137d-38d6-4316-95f4-3ecfabdaa1f1 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:09:22.373283 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0d99137d-38d6-4316-95f4-3ecfabdaa1f1 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:09:22.374153 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0d99137d-38d6-4316-95f4-3ecfabdaa1f1 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:09:22.374643 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0d99137d-38d6-4316-95f4-3ecfabdaa1f1 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:09:22.447451 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-0d99137d-38d6-4316-95f4-3ecfabdaa1f1 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092867 Dec 16 15:09:22.448071 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 777/1547] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:09:22 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:09:23.464192 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-f538c78a-2efb-4479-b13f-36a6024feec7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:09:23.465247 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-f538c78a-2efb-4479-b13f-36a6024feec7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:09:23.473933 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f538c78a-2efb-4479-b13f-36a6024feec7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:09:23.474453 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f538c78a-2efb-4479-b13f-36a6024feec7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:09:23.475358 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f538c78a-2efb-4479-b13f-36a6024feec7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:09:23.475856 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f538c78a-2efb-4479-b13f-36a6024feec7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:09:23.553369 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-f538c78a-2efb-4479-b13f-36a6024feec7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096914 Dec 16 15:09:23.553983 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 771/1548] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:09:23 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:09:24.570188 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-8b630c22-a0dc-48df-bbc3-55cc1becf82b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:09:24.571227 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-8b630c22-a0dc-48df-bbc3-55cc1becf82b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:09:24.590734 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8b630c22-a0dc-48df-bbc3-55cc1becf82b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:09:24.591241 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8b630c22-a0dc-48df-bbc3-55cc1becf82b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:09:24.592085 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8b630c22-a0dc-48df-bbc3-55cc1becf82b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:09:24.592571 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8b630c22-a0dc-48df-bbc3-55cc1becf82b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:09:24.643435 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO oslo.messaging._drivers.impl_rabbit [-] [c006f2bf-d7e6-4bb8-aace-c3797b4b538d] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 45902. Dec 16 15:09:24.664749 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-8b630c22-a0dc-48df-bbc3-55cc1becf82b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.103248 Dec 16 15:09:24.665356 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 778/1549] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:09:24 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:09:25.681608 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-8f52b862-675b-4e4e-a2de-0fc11927923c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:09:25.682609 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-8f52b862-675b-4e4e-a2de-0fc11927923c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:09:25.690745 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8f52b862-675b-4e4e-a2de-0fc11927923c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:09:25.691261 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8f52b862-675b-4e4e-a2de-0fc11927923c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:09:25.692103 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8f52b862-675b-4e4e-a2de-0fc11927923c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:09:25.692601 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8f52b862-675b-4e4e-a2de-0fc11927923c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:09:25.773493 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-8f52b862-675b-4e4e-a2de-0fc11927923c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.100397 Dec 16 15:09:25.774106 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 772/1550] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:09:25 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:09:26.789459 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-f1d4aaab-a0f2-4c4c-9ca8-e37b1b3ac7b2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:09:26.790458 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-f1d4aaab-a0f2-4c4c-9ca8-e37b1b3ac7b2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:09:26.798542 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f1d4aaab-a0f2-4c4c-9ca8-e37b1b3ac7b2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:09:26.799055 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f1d4aaab-a0f2-4c4c-9ca8-e37b1b3ac7b2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:09:26.799915 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f1d4aaab-a0f2-4c4c-9ca8-e37b1b3ac7b2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:09:26.800407 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f1d4aaab-a0f2-4c4c-9ca8-e37b1b3ac7b2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:09:26.877564 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-f1d4aaab-a0f2-4c4c-9ca8-e37b1b3ac7b2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096526 Dec 16 15:09:26.878233 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 779/1551] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:09:26 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:09:27.893200 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-6f0fe96a-397f-4ede-b1f0-62cbad6096f8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:09:27.894280 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-6f0fe96a-397f-4ede-b1f0-62cbad6096f8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:09:27.902247 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6f0fe96a-397f-4ede-b1f0-62cbad6096f8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:09:27.902768 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6f0fe96a-397f-4ede-b1f0-62cbad6096f8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:09:27.903619 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6f0fe96a-397f-4ede-b1f0-62cbad6096f8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:09:27.904116 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6f0fe96a-397f-4ede-b1f0-62cbad6096f8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:09:27.977740 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-6f0fe96a-397f-4ede-b1f0-62cbad6096f8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092235 Dec 16 15:09:27.978451 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 773/1552] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:09:27 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:09:28.993340 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-89e86608-69ae-42fc-b59b-20916bc19735 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:09:28.994380 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-89e86608-69ae-42fc-b59b-20916bc19735 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:09:29.002277 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-89e86608-69ae-42fc-b59b-20916bc19735 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:09:29.002788 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-89e86608-69ae-42fc-b59b-20916bc19735 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:09:29.003633 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-89e86608-69ae-42fc-b59b-20916bc19735 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:09:29.004133 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-89e86608-69ae-42fc-b59b-20916bc19735 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:09:29.076233 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-89e86608-69ae-42fc-b59b-20916bc19735 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090761 Dec 16 15:09:29.076876 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 780/1553] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:09:28 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:09:30.092699 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-9ebed781-2d3e-4779-a4ad-da48f286a2e0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:09:30.093888 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-9ebed781-2d3e-4779-a4ad-da48f286a2e0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:09:30.107388 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9ebed781-2d3e-4779-a4ad-da48f286a2e0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:09:30.107388 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9ebed781-2d3e-4779-a4ad-da48f286a2e0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:09:30.107388 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9ebed781-2d3e-4779-a4ad-da48f286a2e0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:09:30.107388 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9ebed781-2d3e-4779-a4ad-da48f286a2e0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:09:30.176317 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-9ebed781-2d3e-4779-a4ad-da48f286a2e0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091570 Dec 16 15:09:30.176951 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 774/1554] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:09:30 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:09:31.194629 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-feb2dc0b-aa6c-4c82-a867-644b629a99a9 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:09:31.195674 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-feb2dc0b-aa6c-4c82-a867-644b629a99a9 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:09:31.203538 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-feb2dc0b-aa6c-4c82-a867-644b629a99a9 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:09:31.204048 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-feb2dc0b-aa6c-4c82-a867-644b629a99a9 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:09:31.204894 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-feb2dc0b-aa6c-4c82-a867-644b629a99a9 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:09:31.205389 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-feb2dc0b-aa6c-4c82-a867-644b629a99a9 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:09:31.276023 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-feb2dc0b-aa6c-4c82-a867-644b629a99a9 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091093 Dec 16 15:09:31.276645 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 781/1555] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:09:31 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:09:32.292449 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-8dd54980-2960-4735-b56e-2a9b5e95debf tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:09:32.293422 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-8dd54980-2960-4735-b56e-2a9b5e95debf tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:09:32.301771 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8dd54980-2960-4735-b56e-2a9b5e95debf tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:09:32.302309 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8dd54980-2960-4735-b56e-2a9b5e95debf tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:09:32.303147 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8dd54980-2960-4735-b56e-2a9b5e95debf tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:09:32.303641 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8dd54980-2960-4735-b56e-2a9b5e95debf tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:09:32.384267 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-8dd54980-2960-4735-b56e-2a9b5e95debf tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.099674 Dec 16 15:09:32.384902 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 775/1556] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:09:32 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:09:33.400809 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-ee3f07bc-9a05-48f9-a02e-4823cab17ab2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:09:33.401838 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-ee3f07bc-9a05-48f9-a02e-4823cab17ab2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:09:33.409759 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ee3f07bc-9a05-48f9-a02e-4823cab17ab2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:09:33.410287 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ee3f07bc-9a05-48f9-a02e-4823cab17ab2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:09:33.411110 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ee3f07bc-9a05-48f9-a02e-4823cab17ab2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:09:33.411595 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ee3f07bc-9a05-48f9-a02e-4823cab17ab2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:09:33.482111 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-ee3f07bc-9a05-48f9-a02e-4823cab17ab2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089285 Dec 16 15:09:33.482754 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 782/1557] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:09:33 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:09:34.499786 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-b107de73-0dfb-487b-9a7b-5a95da4b47e2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:09:34.500836 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-b107de73-0dfb-487b-9a7b-5a95da4b47e2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:09:34.509149 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b107de73-0dfb-487b-9a7b-5a95da4b47e2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:09:34.509656 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b107de73-0dfb-487b-9a7b-5a95da4b47e2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:09:34.510550 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b107de73-0dfb-487b-9a7b-5a95da4b47e2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:09:34.511042 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b107de73-0dfb-487b-9a7b-5a95da4b47e2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:09:34.591232 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-b107de73-0dfb-487b-9a7b-5a95da4b47e2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.099515 Dec 16 15:09:34.591867 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 776/1558] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:09:34 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:09:35.607590 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-f3f4dc09-329d-41df-a4dc-92cc125aec6f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:09:35.608631 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-f3f4dc09-329d-41df-a4dc-92cc125aec6f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:09:35.617084 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f3f4dc09-329d-41df-a4dc-92cc125aec6f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:09:35.617591 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f3f4dc09-329d-41df-a4dc-92cc125aec6f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:09:35.618466 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f3f4dc09-329d-41df-a4dc-92cc125aec6f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:09:35.618960 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f3f4dc09-329d-41df-a4dc-92cc125aec6f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:09:35.695479 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-f3f4dc09-329d-41df-a4dc-92cc125aec6f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095765 Dec 16 15:09:35.696115 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 783/1559] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:09:35 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:09:36.712034 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-47a232e3-6e0b-41d1-953c-bcd1c138c69d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:09:36.713084 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-47a232e3-6e0b-41d1-953c-bcd1c138c69d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:09:36.721493 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-47a232e3-6e0b-41d1-953c-bcd1c138c69d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:09:36.722007 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-47a232e3-6e0b-41d1-953c-bcd1c138c69d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:09:36.722887 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-47a232e3-6e0b-41d1-953c-bcd1c138c69d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:09:36.723381 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-47a232e3-6e0b-41d1-953c-bcd1c138c69d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:09:36.795066 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-47a232e3-6e0b-41d1-953c-bcd1c138c69d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090777 Dec 16 15:09:36.795694 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 777/1560] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:09:36 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:09:37.811812 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-9b9d82e0-47cd-4fa9-90f4-35546982de9e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:09:37.812769 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-9b9d82e0-47cd-4fa9-90f4-35546982de9e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:09:37.821413 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9b9d82e0-47cd-4fa9-90f4-35546982de9e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:09:37.821919 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9b9d82e0-47cd-4fa9-90f4-35546982de9e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:09:37.822770 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9b9d82e0-47cd-4fa9-90f4-35546982de9e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:09:37.823257 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9b9d82e0-47cd-4fa9-90f4-35546982de9e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:09:37.893857 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-9b9d82e0-47cd-4fa9-90f4-35546982de9e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089807 Dec 16 15:09:37.894515 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 784/1561] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:09:37 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:09:38.909889 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-1fcd0d38-dd07-484b-8233-f83222176145 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:09:38.910970 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-1fcd0d38-dd07-484b-8233-f83222176145 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:09:38.919052 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1fcd0d38-dd07-484b-8233-f83222176145 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:09:38.919555 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1fcd0d38-dd07-484b-8233-f83222176145 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:09:38.920403 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1fcd0d38-dd07-484b-8233-f83222176145 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:09:38.920888 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1fcd0d38-dd07-484b-8233-f83222176145 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:09:38.994367 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-1fcd0d38-dd07-484b-8233-f83222176145 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092474 Dec 16 15:09:38.994993 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 778/1562] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:09:38 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:09:40.011243 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-ffa27474-8ee9-4b2b-81ec-2dc302611003 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:09:40.012223 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-ffa27474-8ee9-4b2b-81ec-2dc302611003 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:09:40.020037 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ffa27474-8ee9-4b2b-81ec-2dc302611003 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:09:40.020543 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ffa27474-8ee9-4b2b-81ec-2dc302611003 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:09:40.021382 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ffa27474-8ee9-4b2b-81ec-2dc302611003 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:09:40.021872 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ffa27474-8ee9-4b2b-81ec-2dc302611003 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:09:40.095379 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-ffa27474-8ee9-4b2b-81ec-2dc302611003 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091866 Dec 16 15:09:40.098509 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 785/1563] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:09:40 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:09:41.112104 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-637fa961-1786-452a-991d-3728e538df8e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:09:41.113191 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-637fa961-1786-452a-991d-3728e538df8e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:09:41.121136 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-637fa961-1786-452a-991d-3728e538df8e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:09:41.121641 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-637fa961-1786-452a-991d-3728e538df8e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:09:41.122525 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-637fa961-1786-452a-991d-3728e538df8e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:09:41.123017 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-637fa961-1786-452a-991d-3728e538df8e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:09:41.218646 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-637fa961-1786-452a-991d-3728e538df8e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.114177 Dec 16 15:09:41.219244 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 779/1564] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:09:41 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:09:42.235628 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-b2ba6110-093f-48b1-9690-b43efd3088f3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:09:42.236684 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-b2ba6110-093f-48b1-9690-b43efd3088f3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:09:42.244761 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b2ba6110-093f-48b1-9690-b43efd3088f3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:09:42.245269 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b2ba6110-093f-48b1-9690-b43efd3088f3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:09:42.246151 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b2ba6110-093f-48b1-9690-b43efd3088f3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:09:42.246646 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b2ba6110-093f-48b1-9690-b43efd3088f3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:09:42.322016 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-b2ba6110-093f-48b1-9690-b43efd3088f3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094604 Dec 16 15:09:42.322772 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 786/1565] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:09:42 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:09:43.342764 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-15fbb849-6cfd-4eec-8a49-f652c8cf53da tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:09:43.343825 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-15fbb849-6cfd-4eec-8a49-f652c8cf53da tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:09:43.352376 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-15fbb849-6cfd-4eec-8a49-f652c8cf53da tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:09:43.352882 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-15fbb849-6cfd-4eec-8a49-f652c8cf53da tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:09:43.353733 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-15fbb849-6cfd-4eec-8a49-f652c8cf53da tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:09:43.354256 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-15fbb849-6cfd-4eec-8a49-f652c8cf53da tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:09:43.425294 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-15fbb849-6cfd-4eec-8a49-f652c8cf53da tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094876 Dec 16 15:09:43.425913 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 780/1566] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:09:43 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:09:44.442986 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-caddce15-8294-42e7-a96f-9ac005fb7cfd tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:09:44.444053 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-caddce15-8294-42e7-a96f-9ac005fb7cfd tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:09:44.452012 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-caddce15-8294-42e7-a96f-9ac005fb7cfd tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:09:44.452524 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-caddce15-8294-42e7-a96f-9ac005fb7cfd tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:09:44.453378 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-caddce15-8294-42e7-a96f-9ac005fb7cfd tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:09:44.453898 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-caddce15-8294-42e7-a96f-9ac005fb7cfd tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:09:44.530555 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-caddce15-8294-42e7-a96f-9ac005fb7cfd tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096991 Dec 16 15:09:44.531186 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 787/1567] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:09:44 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:09:45.546874 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-03e3fed0-3c14-4a91-92f6-1afa4f8fc82c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:09:45.547850 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-03e3fed0-3c14-4a91-92f6-1afa4f8fc82c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:09:45.555851 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-03e3fed0-3c14-4a91-92f6-1afa4f8fc82c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:09:45.556306 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-03e3fed0-3c14-4a91-92f6-1afa4f8fc82c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:09:45.557159 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-03e3fed0-3c14-4a91-92f6-1afa4f8fc82c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:09:45.557662 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-03e3fed0-3c14-4a91-92f6-1afa4f8fc82c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:09:45.630207 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-03e3fed0-3c14-4a91-92f6-1afa4f8fc82c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091060 Dec 16 15:09:45.630833 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 781/1568] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:09:45 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:09:46.646386 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-9d596dbe-9d49-43f8-8a3e-c1d7b2ceb8d6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:09:46.647525 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-9d596dbe-9d49-43f8-8a3e-c1d7b2ceb8d6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:09:46.655412 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9d596dbe-9d49-43f8-8a3e-c1d7b2ceb8d6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:09:46.655921 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9d596dbe-9d49-43f8-8a3e-c1d7b2ceb8d6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:09:46.656760 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9d596dbe-9d49-43f8-8a3e-c1d7b2ceb8d6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:09:46.657255 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9d596dbe-9d49-43f8-8a3e-c1d7b2ceb8d6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:09:46.728574 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-9d596dbe-9d49-43f8-8a3e-c1d7b2ceb8d6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090044 Dec 16 15:09:46.729207 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 788/1569] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:09:46 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:09:47.744943 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-f6bfca7f-fad4-4bb2-8041-435de7523ddd tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:09:47.746023 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-f6bfca7f-fad4-4bb2-8041-435de7523ddd tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:09:47.754604 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f6bfca7f-fad4-4bb2-8041-435de7523ddd tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:09:47.755122 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f6bfca7f-fad4-4bb2-8041-435de7523ddd tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:09:47.755966 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f6bfca7f-fad4-4bb2-8041-435de7523ddd tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:09:47.756459 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f6bfca7f-fad4-4bb2-8041-435de7523ddd tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:09:47.828360 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-f6bfca7f-fad4-4bb2-8041-435de7523ddd tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091349 Dec 16 15:09:47.829009 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 782/1570] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:09:47 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:09:48.845343 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-e8993caa-9581-4fbf-a672-6b0f0290cdcf tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:09:48.846958 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-e8993caa-9581-4fbf-a672-6b0f0290cdcf tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:09:48.854883 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e8993caa-9581-4fbf-a672-6b0f0290cdcf tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:09:48.855384 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e8993caa-9581-4fbf-a672-6b0f0290cdcf tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:09:48.856217 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e8993caa-9581-4fbf-a672-6b0f0290cdcf tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:09:48.856709 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e8993caa-9581-4fbf-a672-6b0f0290cdcf tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:09:48.929027 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-e8993caa-9581-4fbf-a672-6b0f0290cdcf tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091484 Dec 16 15:09:48.929638 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 789/1571] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:09:48 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:09:49.946141 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-8204b38c-24aa-4a62-b9a4-7f3a905f55bd tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:09:49.947196 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-8204b38c-24aa-4a62-b9a4-7f3a905f55bd tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:09:49.955187 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8204b38c-24aa-4a62-b9a4-7f3a905f55bd tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:09:49.955583 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8204b38c-24aa-4a62-b9a4-7f3a905f55bd tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:09:49.956429 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8204b38c-24aa-4a62-b9a4-7f3a905f55bd tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:09:49.956927 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8204b38c-24aa-4a62-b9a4-7f3a905f55bd tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:09:50.035887 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-8204b38c-24aa-4a62-b9a4-7f3a905f55bd tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.098467 Dec 16 15:09:50.036508 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 783/1572] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:09:49 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:09:51.055231 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-724f0fcd-c358-4b62-b1a9-2d49b1e83a4e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:09:51.055231 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-724f0fcd-c358-4b62-b1a9-2d49b1e83a4e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:09:51.061258 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-724f0fcd-c358-4b62-b1a9-2d49b1e83a4e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:09:51.061771 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-724f0fcd-c358-4b62-b1a9-2d49b1e83a4e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:09:51.062640 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-724f0fcd-c358-4b62-b1a9-2d49b1e83a4e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:09:51.063339 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-724f0fcd-c358-4b62-b1a9-2d49b1e83a4e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:09:51.135235 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-724f0fcd-c358-4b62-b1a9-2d49b1e83a4e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091021 Dec 16 15:09:51.135863 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 790/1573] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:09:51 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:09:52.151174 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-e6da85d4-b4f3-4e3e-8e4a-0b975693a8d3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:09:52.152203 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-e6da85d4-b4f3-4e3e-8e4a-0b975693a8d3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:09:52.160027 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e6da85d4-b4f3-4e3e-8e4a-0b975693a8d3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:09:52.160531 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e6da85d4-b4f3-4e3e-8e4a-0b975693a8d3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:09:52.161365 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e6da85d4-b4f3-4e3e-8e4a-0b975693a8d3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:09:52.161851 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e6da85d4-b4f3-4e3e-8e4a-0b975693a8d3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:09:52.233058 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-e6da85d4-b4f3-4e3e-8e4a-0b975693a8d3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089447 Dec 16 15:09:52.233592 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 784/1574] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:09:52 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:09:53.250251 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-bc3a2fb6-b797-4841-a2f1-03b10b0e7c8b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:09:53.251222 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-bc3a2fb6-b797-4841-a2f1-03b10b0e7c8b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:09:53.263565 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-bc3a2fb6-b797-4841-a2f1-03b10b0e7c8b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:09:53.264389 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-bc3a2fb6-b797-4841-a2f1-03b10b0e7c8b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:09:53.265855 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-bc3a2fb6-b797-4841-a2f1-03b10b0e7c8b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:09:53.266782 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-bc3a2fb6-b797-4841-a2f1-03b10b0e7c8b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:09:53.343955 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-bc3a2fb6-b797-4841-a2f1-03b10b0e7c8b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.101518 Dec 16 15:09:53.344804 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 791/1575] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:09:53 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:09:54.362784 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-5982d209-70d3-4ce4-b19a-0916688cc083 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:09:54.365815 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-5982d209-70d3-4ce4-b19a-0916688cc083 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:09:54.372086 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5982d209-70d3-4ce4-b19a-0916688cc083 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:09:54.372723 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5982d209-70d3-4ce4-b19a-0916688cc083 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:09:54.373469 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5982d209-70d3-4ce4-b19a-0916688cc083 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:09:54.373971 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5982d209-70d3-4ce4-b19a-0916688cc083 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:09:54.449185 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-5982d209-70d3-4ce4-b19a-0916688cc083 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096402 Dec 16 15:09:54.449833 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 785/1576] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:09:54 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:09:55.465175 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-45a23b71-9509-4422-8d3a-c898dff58348 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:09:55.466295 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-45a23b71-9509-4422-8d3a-c898dff58348 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:09:55.474925 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-45a23b71-9509-4422-8d3a-c898dff58348 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:09:55.475437 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-45a23b71-9509-4422-8d3a-c898dff58348 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:09:55.476288 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-45a23b71-9509-4422-8d3a-c898dff58348 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:09:55.476806 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-45a23b71-9509-4422-8d3a-c898dff58348 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:09:55.551260 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-45a23b71-9509-4422-8d3a-c898dff58348 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093867 Dec 16 15:09:55.551912 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 792/1577] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:09:55 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:09:56.569197 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-0d38f7ef-106d-4e9a-8537-8f9b9ad9379a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:09:56.570201 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-0d38f7ef-106d-4e9a-8537-8f9b9ad9379a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:09:56.580880 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0d38f7ef-106d-4e9a-8537-8f9b9ad9379a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:09:56.581497 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0d38f7ef-106d-4e9a-8537-8f9b9ad9379a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:09:56.583124 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0d38f7ef-106d-4e9a-8537-8f9b9ad9379a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:09:56.583124 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0d38f7ef-106d-4e9a-8537-8f9b9ad9379a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:09:56.667547 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-0d38f7ef-106d-4e9a-8537-8f9b9ad9379a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.107592 Dec 16 15:09:56.668223 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 786/1578] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:09:56 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:09:57.684440 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-4dbc45f0-6bdb-4b83-8c52-530dcad6587e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:09:57.685490 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-4dbc45f0-6bdb-4b83-8c52-530dcad6587e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:09:57.695073 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4dbc45f0-6bdb-4b83-8c52-530dcad6587e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:09:57.695073 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4dbc45f0-6bdb-4b83-8c52-530dcad6587e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:09:57.696304 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4dbc45f0-6bdb-4b83-8c52-530dcad6587e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:09:57.696304 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4dbc45f0-6bdb-4b83-8c52-530dcad6587e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:09:57.768678 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-4dbc45f0-6bdb-4b83-8c52-530dcad6587e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092043 Dec 16 15:09:57.769313 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 793/1579] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:09:57 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:09:58.786609 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-26a7e205-2006-4c22-a488-6531d260e5eb tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:09:58.787536 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-26a7e205-2006-4c22-a488-6531d260e5eb tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:09:58.795516 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-26a7e205-2006-4c22-a488-6531d260e5eb tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:09:58.796017 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-26a7e205-2006-4c22-a488-6531d260e5eb tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:09:58.796856 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-26a7e205-2006-4c22-a488-6531d260e5eb tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:09:58.797341 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-26a7e205-2006-4c22-a488-6531d260e5eb tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:09:58.875999 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-26a7e205-2006-4c22-a488-6531d260e5eb tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.098741 Dec 16 15:09:58.876655 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 787/1580] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:09:58 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:09:59.891677 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-69ebcbf5-6356-44ba-8917-5894332f5d56 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:09:59.892731 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-69ebcbf5-6356-44ba-8917-5894332f5d56 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:09:59.900713 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-69ebcbf5-6356-44ba-8917-5894332f5d56 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:09:59.901221 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-69ebcbf5-6356-44ba-8917-5894332f5d56 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:09:59.902091 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-69ebcbf5-6356-44ba-8917-5894332f5d56 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:09:59.902587 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-69ebcbf5-6356-44ba-8917-5894332f5d56 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:09:59.991424 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-69ebcbf5-6356-44ba-8917-5894332f5d56 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.107484 Dec 16 15:09:59.992060 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 794/1581] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:09:59 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:10:01.008076 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-e6d483f3-b304-4e3e-9200-891a5902d752 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:10:01.009187 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-e6d483f3-b304-4e3e-9200-891a5902d752 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:10:01.017274 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e6d483f3-b304-4e3e-9200-891a5902d752 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:10:01.017792 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e6d483f3-b304-4e3e-9200-891a5902d752 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:10:01.019196 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e6d483f3-b304-4e3e-9200-891a5902d752 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:10:01.019694 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e6d483f3-b304-4e3e-9200-891a5902d752 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:10:01.092861 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-e6d483f3-b304-4e3e-9200-891a5902d752 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092797 Dec 16 15:10:01.093488 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 788/1582] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:10:00 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:10:02.109525 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-cd84253e-4889-466a-823b-e2e2803aee79 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:10:02.110617 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-cd84253e-4889-466a-823b-e2e2803aee79 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:10:02.119384 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cd84253e-4889-466a-823b-e2e2803aee79 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:10:02.119893 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cd84253e-4889-466a-823b-e2e2803aee79 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:10:02.120758 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cd84253e-4889-466a-823b-e2e2803aee79 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:10:02.121245 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cd84253e-4889-466a-823b-e2e2803aee79 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:10:02.200128 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-cd84253e-4889-466a-823b-e2e2803aee79 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.098656 Dec 16 15:10:02.200757 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 795/1583] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:10:02 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:10:03.216624 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-cfce5b75-3582-4d77-b626-c6e031561026 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:10:03.217561 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-cfce5b75-3582-4d77-b626-c6e031561026 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:10:03.225789 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cfce5b75-3582-4d77-b626-c6e031561026 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:10:03.226322 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cfce5b75-3582-4d77-b626-c6e031561026 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:10:03.227168 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cfce5b75-3582-4d77-b626-c6e031561026 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:10:03.227655 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cfce5b75-3582-4d77-b626-c6e031561026 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:10:03.302233 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-cfce5b75-3582-4d77-b626-c6e031561026 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093601 Dec 16 15:10:03.302872 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 789/1584] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:10:03 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:10:04.318934 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-ea9f2912-8fb1-4e1a-85bb-2200219f6184 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:10:04.319906 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-ea9f2912-8fb1-4e1a-85bb-2200219f6184 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:10:04.327958 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ea9f2912-8fb1-4e1a-85bb-2200219f6184 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:10:04.328464 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ea9f2912-8fb1-4e1a-85bb-2200219f6184 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:10:04.329312 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ea9f2912-8fb1-4e1a-85bb-2200219f6184 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:10:04.329864 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ea9f2912-8fb1-4e1a-85bb-2200219f6184 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:10:04.403693 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-ea9f2912-8fb1-4e1a-85bb-2200219f6184 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092979 Dec 16 15:10:04.404331 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 796/1585] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:10:04 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:10:05.424133 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-857f42ff-a9a8-43bf-8d3b-e476b758df89 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:10:05.425327 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-857f42ff-a9a8-43bf-8d3b-e476b758df89 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:10:05.434271 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-857f42ff-a9a8-43bf-8d3b-e476b758df89 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:10:05.434880 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-857f42ff-a9a8-43bf-8d3b-e476b758df89 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:10:05.435836 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-857f42ff-a9a8-43bf-8d3b-e476b758df89 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:10:05.436332 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-857f42ff-a9a8-43bf-8d3b-e476b758df89 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:10:05.512548 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-857f42ff-a9a8-43bf-8d3b-e476b758df89 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097136 Dec 16 15:10:05.513180 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 790/1586] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:10:05 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:10:06.528799 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-dfe928ac-58bd-47e5-806a-b443a576a956 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:10:06.529895 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-dfe928ac-58bd-47e5-806a-b443a576a956 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:10:06.538574 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-dfe928ac-58bd-47e5-806a-b443a576a956 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:10:06.539071 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-dfe928ac-58bd-47e5-806a-b443a576a956 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:10:06.539919 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-dfe928ac-58bd-47e5-806a-b443a576a956 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:10:06.540401 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-dfe928ac-58bd-47e5-806a-b443a576a956 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:10:06.614316 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-dfe928ac-58bd-47e5-806a-b443a576a956 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093126 Dec 16 15:10:06.614799 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 797/1587] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:10:06 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:10:07.630562 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-e77273e3-fe9c-4db8-91e0-5007439b4173 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:10:07.631661 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-e77273e3-fe9c-4db8-91e0-5007439b4173 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:10:07.640032 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e77273e3-fe9c-4db8-91e0-5007439b4173 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:10:07.640542 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e77273e3-fe9c-4db8-91e0-5007439b4173 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:10:07.641404 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e77273e3-fe9c-4db8-91e0-5007439b4173 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:10:07.641902 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e77273e3-fe9c-4db8-91e0-5007439b4173 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:10:07.725024 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-e77273e3-fe9c-4db8-91e0-5007439b4173 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.102295 Dec 16 15:10:07.725660 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 791/1588] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:10:07 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:10:08.741879 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-5cfe0adc-00a9-4d74-b389-b3d67d455797 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:10:08.742979 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-5cfe0adc-00a9-4d74-b389-b3d67d455797 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:10:08.750914 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5cfe0adc-00a9-4d74-b389-b3d67d455797 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:10:08.751419 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5cfe0adc-00a9-4d74-b389-b3d67d455797 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:10:08.752259 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5cfe0adc-00a9-4d74-b389-b3d67d455797 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:10:08.752780 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5cfe0adc-00a9-4d74-b389-b3d67d455797 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:10:08.825406 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-5cfe0adc-00a9-4d74-b389-b3d67d455797 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091888 Dec 16 15:10:08.826081 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 798/1589] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:10:08 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:10:09.842272 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-b068453c-2b52-4c1f-a38b-f5b74741c467 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:10:09.843351 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-b068453c-2b52-4c1f-a38b-f5b74741c467 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:10:09.852058 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b068453c-2b52-4c1f-a38b-f5b74741c467 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:10:09.852566 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b068453c-2b52-4c1f-a38b-f5b74741c467 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:10:09.853422 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b068453c-2b52-4c1f-a38b-f5b74741c467 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:10:09.853920 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b068453c-2b52-4c1f-a38b-f5b74741c467 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:10:09.928046 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-b068453c-2b52-4c1f-a38b-f5b74741c467 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093473 Dec 16 15:10:09.928876 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 792/1590] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:10:09 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:10:10.944938 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-eaabd2ff-1038-49fb-9744-c84fdd9f9abe tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:10:10.945998 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-eaabd2ff-1038-49fb-9744-c84fdd9f9abe tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:10:10.954188 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-eaabd2ff-1038-49fb-9744-c84fdd9f9abe tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:10:10.954706 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-eaabd2ff-1038-49fb-9744-c84fdd9f9abe tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:10:10.956119 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-eaabd2ff-1038-49fb-9744-c84fdd9f9abe tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:10:10.958630 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-eaabd2ff-1038-49fb-9744-c84fdd9f9abe tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:10:11.038852 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-eaabd2ff-1038-49fb-9744-c84fdd9f9abe tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.101827 Dec 16 15:10:11.039823 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 799/1591] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:10:10 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:10:12.056519 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-0e13eb51-cceb-42fe-8994-12003412fe11 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:10:12.057508 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-0e13eb51-cceb-42fe-8994-12003412fe11 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:10:12.066243 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0e13eb51-cceb-42fe-8994-12003412fe11 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:10:12.066757 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0e13eb51-cceb-42fe-8994-12003412fe11 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:10:12.067621 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0e13eb51-cceb-42fe-8994-12003412fe11 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:10:12.068120 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0e13eb51-cceb-42fe-8994-12003412fe11 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:10:12.142176 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-0e13eb51-cceb-42fe-8994-12003412fe11 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094330 Dec 16 15:10:12.142820 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 793/1592] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:10:12 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 15:10:13.160427 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-ac74888d-05cb-4620-a033-e12b2b764eb8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:10:13.161490 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-ac74888d-05cb-4620-a033-e12b2b764eb8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:10:13.170063 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ac74888d-05cb-4620-a033-e12b2b764eb8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:10:13.170593 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ac74888d-05cb-4620-a033-e12b2b764eb8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:10:13.171476 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ac74888d-05cb-4620-a033-e12b2b764eb8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:10:13.171974 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ac74888d-05cb-4620-a033-e12b2b764eb8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:10:13.248719 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-ac74888d-05cb-4620-a033-e12b2b764eb8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096643 Dec 16 15:10:13.249357 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 800/1593] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:10:13 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:10:14.265272 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-29bc4929-5be6-4829-b350-de349bb7cab8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:10:14.266399 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-29bc4929-5be6-4829-b350-de349bb7cab8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:10:14.275152 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-29bc4929-5be6-4829-b350-de349bb7cab8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:10:14.275689 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-29bc4929-5be6-4829-b350-de349bb7cab8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:10:14.276528 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-29bc4929-5be6-4829-b350-de349bb7cab8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:10:14.277022 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-29bc4929-5be6-4829-b350-de349bb7cab8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:10:14.352425 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-29bc4929-5be6-4829-b350-de349bb7cab8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095209 Dec 16 15:10:14.353307 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 794/1594] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:10:14 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:10:15.371943 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-afef9f34-8351-4a6b-bc08-87179c8db52b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:10:15.373001 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-afef9f34-8351-4a6b-bc08-87179c8db52b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:10:15.381490 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-afef9f34-8351-4a6b-bc08-87179c8db52b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:10:15.381993 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-afef9f34-8351-4a6b-bc08-87179c8db52b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:10:15.382905 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-afef9f34-8351-4a6b-bc08-87179c8db52b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:10:15.383393 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-afef9f34-8351-4a6b-bc08-87179c8db52b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:10:15.465498 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-afef9f34-8351-4a6b-bc08-87179c8db52b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.104170 Dec 16 15:10:15.466174 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 801/1595] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:10:15 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:10:16.481357 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-e9822c38-0498-40f7-bc48-a915e9350e1b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:10:16.482429 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-e9822c38-0498-40f7-bc48-a915e9350e1b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:10:16.493238 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e9822c38-0498-40f7-bc48-a915e9350e1b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:10:16.494016 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e9822c38-0498-40f7-bc48-a915e9350e1b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:10:16.495402 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e9822c38-0498-40f7-bc48-a915e9350e1b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:10:16.496228 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e9822c38-0498-40f7-bc48-a915e9350e1b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:10:16.594697 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-e9822c38-0498-40f7-bc48-a915e9350e1b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.121279 Dec 16 15:10:16.595338 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 795/1596] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:10:16 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:10:17.612277 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-39acf972-3d9c-4924-ba1a-4720d45dc38c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:10:17.613326 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-39acf972-3d9c-4924-ba1a-4720d45dc38c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:10:17.621484 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-39acf972-3d9c-4924-ba1a-4720d45dc38c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:10:17.621988 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-39acf972-3d9c-4924-ba1a-4720d45dc38c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:10:17.622871 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-39acf972-3d9c-4924-ba1a-4720d45dc38c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:10:17.623353 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-39acf972-3d9c-4924-ba1a-4720d45dc38c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:10:17.697523 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-39acf972-3d9c-4924-ba1a-4720d45dc38c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093513 Dec 16 15:10:17.698106 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 802/1597] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:10:17 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:10:18.714424 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-fab80b59-52bf-4ce9-a69d-5ef55b5ccd4e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:10:18.715472 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-fab80b59-52bf-4ce9-a69d-5ef55b5ccd4e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:10:18.723495 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fab80b59-52bf-4ce9-a69d-5ef55b5ccd4e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:10:18.724002 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fab80b59-52bf-4ce9-a69d-5ef55b5ccd4e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:10:18.724847 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fab80b59-52bf-4ce9-a69d-5ef55b5ccd4e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:10:18.725339 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fab80b59-52bf-4ce9-a69d-5ef55b5ccd4e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:10:18.835835 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-fab80b59-52bf-4ce9-a69d-5ef55b5ccd4e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.129789 Dec 16 15:10:18.837012 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 796/1598] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:10:18 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:10:19.853250 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-84708a1e-1347-4ba6-af30-4c361b02777a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:10:19.854324 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-84708a1e-1347-4ba6-af30-4c361b02777a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:10:19.862176 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-84708a1e-1347-4ba6-af30-4c361b02777a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:10:19.862668 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-84708a1e-1347-4ba6-af30-4c361b02777a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:10:19.863516 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-84708a1e-1347-4ba6-af30-4c361b02777a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:10:19.864013 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-84708a1e-1347-4ba6-af30-4c361b02777a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:10:19.940563 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-84708a1e-1347-4ba6-af30-4c361b02777a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095635 Dec 16 15:10:19.941193 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 803/1599] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:10:19 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:10:20.957443 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-b12fbdf9-8513-4cdd-8d0b-36385f083175 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:10:20.958514 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-b12fbdf9-8513-4cdd-8d0b-36385f083175 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:10:20.966485 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b12fbdf9-8513-4cdd-8d0b-36385f083175 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:10:20.966992 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b12fbdf9-8513-4cdd-8d0b-36385f083175 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:10:20.967839 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b12fbdf9-8513-4cdd-8d0b-36385f083175 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:10:20.968335 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b12fbdf9-8513-4cdd-8d0b-36385f083175 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:10:21.042147 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-b12fbdf9-8513-4cdd-8d0b-36385f083175 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093187 Dec 16 15:10:21.042776 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 797/1600] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:10:20 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:10:22.058402 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-b3c0e3fa-166c-4da1-af7e-ac6deb258887 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:10:22.059583 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-b3c0e3fa-166c-4da1-af7e-ac6deb258887 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:10:22.067859 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b3c0e3fa-166c-4da1-af7e-ac6deb258887 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:10:22.068367 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b3c0e3fa-166c-4da1-af7e-ac6deb258887 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:10:22.069261 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b3c0e3fa-166c-4da1-af7e-ac6deb258887 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:10:22.069762 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b3c0e3fa-166c-4da1-af7e-ac6deb258887 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:10:22.142129 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-b3c0e3fa-166c-4da1-af7e-ac6deb258887 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091584 Dec 16 15:10:22.143278 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 804/1601] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:10:22 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:10:23.158909 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-8bc96396-316f-403b-8a97-1b2511b281c0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:10:23.160006 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-8bc96396-316f-403b-8a97-1b2511b281c0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:10:23.168084 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8bc96396-316f-403b-8a97-1b2511b281c0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:10:23.168588 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8bc96396-316f-403b-8a97-1b2511b281c0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:10:23.169448 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8bc96396-316f-403b-8a97-1b2511b281c0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:10:23.169944 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8bc96396-316f-403b-8a97-1b2511b281c0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:10:23.241167 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-8bc96396-316f-403b-8a97-1b2511b281c0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090123 Dec 16 15:10:23.241792 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 798/1602] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:10:23 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:10:24.257512 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-c850e70d-e401-433e-816e-0c8f63275aa7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:10:24.258573 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-c850e70d-e401-433e-816e-0c8f63275aa7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:10:24.266515 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c850e70d-e401-433e-816e-0c8f63275aa7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:10:24.267018 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c850e70d-e401-433e-816e-0c8f63275aa7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:10:24.268529 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c850e70d-e401-433e-816e-0c8f63275aa7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:10:24.269014 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c850e70d-e401-433e-816e-0c8f63275aa7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:10:24.343834 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-c850e70d-e401-433e-816e-0c8f63275aa7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094215 Dec 16 15:10:24.344686 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 805/1603] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:10:24 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:10:25.360049 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-eaa845ad-d484-46f7-8348-5f71b08ec00d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:10:25.361103 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-eaa845ad-d484-46f7-8348-5f71b08ec00d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:10:25.369168 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-eaa845ad-d484-46f7-8348-5f71b08ec00d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:10:25.369683 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-eaa845ad-d484-46f7-8348-5f71b08ec00d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:10:25.370570 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-eaa845ad-d484-46f7-8348-5f71b08ec00d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:10:25.371094 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-eaa845ad-d484-46f7-8348-5f71b08ec00d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:10:25.447444 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-eaa845ad-d484-46f7-8348-5f71b08ec00d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095138 Dec 16 15:10:25.448075 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 799/1604] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:10:25 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:10:26.463900 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-7ed49a3a-1add-40b3-a8eb-483f52fd6848 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:10:26.464945 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-7ed49a3a-1add-40b3-a8eb-483f52fd6848 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:10:26.468247 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 15:10:26.468414 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: Thu Dec 16 15:10:26 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments (ip 10.222.0.45) !!! Dec 16 15:10:26.489361 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7ed49a3a-1add-40b3-a8eb-483f52fd6848 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:10:26.489864 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7ed49a3a-1add-40b3-a8eb-483f52fd6848 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:10:26.490732 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7ed49a3a-1add-40b3-a8eb-483f52fd6848 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:10:26.491216 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7ed49a3a-1add-40b3-a8eb-483f52fd6848 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:10:26.562841 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-7ed49a3a-1add-40b3-a8eb-483f52fd6848 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.106600 Dec 16 15:10:26.563467 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 806/1605] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:10:26 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:10:27.579420 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-a26c74dc-8fa6-485c-9827-fe234bc329c1 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:10:27.580508 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-a26c74dc-8fa6-485c-9827-fe234bc329c1 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:10:27.588518 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a26c74dc-8fa6-485c-9827-fe234bc329c1 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:10:27.589027 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a26c74dc-8fa6-485c-9827-fe234bc329c1 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:10:27.589886 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a26c74dc-8fa6-485c-9827-fe234bc329c1 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:10:27.590406 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a26c74dc-8fa6-485c-9827-fe234bc329c1 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:10:27.664303 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-a26c74dc-8fa6-485c-9827-fe234bc329c1 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092648 Dec 16 15:10:27.664861 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 800/1606] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:10:27 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:10:28.962923 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-cf9679cc-0fef-47cc-9a53-0ab3043d1093 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:10:28.963959 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-cf9679cc-0fef-47cc-9a53-0ab3043d1093 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:10:28.972484 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cf9679cc-0fef-47cc-9a53-0ab3043d1093 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:10:28.972983 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cf9679cc-0fef-47cc-9a53-0ab3043d1093 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:10:28.973819 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cf9679cc-0fef-47cc-9a53-0ab3043d1093 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:10:28.974331 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cf9679cc-0fef-47cc-9a53-0ab3043d1093 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:10:29.049335 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-cf9679cc-0fef-47cc-9a53-0ab3043d1093 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.376627 Dec 16 15:10:29.049969 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 807/1607] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:10:28 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:10:30.066348 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-7e48cbb1-1ac5-4bb6-8c30-42e20d81e009 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:10:30.067412 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-7e48cbb1-1ac5-4bb6-8c30-42e20d81e009 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:10:30.075936 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7e48cbb1-1ac5-4bb6-8c30-42e20d81e009 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:10:30.076452 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7e48cbb1-1ac5-4bb6-8c30-42e20d81e009 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:10:30.077312 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7e48cbb1-1ac5-4bb6-8c30-42e20d81e009 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:10:30.077811 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7e48cbb1-1ac5-4bb6-8c30-42e20d81e009 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:10:30.152752 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-7e48cbb1-1ac5-4bb6-8c30-42e20d81e009 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094673 Dec 16 15:10:30.153630 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 801/1608] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:10:30 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:10:31.169417 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-7ea7da5b-a497-485c-a5cb-4eb42544401d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:10:31.170521 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-7ea7da5b-a497-485c-a5cb-4eb42544401d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:10:31.178770 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7ea7da5b-a497-485c-a5cb-4eb42544401d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:10:31.179269 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7ea7da5b-a497-485c-a5cb-4eb42544401d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:10:31.180097 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7ea7da5b-a497-485c-a5cb-4eb42544401d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:10:31.180585 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7ea7da5b-a497-485c-a5cb-4eb42544401d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:10:31.264653 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-7ea7da5b-a497-485c-a5cb-4eb42544401d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.102974 Dec 16 15:10:31.265284 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 808/1609] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:10:31 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:10:32.281068 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-ee73978d-4907-43d7-a1ef-0507563d076c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:10:32.282138 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-ee73978d-4907-43d7-a1ef-0507563d076c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:10:32.290142 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ee73978d-4907-43d7-a1ef-0507563d076c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:10:32.290657 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ee73978d-4907-43d7-a1ef-0507563d076c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:10:32.291504 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ee73978d-4907-43d7-a1ef-0507563d076c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:10:32.292001 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ee73978d-4907-43d7-a1ef-0507563d076c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:10:32.368466 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-ee73978d-4907-43d7-a1ef-0507563d076c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095239 Dec 16 15:10:32.369245 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 802/1610] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:10:32 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:10:33.385803 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-d33ea095-6d8a-4aa8-a1a9-a2d71f0071fb tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:10:33.386877 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-d33ea095-6d8a-4aa8-a1a9-a2d71f0071fb tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:10:33.389979 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 15:10:33.390182 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: Thu Dec 16 15:10:33 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments (ip 10.222.0.45) !!! Dec 16 15:10:33.406189 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d33ea095-6d8a-4aa8-a1a9-a2d71f0071fb tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:10:33.406712 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d33ea095-6d8a-4aa8-a1a9-a2d71f0071fb tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:10:33.407536 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d33ea095-6d8a-4aa8-a1a9-a2d71f0071fb tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:10:33.408027 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d33ea095-6d8a-4aa8-a1a9-a2d71f0071fb tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:10:33.481130 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-d33ea095-6d8a-4aa8-a1a9-a2d71f0071fb tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.104203 Dec 16 15:10:33.481761 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 809/1611] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:10:33 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:10:34.497656 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-c868606e-24ac-4640-9bbe-0ab395af843a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:10:34.498721 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-c868606e-24ac-4640-9bbe-0ab395af843a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:10:34.506629 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c868606e-24ac-4640-9bbe-0ab395af843a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:10:34.507134 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c868606e-24ac-4640-9bbe-0ab395af843a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:10:34.507965 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c868606e-24ac-4640-9bbe-0ab395af843a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:10:34.508453 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c868606e-24ac-4640-9bbe-0ab395af843a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:10:34.583078 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-c868606e-24ac-4640-9bbe-0ab395af843a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093356 Dec 16 15:10:34.583696 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 803/1612] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:10:34 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:10:35.599098 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-787e756c-da63-467c-859f-d86c5c0f7b68 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:10:35.600152 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-787e756c-da63-467c-859f-d86c5c0f7b68 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:10:35.607997 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-787e756c-da63-467c-859f-d86c5c0f7b68 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:10:35.608503 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-787e756c-da63-467c-859f-d86c5c0f7b68 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:10:35.609346 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-787e756c-da63-467c-859f-d86c5c0f7b68 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:10:35.609836 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-787e756c-da63-467c-859f-d86c5c0f7b68 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:10:35.684755 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-787e756c-da63-467c-859f-d86c5c0f7b68 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093474 Dec 16 15:10:35.685377 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 810/1613] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:10:35 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:10:36.700821 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-176e0aed-5b4d-459f-90bb-ef288b2cff4d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:10:36.701791 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-176e0aed-5b4d-459f-90bb-ef288b2cff4d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:10:36.710615 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-176e0aed-5b4d-459f-90bb-ef288b2cff4d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:10:36.711123 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-176e0aed-5b4d-459f-90bb-ef288b2cff4d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:10:36.711967 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-176e0aed-5b4d-459f-90bb-ef288b2cff4d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:10:36.712458 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-176e0aed-5b4d-459f-90bb-ef288b2cff4d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:10:36.784905 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-176e0aed-5b4d-459f-90bb-ef288b2cff4d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091867 Dec 16 15:10:36.785535 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 804/1614] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:10:36 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:10:37.801641 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-b72f76da-3697-4e4a-a0fc-c3d2b9cb1e39 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:10:37.802632 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-b72f76da-3697-4e4a-a0fc-c3d2b9cb1e39 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:10:37.810505 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b72f76da-3697-4e4a-a0fc-c3d2b9cb1e39 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:10:37.811006 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b72f76da-3697-4e4a-a0fc-c3d2b9cb1e39 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:10:37.811843 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b72f76da-3697-4e4a-a0fc-c3d2b9cb1e39 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:10:37.812329 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b72f76da-3697-4e4a-a0fc-c3d2b9cb1e39 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:10:37.884255 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-b72f76da-3697-4e4a-a0fc-c3d2b9cb1e39 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090964 Dec 16 15:10:37.884882 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 811/1615] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:10:37 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:10:38.900825 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-6439567c-7fab-44b3-ad21-914f8b5be887 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:10:38.901919 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-6439567c-7fab-44b3-ad21-914f8b5be887 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:10:38.909812 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6439567c-7fab-44b3-ad21-914f8b5be887 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:10:38.910360 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6439567c-7fab-44b3-ad21-914f8b5be887 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:10:38.911205 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6439567c-7fab-44b3-ad21-914f8b5be887 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:10:38.911704 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6439567c-7fab-44b3-ad21-914f8b5be887 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:10:38.983789 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-6439567c-7fab-44b3-ad21-914f8b5be887 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091419 Dec 16 15:10:38.984392 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 805/1616] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:10:38 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:10:40.000022 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-d9bb2313-5d36-42a8-8360-aa05f6696536 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:10:40.001122 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-d9bb2313-5d36-42a8-8360-aa05f6696536 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:10:40.009795 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d9bb2313-5d36-42a8-8360-aa05f6696536 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:10:40.010367 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d9bb2313-5d36-42a8-8360-aa05f6696536 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:10:40.011223 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d9bb2313-5d36-42a8-8360-aa05f6696536 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:10:40.011722 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d9bb2313-5d36-42a8-8360-aa05f6696536 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:10:40.084318 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-d9bb2313-5d36-42a8-8360-aa05f6696536 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092050 Dec 16 15:10:40.084943 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 812/1617] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:10:39 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 15:10:41.100654 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-92ed0774-34d9-48de-a463-a7f8a609e73c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:10:41.101710 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-92ed0774-34d9-48de-a463-a7f8a609e73c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:10:41.109570 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-92ed0774-34d9-48de-a463-a7f8a609e73c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:10:41.110106 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-92ed0774-34d9-48de-a463-a7f8a609e73c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:10:41.110955 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-92ed0774-34d9-48de-a463-a7f8a609e73c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:10:41.111451 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-92ed0774-34d9-48de-a463-a7f8a609e73c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:10:41.183040 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-92ed0774-34d9-48de-a463-a7f8a609e73c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090438 Dec 16 15:10:41.183762 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 806/1618] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:10:41 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:10:42.199409 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-ccbaf646-79b9-4d08-85d5-ac1f89f7fcdf tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:10:42.200449 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-ccbaf646-79b9-4d08-85d5-ac1f89f7fcdf tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:10:42.209091 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ccbaf646-79b9-4d08-85d5-ac1f89f7fcdf tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:10:42.209594 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ccbaf646-79b9-4d08-85d5-ac1f89f7fcdf tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:10:42.210449 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ccbaf646-79b9-4d08-85d5-ac1f89f7fcdf tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:10:42.210941 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ccbaf646-79b9-4d08-85d5-ac1f89f7fcdf tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:10:42.282500 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-ccbaf646-79b9-4d08-85d5-ac1f89f7fcdf tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090780 Dec 16 15:10:42.283706 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 813/1619] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:10:42 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:10:43.299078 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-cc59828d-f010-48b7-8f8c-f4c259f8b926 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:10:43.300053 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-cc59828d-f010-48b7-8f8c-f4c259f8b926 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:10:43.307836 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cc59828d-f010-48b7-8f8c-f4c259f8b926 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:10:43.308346 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cc59828d-f010-48b7-8f8c-f4c259f8b926 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:10:43.309186 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cc59828d-f010-48b7-8f8c-f4c259f8b926 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:10:43.309679 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cc59828d-f010-48b7-8f8c-f4c259f8b926 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:10:43.389041 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-cc59828d-f010-48b7-8f8c-f4c259f8b926 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.098010 Dec 16 15:10:43.389657 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 807/1620] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:10:43 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:10:44.405591 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-eb4321bb-5f2c-4f64-aebb-e1247d88606c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:10:44.406904 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-eb4321bb-5f2c-4f64-aebb-e1247d88606c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:10:44.414555 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-eb4321bb-5f2c-4f64-aebb-e1247d88606c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:10:44.415067 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-eb4321bb-5f2c-4f64-aebb-e1247d88606c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:10:44.415909 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-eb4321bb-5f2c-4f64-aebb-e1247d88606c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:10:44.416411 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-eb4321bb-5f2c-4f64-aebb-e1247d88606c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:10:44.490830 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-eb4321bb-5f2c-4f64-aebb-e1247d88606c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093637 Dec 16 15:10:44.491462 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 814/1621] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:10:44 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:10:45.507676 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-3dd2eca1-3ff5-481e-9fad-08d6ce5dedc1 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:10:45.508702 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-3dd2eca1-3ff5-481e-9fad-08d6ce5dedc1 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:10:45.516606 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3dd2eca1-3ff5-481e-9fad-08d6ce5dedc1 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:10:45.517819 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3dd2eca1-3ff5-481e-9fad-08d6ce5dedc1 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:10:45.518680 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3dd2eca1-3ff5-481e-9fad-08d6ce5dedc1 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:10:45.519173 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3dd2eca1-3ff5-481e-9fad-08d6ce5dedc1 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:10:45.590600 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-3dd2eca1-3ff5-481e-9fad-08d6ce5dedc1 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091404 Dec 16 15:10:45.591225 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 808/1622] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:10:45 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:10:46.606836 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-8389afb3-382c-4c4a-acec-f3e1f13c8ed7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:10:46.607981 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-8389afb3-382c-4c4a-acec-f3e1f13c8ed7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:10:46.616270 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8389afb3-382c-4c4a-acec-f3e1f13c8ed7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:10:46.616771 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8389afb3-382c-4c4a-acec-f3e1f13c8ed7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:10:46.617635 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8389afb3-382c-4c4a-acec-f3e1f13c8ed7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:10:46.618137 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8389afb3-382c-4c4a-acec-f3e1f13c8ed7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:10:46.690811 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-8389afb3-382c-4c4a-acec-f3e1f13c8ed7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091708 Dec 16 15:10:46.691438 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 815/1623] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:10:46 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:10:47.707868 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-8d21e714-6227-4936-afaf-02476ac3f7f3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:10:47.708834 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-8d21e714-6227-4936-afaf-02476ac3f7f3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:10:47.716761 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8d21e714-6227-4936-afaf-02476ac3f7f3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:10:47.717271 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8d21e714-6227-4936-afaf-02476ac3f7f3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:10:47.718153 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8d21e714-6227-4936-afaf-02476ac3f7f3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:10:47.718657 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8d21e714-6227-4936-afaf-02476ac3f7f3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:10:47.790636 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-8d21e714-6227-4936-afaf-02476ac3f7f3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091026 Dec 16 15:10:47.791266 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 809/1624] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:10:47 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:10:48.806670 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-1f1a1b5c-c0b1-4196-adf4-e4be37f15208 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:10:48.807701 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-1f1a1b5c-c0b1-4196-adf4-e4be37f15208 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:10:48.816806 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1f1a1b5c-c0b1-4196-adf4-e4be37f15208 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:10:48.817477 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1f1a1b5c-c0b1-4196-adf4-e4be37f15208 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:10:48.818366 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1f1a1b5c-c0b1-4196-adf4-e4be37f15208 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:10:48.819047 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1f1a1b5c-c0b1-4196-adf4-e4be37f15208 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:10:48.891944 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-1f1a1b5c-c0b1-4196-adf4-e4be37f15208 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093058 Dec 16 15:10:48.892747 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 816/1625] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:10:48 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:10:49.907904 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-6cf2bb5b-032a-4986-b9bf-f8d7940fd7b7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:10:49.908992 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-6cf2bb5b-032a-4986-b9bf-f8d7940fd7b7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:10:49.916935 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6cf2bb5b-032a-4986-b9bf-f8d7940fd7b7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:10:49.917441 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6cf2bb5b-032a-4986-b9bf-f8d7940fd7b7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:10:49.918315 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6cf2bb5b-032a-4986-b9bf-f8d7940fd7b7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:10:49.918814 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6cf2bb5b-032a-4986-b9bf-f8d7940fd7b7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:10:49.993304 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-6cf2bb5b-032a-4986-b9bf-f8d7940fd7b7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093388 Dec 16 15:10:49.993944 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 810/1626] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:10:49 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:10:51.009974 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-4cead666-c0d0-4387-849b-c51390b31ec0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:10:51.011051 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-4cead666-c0d0-4387-849b-c51390b31ec0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:10:51.019808 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4cead666-c0d0-4387-849b-c51390b31ec0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:10:51.020315 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4cead666-c0d0-4387-849b-c51390b31ec0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:10:51.021159 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4cead666-c0d0-4387-849b-c51390b31ec0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:10:51.021634 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4cead666-c0d0-4387-849b-c51390b31ec0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:10:51.093271 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-4cead666-c0d0-4387-849b-c51390b31ec0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091110 Dec 16 15:10:51.093892 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 817/1627] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:10:51 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:10:52.108993 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-5dfab4a9-5d1e-47b9-a513-c33e8406c203 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:10:52.110028 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-5dfab4a9-5d1e-47b9-a513-c33e8406c203 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:10:52.120311 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5dfab4a9-5d1e-47b9-a513-c33e8406c203 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:10:52.120817 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5dfab4a9-5d1e-47b9-a513-c33e8406c203 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:10:52.121665 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5dfab4a9-5d1e-47b9-a513-c33e8406c203 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:10:52.122183 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5dfab4a9-5d1e-47b9-a513-c33e8406c203 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:10:52.202694 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-5dfab4a9-5d1e-47b9-a513-c33e8406c203 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.101548 Dec 16 15:10:52.203320 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 811/1628] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:10:52 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:10:53.219400 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-217ece93-ad49-4969-abc9-23d923e7415c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:10:53.220519 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-217ece93-ad49-4969-abc9-23d923e7415c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:10:53.228373 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-217ece93-ad49-4969-abc9-23d923e7415c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:10:53.228880 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-217ece93-ad49-4969-abc9-23d923e7415c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:10:53.229720 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-217ece93-ad49-4969-abc9-23d923e7415c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:10:53.230259 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-217ece93-ad49-4969-abc9-23d923e7415c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:10:53.304977 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-217ece93-ad49-4969-abc9-23d923e7415c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093244 Dec 16 15:10:53.305812 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 818/1629] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:10:53 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:10:54.322642 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-c384d019-c0cf-4485-bbaf-14b5d026f909 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:10:54.323703 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-c384d019-c0cf-4485-bbaf-14b5d026f909 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:10:54.326892 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 15:10:54.327037 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: Thu Dec 16 15:10:54 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments (ip 10.222.0.45) !!! Dec 16 15:10:54.343522 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c384d019-c0cf-4485-bbaf-14b5d026f909 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:10:54.344032 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c384d019-c0cf-4485-bbaf-14b5d026f909 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:10:54.345482 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c384d019-c0cf-4485-bbaf-14b5d026f909 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:10:54.345985 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c384d019-c0cf-4485-bbaf-14b5d026f909 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:10:54.420516 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-c384d019-c0cf-4485-bbaf-14b5d026f909 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.106875 Dec 16 15:10:54.421144 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 812/1630] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:10:54 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:10:55.436401 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-59fd51bc-da24-4404-84f3-6e1cff0aed5a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:10:55.437440 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-59fd51bc-da24-4404-84f3-6e1cff0aed5a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:10:55.445607 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-59fd51bc-da24-4404-84f3-6e1cff0aed5a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:10:55.446162 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-59fd51bc-da24-4404-84f3-6e1cff0aed5a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:10:55.446999 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-59fd51bc-da24-4404-84f3-6e1cff0aed5a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:10:55.447490 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-59fd51bc-da24-4404-84f3-6e1cff0aed5a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:10:55.523734 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-59fd51bc-da24-4404-84f3-6e1cff0aed5a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095119 Dec 16 15:10:55.524482 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 819/1631] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:10:55 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:10:56.540966 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-de65b7f7-0f86-4188-805b-5364398587ed tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:10:56.542088 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-de65b7f7-0f86-4188-805b-5364398587ed tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:10:56.550591 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-de65b7f7-0f86-4188-805b-5364398587ed tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:10:56.551106 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-de65b7f7-0f86-4188-805b-5364398587ed tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:10:56.551955 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-de65b7f7-0f86-4188-805b-5364398587ed tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:10:56.552455 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-de65b7f7-0f86-4188-805b-5364398587ed tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:10:56.624086 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-de65b7f7-0f86-4188-805b-5364398587ed tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090864 Dec 16 15:10:56.624754 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 813/1632] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:10:56 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:10:57.641175 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-2c458bf4-8ef7-43e7-a6b5-df6e37c3582c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:10:57.642192 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-2c458bf4-8ef7-43e7-a6b5-df6e37c3582c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:10:57.650194 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2c458bf4-8ef7-43e7-a6b5-df6e37c3582c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:10:57.650700 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2c458bf4-8ef7-43e7-a6b5-df6e37c3582c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:10:57.651525 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2c458bf4-8ef7-43e7-a6b5-df6e37c3582c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:10:57.652010 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2c458bf4-8ef7-43e7-a6b5-df6e37c3582c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:10:57.724171 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-2c458bf4-8ef7-43e7-a6b5-df6e37c3582c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091382 Dec 16 15:10:57.724782 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 820/1633] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:10:57 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:10:58.739534 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-e0e30d7b-598f-4e59-941b-3bd084e2935f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:10:58.740576 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-e0e30d7b-598f-4e59-941b-3bd084e2935f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:10:58.748886 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e0e30d7b-598f-4e59-941b-3bd084e2935f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:10:58.749391 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e0e30d7b-598f-4e59-941b-3bd084e2935f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:10:58.750282 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e0e30d7b-598f-4e59-941b-3bd084e2935f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:10:58.750779 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e0e30d7b-598f-4e59-941b-3bd084e2935f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:10:58.831152 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-e0e30d7b-598f-4e59-941b-3bd084e2935f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.099442 Dec 16 15:10:58.831792 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 814/1634] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:10:58 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:10:59.847407 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-d3a670ba-752e-4f41-8850-d93ca96565f8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:10:59.848470 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-d3a670ba-752e-4f41-8850-d93ca96565f8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:10:59.856511 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d3a670ba-752e-4f41-8850-d93ca96565f8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:10:59.857022 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d3a670ba-752e-4f41-8850-d93ca96565f8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:10:59.857875 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d3a670ba-752e-4f41-8850-d93ca96565f8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:10:59.858426 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d3a670ba-752e-4f41-8850-d93ca96565f8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:10:59.932985 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-d3a670ba-752e-4f41-8850-d93ca96565f8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093852 Dec 16 15:10:59.933618 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 821/1635] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:10:59 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:11:00.949351 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-7bb8f458-3ae9-4d4d-b7fd-50aaef3e1444 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:11:00.950425 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-7bb8f458-3ae9-4d4d-b7fd-50aaef3e1444 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:11:00.959092 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7bb8f458-3ae9-4d4d-b7fd-50aaef3e1444 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:00.959608 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7bb8f458-3ae9-4d4d-b7fd-50aaef3e1444 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:00.960462 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7bb8f458-3ae9-4d4d-b7fd-50aaef3e1444 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:00.960958 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7bb8f458-3ae9-4d4d-b7fd-50aaef3e1444 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:01.036207 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-7bb8f458-3ae9-4d4d-b7fd-50aaef3e1444 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094644 Dec 16 15:11:01.036950 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 815/1636] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:11:00 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:11:02.053037 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-3813976e-9225-4a0a-af80-f7fdff7ce98d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:11:02.054097 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-3813976e-9225-4a0a-af80-f7fdff7ce98d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:11:02.061958 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3813976e-9225-4a0a-af80-f7fdff7ce98d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:02.062492 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3813976e-9225-4a0a-af80-f7fdff7ce98d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:02.063335 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3813976e-9225-4a0a-af80-f7fdff7ce98d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:02.064095 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3813976e-9225-4a0a-af80-f7fdff7ce98d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:02.140028 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-3813976e-9225-4a0a-af80-f7fdff7ce98d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095500 Dec 16 15:11:02.140627 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 822/1637] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:11:02 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:11:03.155020 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-7c4e40bb-86e2-4c2f-85d4-12ec3f0a4f4d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:11:03.156079 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-7c4e40bb-86e2-4c2f-85d4-12ec3f0a4f4d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:11:03.164073 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7c4e40bb-86e2-4c2f-85d4-12ec3f0a4f4d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:03.164591 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7c4e40bb-86e2-4c2f-85d4-12ec3f0a4f4d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:03.165530 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7c4e40bb-86e2-4c2f-85d4-12ec3f0a4f4d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:03.165950 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7c4e40bb-86e2-4c2f-85d4-12ec3f0a4f4d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:03.239230 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-7c4e40bb-86e2-4c2f-85d4-12ec3f0a4f4d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092011 Dec 16 15:11:03.239871 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 816/1638] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:11:03 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:11:04.255687 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-9bf87e4c-eea1-46e0-8712-35cf55e649a7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:11:04.256971 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-9bf87e4c-eea1-46e0-8712-35cf55e649a7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:11:04.265111 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9bf87e4c-eea1-46e0-8712-35cf55e649a7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:04.265627 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9bf87e4c-eea1-46e0-8712-35cf55e649a7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:04.266517 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9bf87e4c-eea1-46e0-8712-35cf55e649a7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:04.267149 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9bf87e4c-eea1-46e0-8712-35cf55e649a7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:04.342534 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-9bf87e4c-eea1-46e0-8712-35cf55e649a7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095064 Dec 16 15:11:04.343181 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 823/1639] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:11:04 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:11:05.359167 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-21ae8fa2-817e-4a60-ad65-2d789901b26c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:11:05.360228 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-21ae8fa2-817e-4a60-ad65-2d789901b26c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:11:05.369157 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-21ae8fa2-817e-4a60-ad65-2d789901b26c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:05.369878 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-21ae8fa2-817e-4a60-ad65-2d789901b26c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:05.371083 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-21ae8fa2-817e-4a60-ad65-2d789901b26c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:05.371857 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-21ae8fa2-817e-4a60-ad65-2d789901b26c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:05.449503 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-21ae8fa2-817e-4a60-ad65-2d789901b26c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.098138 Dec 16 15:11:05.450208 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 817/1640] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:11:05 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:11:06.465968 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-17caadf0-825c-463d-b3a5-532a274e0c47 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:11:06.467042 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-17caadf0-825c-463d-b3a5-532a274e0c47 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:11:06.475548 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-17caadf0-825c-463d-b3a5-532a274e0c47 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:06.476052 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-17caadf0-825c-463d-b3a5-532a274e0c47 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:06.476903 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-17caadf0-825c-463d-b3a5-532a274e0c47 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:06.477395 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-17caadf0-825c-463d-b3a5-532a274e0c47 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:06.550453 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-17caadf0-825c-463d-b3a5-532a274e0c47 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092307 Dec 16 15:11:06.551081 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 824/1641] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:11:06 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:11:07.566692 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-37238a14-e58a-4693-bc06-e4cb702f2670 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:11:07.567729 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-37238a14-e58a-4693-bc06-e4cb702f2670 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:11:07.575712 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-37238a14-e58a-4693-bc06-e4cb702f2670 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:07.576218 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-37238a14-e58a-4693-bc06-e4cb702f2670 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:07.577065 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-37238a14-e58a-4693-bc06-e4cb702f2670 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:07.577554 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-37238a14-e58a-4693-bc06-e4cb702f2670 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:07.666099 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-37238a14-e58a-4693-bc06-e4cb702f2670 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.107565 Dec 16 15:11:07.666723 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 818/1642] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:11:07 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:11:08.682134 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-9d66f61b-0b9d-444d-a299-1b8e8c5fca2a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:11:08.683190 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-9d66f61b-0b9d-444d-a299-1b8e8c5fca2a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:11:08.692385 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9d66f61b-0b9d-444d-a299-1b8e8c5fca2a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:08.692885 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9d66f61b-0b9d-444d-a299-1b8e8c5fca2a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:08.693730 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9d66f61b-0b9d-444d-a299-1b8e8c5fca2a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:08.694295 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9d66f61b-0b9d-444d-a299-1b8e8c5fca2a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:08.765752 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-9d66f61b-0b9d-444d-a299-1b8e8c5fca2a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091535 Dec 16 15:11:08.766405 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 825/1643] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:11:08 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:11:09.781580 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-1bfed71a-086b-479f-837b-cdad77bfa901 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:11:09.782656 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-1bfed71a-086b-479f-837b-cdad77bfa901 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:11:09.791067 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1bfed71a-086b-479f-837b-cdad77bfa901 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:09.791585 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1bfed71a-086b-479f-837b-cdad77bfa901 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:09.792433 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1bfed71a-086b-479f-837b-cdad77bfa901 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:09.792931 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1bfed71a-086b-479f-837b-cdad77bfa901 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:09.868255 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-1bfed71a-086b-479f-837b-cdad77bfa901 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094508 Dec 16 15:11:09.868984 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 819/1644] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:11:09 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:11:10.884356 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-9f809f69-2329-47ad-9474-036bebb585d3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:11:10.885427 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-9f809f69-2329-47ad-9474-036bebb585d3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:11:10.893808 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9f809f69-2329-47ad-9474-036bebb585d3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:10.894677 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9f809f69-2329-47ad-9474-036bebb585d3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:10.895530 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9f809f69-2329-47ad-9474-036bebb585d3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:10.896017 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9f809f69-2329-47ad-9474-036bebb585d3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:10.977930 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-9f809f69-2329-47ad-9474-036bebb585d3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.101252 Dec 16 15:11:10.978608 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 826/1645] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:11:10 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:11:11.994045 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-cd99d566-8691-41ee-8b25-7ca540e9e831 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:11:11.995112 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-cd99d566-8691-41ee-8b25-7ca540e9e831 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:11:12.003108 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cd99d566-8691-41ee-8b25-7ca540e9e831 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:12.003662 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cd99d566-8691-41ee-8b25-7ca540e9e831 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:12.004524 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cd99d566-8691-41ee-8b25-7ca540e9e831 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:12.005026 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cd99d566-8691-41ee-8b25-7ca540e9e831 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:12.077351 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-cd99d566-8691-41ee-8b25-7ca540e9e831 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091775 Dec 16 15:11:12.077972 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 820/1646] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:11:11 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:11:13.094346 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-bf707759-34fc-40c5-a545-1063d573e8b0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:11:13.095397 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-bf707759-34fc-40c5-a545-1063d573e8b0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:11:13.103847 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-bf707759-34fc-40c5-a545-1063d573e8b0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:13.104354 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-bf707759-34fc-40c5-a545-1063d573e8b0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:13.105186 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-bf707759-34fc-40c5-a545-1063d573e8b0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:13.105677 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-bf707759-34fc-40c5-a545-1063d573e8b0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:13.177649 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-bf707759-34fc-40c5-a545-1063d573e8b0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091208 Dec 16 15:11:13.178567 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 827/1647] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:11:13 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:11:14.195087 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-a3ee367a-154b-456c-8b34-ba21399e5057 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:11:14.196133 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-a3ee367a-154b-456c-8b34-ba21399e5057 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:11:14.204397 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a3ee367a-154b-456c-8b34-ba21399e5057 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:14.204902 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a3ee367a-154b-456c-8b34-ba21399e5057 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:14.206427 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a3ee367a-154b-456c-8b34-ba21399e5057 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:14.206923 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a3ee367a-154b-456c-8b34-ba21399e5057 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:14.284264 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-a3ee367a-154b-456c-8b34-ba21399e5057 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.098410 Dec 16 15:11:14.284908 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 821/1648] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:11:14 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:11:15.301946 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-62b115dd-54d3-459d-8251-73a8e32e57e4 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:11:15.303284 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-62b115dd-54d3-459d-8251-73a8e32e57e4 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:11:15.312048 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-62b115dd-54d3-459d-8251-73a8e32e57e4 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:15.312557 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-62b115dd-54d3-459d-8251-73a8e32e57e4 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:15.313896 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-62b115dd-54d3-459d-8251-73a8e32e57e4 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:15.314569 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-62b115dd-54d3-459d-8251-73a8e32e57e4 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:15.395362 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-62b115dd-54d3-459d-8251-73a8e32e57e4 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.102459 Dec 16 15:11:15.396023 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 828/1649] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:11:15 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:11:16.411369 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-b82d7be7-d6c0-4a69-b05a-825ed10e89bd tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:11:16.412412 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-b82d7be7-d6c0-4a69-b05a-825ed10e89bd tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:11:16.420267 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b82d7be7-d6c0-4a69-b05a-825ed10e89bd tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:16.420780 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b82d7be7-d6c0-4a69-b05a-825ed10e89bd tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:16.421617 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b82d7be7-d6c0-4a69-b05a-825ed10e89bd tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:16.422159 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b82d7be7-d6c0-4a69-b05a-825ed10e89bd tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:16.499028 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-b82d7be7-d6c0-4a69-b05a-825ed10e89bd tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095473 Dec 16 15:11:16.499954 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 822/1650] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:11:16 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:11:17.515152 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-5ae78e39-acfc-4606-8d9b-ef647ed1604f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:11:17.516265 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-5ae78e39-acfc-4606-8d9b-ef647ed1604f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:11:17.524383 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5ae78e39-acfc-4606-8d9b-ef647ed1604f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:17.524891 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5ae78e39-acfc-4606-8d9b-ef647ed1604f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:17.525781 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5ae78e39-acfc-4606-8d9b-ef647ed1604f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:17.526323 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5ae78e39-acfc-4606-8d9b-ef647ed1604f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:17.599229 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-5ae78e39-acfc-4606-8d9b-ef647ed1604f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091794 Dec 16 15:11:17.600094 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 829/1651] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:11:17 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:11:18.615406 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-8050a8e7-9bb0-4550-abd5-31bac0806424 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:11:18.616449 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-8050a8e7-9bb0-4550-abd5-31bac0806424 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:11:18.624415 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8050a8e7-9bb0-4550-abd5-31bac0806424 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:18.624931 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8050a8e7-9bb0-4550-abd5-31bac0806424 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:18.625780 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8050a8e7-9bb0-4550-abd5-31bac0806424 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:18.626304 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8050a8e7-9bb0-4550-abd5-31bac0806424 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:18.700053 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-8050a8e7-9bb0-4550-abd5-31bac0806424 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092405 Dec 16 15:11:18.704418 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 823/1652] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:11:18 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:11:19.716110 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-01f8fea4-ffb2-4ea8-8b96-6d3c1596073b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:11:19.717145 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-01f8fea4-ffb2-4ea8-8b96-6d3c1596073b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:11:19.725615 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-01f8fea4-ffb2-4ea8-8b96-6d3c1596073b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:19.726142 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-01f8fea4-ffb2-4ea8-8b96-6d3c1596073b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:19.726967 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-01f8fea4-ffb2-4ea8-8b96-6d3c1596073b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:19.727454 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-01f8fea4-ffb2-4ea8-8b96-6d3c1596073b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:19.813842 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-01f8fea4-ffb2-4ea8-8b96-6d3c1596073b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.104667 Dec 16 15:11:19.814733 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 830/1653] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:11:19 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:11:20.830521 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-46891b25-901c-4aff-b413-f0d35441c355 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:11:20.831586 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-46891b25-901c-4aff-b413-f0d35441c355 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:11:20.839541 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-46891b25-901c-4aff-b413-f0d35441c355 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:20.840051 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-46891b25-901c-4aff-b413-f0d35441c355 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:20.840908 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-46891b25-901c-4aff-b413-f0d35441c355 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:20.841414 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-46891b25-901c-4aff-b413-f0d35441c355 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:20.916268 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-46891b25-901c-4aff-b413-f0d35441c355 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093763 Dec 16 15:11:20.917236 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 824/1654] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:11:20 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:11:21.934380 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-79ccb9da-e1b5-493f-9f7a-599c42ec05f1 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:11:21.935428 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-79ccb9da-e1b5-493f-9f7a-599c42ec05f1 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:11:21.943879 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-79ccb9da-e1b5-493f-9f7a-599c42ec05f1 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:21.944392 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-79ccb9da-e1b5-493f-9f7a-599c42ec05f1 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:21.945241 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-79ccb9da-e1b5-493f-9f7a-599c42ec05f1 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:21.945734 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-79ccb9da-e1b5-493f-9f7a-599c42ec05f1 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:22.020348 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-79ccb9da-e1b5-493f-9f7a-599c42ec05f1 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094267 Dec 16 15:11:22.021166 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 831/1655] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:11:21 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:11:23.037258 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-421712b6-b4d9-4e9c-b57d-1d8a54125e79 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:11:23.038364 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-421712b6-b4d9-4e9c-b57d-1d8a54125e79 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:11:23.046260 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-421712b6-b4d9-4e9c-b57d-1d8a54125e79 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:23.046776 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-421712b6-b4d9-4e9c-b57d-1d8a54125e79 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:23.047617 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-421712b6-b4d9-4e9c-b57d-1d8a54125e79 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:23.048106 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-421712b6-b4d9-4e9c-b57d-1d8a54125e79 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:23.121838 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-421712b6-b4d9-4e9c-b57d-1d8a54125e79 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092576 Dec 16 15:11:23.122707 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 825/1656] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:11:23 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:11:24.137370 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-928d613f-ae8b-4027-90e5-4882b9ea791b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:11:24.138469 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-928d613f-ae8b-4027-90e5-4882b9ea791b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:11:24.147031 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-928d613f-ae8b-4027-90e5-4882b9ea791b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:24.147536 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-928d613f-ae8b-4027-90e5-4882b9ea791b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:24.148381 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-928d613f-ae8b-4027-90e5-4882b9ea791b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:24.148871 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-928d613f-ae8b-4027-90e5-4882b9ea791b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:24.222883 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-928d613f-ae8b-4027-90e5-4882b9ea791b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093276 Dec 16 15:11:24.223660 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 832/1657] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:11:24 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:11:25.238457 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-a3274349-7673-4e97-bbf3-5cb71a9fb4ed tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:11:25.239503 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-a3274349-7673-4e97-bbf3-5cb71a9fb4ed tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:11:25.247672 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a3274349-7673-4e97-bbf3-5cb71a9fb4ed tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:25.248181 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a3274349-7673-4e97-bbf3-5cb71a9fb4ed tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:25.249025 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a3274349-7673-4e97-bbf3-5cb71a9fb4ed tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:25.249528 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a3274349-7673-4e97-bbf3-5cb71a9fb4ed tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:25.327274 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-a3274349-7673-4e97-bbf3-5cb71a9fb4ed tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096794 Dec 16 15:11:25.327890 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 826/1658] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:11:25 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:11:26.344608 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-129be974-ab08-4945-aa0e-68657722ed22 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:11:26.346321 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-129be974-ab08-4945-aa0e-68657722ed22 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:11:26.354502 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-129be974-ab08-4945-aa0e-68657722ed22 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:26.355008 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-129be974-ab08-4945-aa0e-68657722ed22 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:26.355854 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-129be974-ab08-4945-aa0e-68657722ed22 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:26.356341 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-129be974-ab08-4945-aa0e-68657722ed22 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:26.429853 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-129be974-ab08-4945-aa0e-68657722ed22 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093383 Dec 16 15:11:26.430756 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 833/1659] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:11:26 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:11:27.446898 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-9dc43a9c-6a9a-4add-86f5-3d56052e1bcd tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:11:27.447941 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-9dc43a9c-6a9a-4add-86f5-3d56052e1bcd tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:11:27.455883 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9dc43a9c-6a9a-4add-86f5-3d56052e1bcd tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:27.456393 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9dc43a9c-6a9a-4add-86f5-3d56052e1bcd tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:27.457244 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9dc43a9c-6a9a-4add-86f5-3d56052e1bcd tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:27.457742 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9dc43a9c-6a9a-4add-86f5-3d56052e1bcd tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:27.532169 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-9dc43a9c-6a9a-4add-86f5-3d56052e1bcd tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093879 Dec 16 15:11:27.536814 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 827/1660] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:11:27 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:11:28.549386 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-d0567d17-8cb6-42da-bed3-cb7ee9565d69 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:11:28.550465 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-d0567d17-8cb6-42da-bed3-cb7ee9565d69 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:11:28.558451 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d0567d17-8cb6-42da-bed3-cb7ee9565d69 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:28.558963 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d0567d17-8cb6-42da-bed3-cb7ee9565d69 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:28.559811 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d0567d17-8cb6-42da-bed3-cb7ee9565d69 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:28.560307 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d0567d17-8cb6-42da-bed3-cb7ee9565d69 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:28.639038 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-d0567d17-8cb6-42da-bed3-cb7ee9565d69 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097866 Dec 16 15:11:28.639933 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 834/1661] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:11:28 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:11:29.648870 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c89047bd-5046-4dc5-81a4-5f3a093a9e0b] AMQP server on 10.222.0.45:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 15:11:29.656469 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-af20ff34-620b-4dbf-bf91-7a0add9714fa tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:11:29.657508 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-af20ff34-620b-4dbf-bf91-7a0add9714fa tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:11:29.665566 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-af20ff34-620b-4dbf-bf91-7a0add9714fa tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:29.666080 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-af20ff34-620b-4dbf-bf91-7a0add9714fa tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:29.666934 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-af20ff34-620b-4dbf-bf91-7a0add9714fa tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:29.667421 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-af20ff34-620b-4dbf-bf91-7a0add9714fa tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:29.743371 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-af20ff34-620b-4dbf-bf91-7a0add9714fa tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095824 Dec 16 15:11:29.744204 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 828/1662] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:11:29 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 15:11:30.759756 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-ad1333ca-e334-4582-89f7-afdca65428cc tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:11:30.760783 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-ad1333ca-e334-4582-89f7-afdca65428cc tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:11:30.768676 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ad1333ca-e334-4582-89f7-afdca65428cc tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:30.769173 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ad1333ca-e334-4582-89f7-afdca65428cc tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:30.769994 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ad1333ca-e334-4582-89f7-afdca65428cc tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:30.770532 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ad1333ca-e334-4582-89f7-afdca65428cc tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:30.858471 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-ad1333ca-e334-4582-89f7-afdca65428cc tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.106537 Dec 16 15:11:30.859283 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 835/1663] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:11:30 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:11:31.874677 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-86147a25-378d-430c-a5c6-da4fc727050f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:11:31.875683 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-86147a25-378d-430c-a5c6-da4fc727050f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:11:31.895990 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-86147a25-378d-430c-a5c6-da4fc727050f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:31.896802 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-86147a25-378d-430c-a5c6-da4fc727050f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:31.897756 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-86147a25-378d-430c-a5c6-da4fc727050f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:31.898451 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-86147a25-378d-430c-a5c6-da4fc727050f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:31.952090 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO oslo.messaging._drivers.impl_rabbit [-] [c89047bd-5046-4dc5-81a4-5f3a093a9e0b] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 47084. Dec 16 15:11:31.974544 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-86147a25-378d-430c-a5c6-da4fc727050f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.107581 Dec 16 15:11:31.975187 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 829/1664] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:11:31 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:11:32.990855 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-77557827-66c2-48a6-bc4a-d62bf4bed484 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:11:32.991901 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-77557827-66c2-48a6-bc4a-d62bf4bed484 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:11:32.999952 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-77557827-66c2-48a6-bc4a-d62bf4bed484 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:33.000502 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-77557827-66c2-48a6-bc4a-d62bf4bed484 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:33.001952 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-77557827-66c2-48a6-bc4a-d62bf4bed484 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:33.002483 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-77557827-66c2-48a6-bc4a-d62bf4bed484 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:33.074837 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-77557827-66c2-48a6-bc4a-d62bf4bed484 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091684 Dec 16 15:11:33.076433 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 836/1665] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:11:32 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:11:34.091069 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-33da6a91-d450-42ea-a005-2643a0e1c9c1 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:11:34.092122 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-33da6a91-d450-42ea-a005-2643a0e1c9c1 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:11:34.100678 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-33da6a91-d450-42ea-a005-2643a0e1c9c1 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:34.101185 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-33da6a91-d450-42ea-a005-2643a0e1c9c1 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:34.102059 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-33da6a91-d450-42ea-a005-2643a0e1c9c1 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:34.102555 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-33da6a91-d450-42ea-a005-2643a0e1c9c1 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:34.177580 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-33da6a91-d450-42ea-a005-2643a0e1c9c1 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094345 Dec 16 15:11:34.178453 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 830/1666] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:11:34 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:11:35.193708 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-8161b14c-a418-4efb-add4-20a9852582df tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:11:35.194783 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-8161b14c-a418-4efb-add4-20a9852582df tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:11:35.202574 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8161b14c-a418-4efb-add4-20a9852582df tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:35.203074 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8161b14c-a418-4efb-add4-20a9852582df tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:35.203902 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8161b14c-a418-4efb-add4-20a9852582df tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:35.204401 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8161b14c-a418-4efb-add4-20a9852582df tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:35.278733 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-8161b14c-a418-4efb-add4-20a9852582df tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093041 Dec 16 15:11:35.279719 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 837/1667] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:11:35 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:11:36.295640 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-d2a52815-795c-40bf-bc1b-887eb4a638f2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:11:36.296689 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-d2a52815-795c-40bf-bc1b-887eb4a638f2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:11:36.304924 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d2a52815-795c-40bf-bc1b-887eb4a638f2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:36.305437 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d2a52815-795c-40bf-bc1b-887eb4a638f2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:36.306329 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d2a52815-795c-40bf-bc1b-887eb4a638f2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:36.306828 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d2a52815-795c-40bf-bc1b-887eb4a638f2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:36.388906 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-d2a52815-795c-40bf-bc1b-887eb4a638f2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.101126 Dec 16 15:11:36.389528 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 831/1668] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:11:36 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 15:11:37.405249 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-65ca5d56-d94d-4d2b-b84c-d9963132bc4a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:11:37.406325 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-65ca5d56-d94d-4d2b-b84c-d9963132bc4a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:11:37.414769 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-65ca5d56-d94d-4d2b-b84c-d9963132bc4a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:37.415275 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-65ca5d56-d94d-4d2b-b84c-d9963132bc4a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:37.416114 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-65ca5d56-d94d-4d2b-b84c-d9963132bc4a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:37.416604 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-65ca5d56-d94d-4d2b-b84c-d9963132bc4a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:37.492811 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-65ca5d56-d94d-4d2b-b84c-d9963132bc4a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095243 Dec 16 15:11:37.496780 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 838/1669] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:11:37 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:11:38.085967 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-9bdb8552-d882-4d5f-9e39-ddc88f4577e5 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:11:38.086581 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-9bdb8552-d882-4d5f-9e39-ddc88f4577e5 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] [instance: 64774bdb-b85b-4d86-9110-0b37d9c15bed] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:11:38.094458 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9bdb8552-d882-4d5f-9e39-ddc88f4577e5 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:38.094975 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9bdb8552-d882-4d5f-9e39-ddc88f4577e5 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:38.095829 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9bdb8552-d882-4d5f-9e39-ddc88f4577e5 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:38.096332 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9bdb8552-d882-4d5f-9e39-ddc88f4577e5 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:38.164756 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-9bdb8552-d882-4d5f-9e39-ddc88f4577e5 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] [instance: 64774bdb-b85b-4d86-9110-0b37d9c15bed] Going to try to terminate instance {{(pid=101355) delete /opt/stack/nova/nova/compute/api.py:2496}} Dec 16 15:11:38.402629 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-9bdb8552-d882-4d5f-9e39-ddc88f4577e5 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] 10.222.0.45 "DELETE /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed" status: 204 len: 0 microversion: 2.1 time: 0.324328 Dec 16 15:11:38.403609 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 832/1670] 10.222.0.45 () {58 vars in 1229 bytes} [Thu Dec 16 15:11:38 2021] DELETE /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 16 15:11:38.415897 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-8de33211-eca5-4e7d-936d-5650ff23f6f4 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:11:38.416574 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-8de33211-eca5-4e7d-936d-5650ff23f6f4 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] [instance: 64774bdb-b85b-4d86-9110-0b37d9c15bed] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:11:38.425010 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8de33211-eca5-4e7d-936d-5650ff23f6f4 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:38.425517 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8de33211-eca5-4e7d-936d-5650ff23f6f4 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:38.426398 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8de33211-eca5-4e7d-936d-5650ff23f6f4 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:38.426892 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8de33211-eca5-4e7d-936d-5650ff23f6f4 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:38.510585 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-7d6affd3-5cbb-4b3a-8d04-d80b931a37f4 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:11:38.511654 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-7d6affd3-5cbb-4b3a-8d04-d80b931a37f4 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:11:38.519573 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7d6affd3-5cbb-4b3a-8d04-d80b931a37f4 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:38.520084 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7d6affd3-5cbb-4b3a-8d04-d80b931a37f4 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:38.520931 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7d6affd3-5cbb-4b3a-8d04-d80b931a37f4 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:38.521431 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7d6affd3-5cbb-4b3a-8d04-d80b931a37f4 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:38.700678 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-7d6affd3-5cbb-4b3a-8d04-d80b931a37f4 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.198948 Dec 16 15:11:38.701553 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 833/1671] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:11:38 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 15:11:39.014726 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-8de33211-eca5-4e7d-936d-5650ff23f6f4 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ee0c9e767b4895b9e063b28ae947d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb300a155af646228f7c0b155a5d63ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:11:39.024327 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-8de33211-eca5-4e7d-936d-5650ff23f6f4 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] 10.222.0.45 "GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed" status: 200 len: 1560 microversion: 2.1 time: 0.616008 Dec 16 15:11:39.024915 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 839/1672] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:11:38 2021] GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed => generated 1560 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:11:39.725336 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-7c38441f-ede6-41c1-8866-28b4ad970076 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:11:39.725336 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-7c38441f-ede6-41c1-8866-28b4ad970076 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:11:39.727263 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7c38441f-ede6-41c1-8866-28b4ad970076 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:39.727779 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7c38441f-ede6-41c1-8866-28b4ad970076 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:39.728641 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7c38441f-ede6-41c1-8866-28b4ad970076 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:39.729142 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7c38441f-ede6-41c1-8866-28b4ad970076 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:39.807849 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-7c38441f-ede6-41c1-8866-28b4ad970076 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.098185 Dec 16 15:11:39.808764 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 834/1673] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:11:39 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:11:40.047436 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-bda16948-6c86-47e2-9d7a-4869eb127a16 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:11:40.048617 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-bda16948-6c86-47e2-9d7a-4869eb127a16 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] [instance: 64774bdb-b85b-4d86-9110-0b37d9c15bed] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:11:40.056528 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-bda16948-6c86-47e2-9d7a-4869eb127a16 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:40.057027 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-bda16948-6c86-47e2-9d7a-4869eb127a16 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:40.057863 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-bda16948-6c86-47e2-9d7a-4869eb127a16 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:40.058378 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-bda16948-6c86-47e2-9d7a-4869eb127a16 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:40.288935 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-bda16948-6c86-47e2-9d7a-4869eb127a16 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ee0c9e767b4895b9e063b28ae947d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb300a155af646228f7c0b155a5d63ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:11:40.299012 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-bda16948-6c86-47e2-9d7a-4869eb127a16 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] 10.222.0.45 "GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed" status: 200 len: 1560 microversion: 2.1 time: 0.258744 Dec 16 15:11:40.299628 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 840/1674] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:11:40 2021] GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed => generated 1560 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:11:40.750878 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [req-fd092517-454d-4979-86e8-48ed04ee66da req-f3d38343-4f27-4093-9e81-429b55fd3a13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64774bdb-b85b-4d86-9110-0b37d9c15bed", "name": "network-vif-deleted", "tag": "75cb5458-4bda-45f2-b4d8-351b0e290d01"}]} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:11:40.755594 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:11:40.755594 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: warnings.warn(msg) Dec 16 15:11:40.765266 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-fd092517-454d-4979-86e8-48ed04ee66da req-f3d38343-4f27-4093-9e81-429b55fd3a13 service nova] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:40.766004 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-fd092517-454d-4979-86e8-48ed04ee66da req-f3d38343-4f27-4093-9e81-429b55fd3a13 service nova] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:40.784305 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.compute.server_external_events [req-fd092517-454d-4979-86e8-48ed04ee66da req-f3d38343-4f27-4093-9e81-429b55fd3a13 service nova] Creating event network-vif-deleted:75cb5458-4bda-45f2-b4d8-351b0e290d01 for instance 64774bdb-b85b-4d86-9110-0b37d9c15bed on hv-cinder-82189 Dec 16 15:11:40.789358 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [req-fd092517-454d-4979-86e8-48ed04ee66da req-f3d38343-4f27-4093-9e81-429b55fd3a13 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.210024 Dec 16 15:11:40.789996 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 835/1675] 10.222.0.45 () {64 vars in 1308 bytes} [Thu Dec 16 15:11:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:11:40.824940 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-f5c1703d-89cd-4dc8-9a68-2c40fc7ee483 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:11:40.826018 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-f5c1703d-89cd-4dc8-9a68-2c40fc7ee483 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:11:40.834460 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f5c1703d-89cd-4dc8-9a68-2c40fc7ee483 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:40.835198 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f5c1703d-89cd-4dc8-9a68-2c40fc7ee483 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:40.836044 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f5c1703d-89cd-4dc8-9a68-2c40fc7ee483 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:40.836534 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f5c1703d-89cd-4dc8-9a68-2c40fc7ee483 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:40.951700 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-f5c1703d-89cd-4dc8-9a68-2c40fc7ee483 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.134830 Dec 16 15:11:40.952456 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 841/1676] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:11:40 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:11:41.321887 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-8aee0719-dfb6-479b-a8c1-919a11781a1d tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:11:41.322667 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-8aee0719-dfb6-479b-a8c1-919a11781a1d tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] [instance: 64774bdb-b85b-4d86-9110-0b37d9c15bed] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:11:41.331239 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8aee0719-dfb6-479b-a8c1-919a11781a1d tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:41.331724 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8aee0719-dfb6-479b-a8c1-919a11781a1d tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:41.332550 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8aee0719-dfb6-479b-a8c1-919a11781a1d tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:41.333035 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8aee0719-dfb6-479b-a8c1-919a11781a1d tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:41.636992 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-8aee0719-dfb6-479b-a8c1-919a11781a1d tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ee0c9e767b4895b9e063b28ae947d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb300a155af646228f7c0b155a5d63ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:11:41.647018 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-8aee0719-dfb6-479b-a8c1-919a11781a1d tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] 10.222.0.45 "GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed" status: 200 len: 1350 microversion: 2.1 time: 0.333268 Dec 16 15:11:41.647617 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 836/1677] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:11:41 2021] GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed => generated 1350 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:11:41.968406 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-ed92df17-5c5e-4573-91cb-146b2fee0939 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:11:41.969451 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-ed92df17-5c5e-4573-91cb-146b2fee0939 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:11:41.977278 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ed92df17-5c5e-4573-91cb-146b2fee0939 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:41.977792 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ed92df17-5c5e-4573-91cb-146b2fee0939 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:41.978658 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ed92df17-5c5e-4573-91cb-146b2fee0939 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:41.979155 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ed92df17-5c5e-4573-91cb-146b2fee0939 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:42.051471 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-ed92df17-5c5e-4573-91cb-146b2fee0939 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090837 Dec 16 15:11:42.052313 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 842/1678] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:11:41 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:11:42.668834 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-b41f0e67-9575-4d1a-960d-27275bf488f2 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:11:42.669475 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-b41f0e67-9575-4d1a-960d-27275bf488f2 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] [instance: 64774bdb-b85b-4d86-9110-0b37d9c15bed] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:11:42.677425 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b41f0e67-9575-4d1a-960d-27275bf488f2 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:42.677936 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b41f0e67-9575-4d1a-960d-27275bf488f2 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:42.678801 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b41f0e67-9575-4d1a-960d-27275bf488f2 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:42.679324 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b41f0e67-9575-4d1a-960d-27275bf488f2 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:42.810166 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-b41f0e67-9575-4d1a-960d-27275bf488f2 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ee0c9e767b4895b9e063b28ae947d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb300a155af646228f7c0b155a5d63ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:11:42.820533 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-b41f0e67-9575-4d1a-960d-27275bf488f2 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] 10.222.0.45 "GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed" status: 200 len: 1350 microversion: 2.1 time: 0.159390 Dec 16 15:11:42.821131 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 837/1679] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:11:42 2021] GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed => generated 1350 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:11:43.068267 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-dc2e2ef3-3978-451a-b963-726d33cb023a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:11:43.069307 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-dc2e2ef3-3978-451a-b963-726d33cb023a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:11:43.077401 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-dc2e2ef3-3978-451a-b963-726d33cb023a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:43.077910 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-dc2e2ef3-3978-451a-b963-726d33cb023a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:43.078774 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-dc2e2ef3-3978-451a-b963-726d33cb023a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:43.079271 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-dc2e2ef3-3978-451a-b963-726d33cb023a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:43.151117 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-dc2e2ef3-3978-451a-b963-726d33cb023a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091547 Dec 16 15:11:43.151742 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 843/1680] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:11:43 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:11:43.841474 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-e1ee4c64-1aac-452d-99ec-f42871716ce1 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:11:43.842180 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-e1ee4c64-1aac-452d-99ec-f42871716ce1 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] [instance: 64774bdb-b85b-4d86-9110-0b37d9c15bed] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:11:43.850728 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e1ee4c64-1aac-452d-99ec-f42871716ce1 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:43.851244 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e1ee4c64-1aac-452d-99ec-f42871716ce1 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:43.852089 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e1ee4c64-1aac-452d-99ec-f42871716ce1 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:43.852589 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e1ee4c64-1aac-452d-99ec-f42871716ce1 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:43.983473 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-e1ee4c64-1aac-452d-99ec-f42871716ce1 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ee0c9e767b4895b9e063b28ae947d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb300a155af646228f7c0b155a5d63ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:11:43.992683 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-e1ee4c64-1aac-452d-99ec-f42871716ce1 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] 10.222.0.45 "GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed" status: 200 len: 1350 microversion: 2.1 time: 0.158975 Dec 16 15:11:43.993270 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 838/1681] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:11:43 2021] GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed => generated 1350 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:11:44.167018 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-f6b28ca0-66ca-46f9-bcc9-21d9dfbccb3a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:11:44.168064 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-f6b28ca0-66ca-46f9-bcc9-21d9dfbccb3a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:11:44.175888 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f6b28ca0-66ca-46f9-bcc9-21d9dfbccb3a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:44.176390 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f6b28ca0-66ca-46f9-bcc9-21d9dfbccb3a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:44.177224 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f6b28ca0-66ca-46f9-bcc9-21d9dfbccb3a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:44.177716 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f6b28ca0-66ca-46f9-bcc9-21d9dfbccb3a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:44.248328 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-f6b28ca0-66ca-46f9-bcc9-21d9dfbccb3a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088947 Dec 16 15:11:44.248952 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 844/1682] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:11:44 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:11:45.015023 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-c599a550-25fa-4a3a-8d13-648c4023e9bf tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:11:45.015695 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-c599a550-25fa-4a3a-8d13-648c4023e9bf tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] [instance: 64774bdb-b85b-4d86-9110-0b37d9c15bed] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:11:45.024172 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c599a550-25fa-4a3a-8d13-648c4023e9bf tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:45.024686 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c599a550-25fa-4a3a-8d13-648c4023e9bf tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:45.025537 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c599a550-25fa-4a3a-8d13-648c4023e9bf tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:45.026032 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c599a550-25fa-4a3a-8d13-648c4023e9bf tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:45.153907 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-c599a550-25fa-4a3a-8d13-648c4023e9bf tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ee0c9e767b4895b9e063b28ae947d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb300a155af646228f7c0b155a5d63ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:11:45.163379 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-c599a550-25fa-4a3a-8d13-648c4023e9bf tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] 10.222.0.45 "GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed" status: 200 len: 1350 microversion: 2.1 time: 0.156073 Dec 16 15:11:45.163981 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 839/1683] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:11:45 2021] GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed => generated 1350 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:11:45.263921 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-768cde82-1d03-4f89-b175-36bbc266055a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:11:45.264997 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-768cde82-1d03-4f89-b175-36bbc266055a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:11:45.272802 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-768cde82-1d03-4f89-b175-36bbc266055a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:45.273253 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-768cde82-1d03-4f89-b175-36bbc266055a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:45.274095 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-768cde82-1d03-4f89-b175-36bbc266055a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:45.274588 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-768cde82-1d03-4f89-b175-36bbc266055a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:45.349572 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-768cde82-1d03-4f89-b175-36bbc266055a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093254 Dec 16 15:11:45.350396 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 845/1684] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:11:45 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:11:46.186097 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-8b7e0e1a-a1c0-4ba2-a0cb-794d62dd9be3 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:11:46.186822 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-8b7e0e1a-a1c0-4ba2-a0cb-794d62dd9be3 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] [instance: 64774bdb-b85b-4d86-9110-0b37d9c15bed] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:11:46.195502 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8b7e0e1a-a1c0-4ba2-a0cb-794d62dd9be3 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:46.196015 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8b7e0e1a-a1c0-4ba2-a0cb-794d62dd9be3 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:46.196857 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8b7e0e1a-a1c0-4ba2-a0cb-794d62dd9be3 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:46.197406 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8b7e0e1a-a1c0-4ba2-a0cb-794d62dd9be3 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:46.328544 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-8b7e0e1a-a1c0-4ba2-a0cb-794d62dd9be3 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ee0c9e767b4895b9e063b28ae947d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb300a155af646228f7c0b155a5d63ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:11:46.338612 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-8b7e0e1a-a1c0-4ba2-a0cb-794d62dd9be3 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] 10.222.0.45 "GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed" status: 200 len: 1350 microversion: 2.1 time: 0.160168 Dec 16 15:11:46.339383 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 840/1685] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:11:46 2021] GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed => generated 1350 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:11:46.366459 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-580bde75-4847-410d-972a-cd424216a5b5 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:11:46.367498 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-580bde75-4847-410d-972a-cd424216a5b5 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:11:46.377157 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-580bde75-4847-410d-972a-cd424216a5b5 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:46.377677 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-580bde75-4847-410d-972a-cd424216a5b5 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:46.378622 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-580bde75-4847-410d-972a-cd424216a5b5 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:46.379121 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-580bde75-4847-410d-972a-cd424216a5b5 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:46.454600 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-580bde75-4847-410d-972a-cd424216a5b5 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096745 Dec 16 15:11:46.455167 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 846/1686] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:11:46 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:11:47.360174 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-77216492-a2b4-4e48-a767-43f117892cb1 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:11:47.360855 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-77216492-a2b4-4e48-a767-43f117892cb1 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] [instance: 64774bdb-b85b-4d86-9110-0b37d9c15bed] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:11:47.368730 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-77216492-a2b4-4e48-a767-43f117892cb1 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:47.369244 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-77216492-a2b4-4e48-a767-43f117892cb1 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:47.370119 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-77216492-a2b4-4e48-a767-43f117892cb1 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:47.370620 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-77216492-a2b4-4e48-a767-43f117892cb1 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:47.471037 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-20fa0f8c-a92a-4e89-8cf0-ee909ea11956 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:11:47.472087 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-20fa0f8c-a92a-4e89-8cf0-ee909ea11956 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:11:47.479909 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-20fa0f8c-a92a-4e89-8cf0-ee909ea11956 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:47.480597 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-20fa0f8c-a92a-4e89-8cf0-ee909ea11956 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:47.481442 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-20fa0f8c-a92a-4e89-8cf0-ee909ea11956 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:47.481932 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-20fa0f8c-a92a-4e89-8cf0-ee909ea11956 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:47.497528 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-77216492-a2b4-4e48-a767-43f117892cb1 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ee0c9e767b4895b9e063b28ae947d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb300a155af646228f7c0b155a5d63ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:11:47.507162 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-77216492-a2b4-4e48-a767-43f117892cb1 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] 10.222.0.45 "GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed" status: 200 len: 1350 microversion: 2.1 time: 0.154695 Dec 16 15:11:47.507761 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 841/1687] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:11:47 2021] GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed => generated 1350 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:11:47.554807 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-20fa0f8c-a92a-4e89-8cf0-ee909ea11956 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092076 Dec 16 15:11:47.555428 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 847/1688] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:11:47 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:11:48.533407 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-cdb3a9da-0c4c-4623-b847-5340a258708f tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:11:48.534126 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-cdb3a9da-0c4c-4623-b847-5340a258708f tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] [instance: 64774bdb-b85b-4d86-9110-0b37d9c15bed] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:11:48.542101 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cdb3a9da-0c4c-4623-b847-5340a258708f tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:48.542657 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cdb3a9da-0c4c-4623-b847-5340a258708f tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:48.543563 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cdb3a9da-0c4c-4623-b847-5340a258708f tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:48.544202 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cdb3a9da-0c4c-4623-b847-5340a258708f tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:48.570963 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-a088c183-81e0-420a-8493-4311f923ba9d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:11:48.572009 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-a088c183-81e0-420a-8493-4311f923ba9d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:11:48.579811 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a088c183-81e0-420a-8493-4311f923ba9d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:48.580316 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a088c183-81e0-420a-8493-4311f923ba9d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:48.581155 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a088c183-81e0-420a-8493-4311f923ba9d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:48.581813 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a088c183-81e0-420a-8493-4311f923ba9d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:48.676072 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-cdb3a9da-0c4c-4623-b847-5340a258708f tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ee0c9e767b4895b9e063b28ae947d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb300a155af646228f7c0b155a5d63ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:11:48.687602 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-cdb3a9da-0c4c-4623-b847-5340a258708f tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] 10.222.0.45 "GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed" status: 200 len: 1350 microversion: 2.1 time: 0.166375 Dec 16 15:11:48.688971 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 842/1689] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:11:48 2021] GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed => generated 1350 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:11:48.698278 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-a088c183-81e0-420a-8493-4311f923ba9d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.135182 Dec 16 15:11:48.698899 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 848/1690] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:11:48 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:11:49.710772 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-0da854d7-003a-468e-a18e-a0c60c70bf84 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:11:49.711452 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-0da854d7-003a-468e-a18e-a0c60c70bf84 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] [instance: 64774bdb-b85b-4d86-9110-0b37d9c15bed] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:11:49.714921 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-213ffdd6-7f04-47b5-b1cb-6c610182ce19 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:11:49.716032 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-213ffdd6-7f04-47b5-b1cb-6c610182ce19 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:11:49.719982 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0da854d7-003a-468e-a18e-a0c60c70bf84 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:49.721575 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0da854d7-003a-468e-a18e-a0c60c70bf84 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:49.722138 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0da854d7-003a-468e-a18e-a0c60c70bf84 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:49.722642 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0da854d7-003a-468e-a18e-a0c60c70bf84 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:49.725098 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-213ffdd6-7f04-47b5-b1cb-6c610182ce19 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:49.725795 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-213ffdd6-7f04-47b5-b1cb-6c610182ce19 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:49.726697 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-213ffdd6-7f04-47b5-b1cb-6c610182ce19 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:49.727192 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-213ffdd6-7f04-47b5-b1cb-6c610182ce19 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:49.804772 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-213ffdd6-7f04-47b5-b1cb-6c610182ce19 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097770 Dec 16 15:11:49.805517 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 849/1691] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:11:49 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 15:11:49.863932 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-0da854d7-003a-468e-a18e-a0c60c70bf84 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ee0c9e767b4895b9e063b28ae947d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb300a155af646228f7c0b155a5d63ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:11:49.873518 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-0da854d7-003a-468e-a18e-a0c60c70bf84 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] 10.222.0.45 "GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed" status: 200 len: 1350 microversion: 2.1 time: 0.171479 Dec 16 15:11:49.874427 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 843/1692] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:11:49 2021] GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed => generated 1350 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:11:50.821496 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-d22426f6-376c-4062-9830-9b5512c19221 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:11:50.822561 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-d22426f6-376c-4062-9830-9b5512c19221 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:11:50.830977 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d22426f6-376c-4062-9830-9b5512c19221 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:50.833026 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d22426f6-376c-4062-9830-9b5512c19221 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:50.833026 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d22426f6-376c-4062-9830-9b5512c19221 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:50.833026 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d22426f6-376c-4062-9830-9b5512c19221 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:50.896584 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-c42f9351-b3e2-4a5d-8835-e1728ff2a816 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:11:50.897268 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-c42f9351-b3e2-4a5d-8835-e1728ff2a816 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] [instance: 64774bdb-b85b-4d86-9110-0b37d9c15bed] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:11:50.905009 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-d22426f6-376c-4062-9830-9b5512c19221 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092013 Dec 16 15:11:50.905855 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 850/1693] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:11:50 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:11:50.905974 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c42f9351-b3e2-4a5d-8835-e1728ff2a816 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:50.906329 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c42f9351-b3e2-4a5d-8835-e1728ff2a816 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:50.907285 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c42f9351-b3e2-4a5d-8835-e1728ff2a816 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:50.907774 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c42f9351-b3e2-4a5d-8835-e1728ff2a816 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:51.044981 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-c42f9351-b3e2-4a5d-8835-e1728ff2a816 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ee0c9e767b4895b9e063b28ae947d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb300a155af646228f7c0b155a5d63ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:11:51.055286 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-c42f9351-b3e2-4a5d-8835-e1728ff2a816 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] 10.222.0.45 "GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed" status: 200 len: 1350 microversion: 2.1 time: 0.167278 Dec 16 15:11:51.055895 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 844/1694] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:11:50 2021] GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed => generated 1350 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:11:51.921063 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-61dd02ba-57e5-48b4-b641-77ba7417e13a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:11:51.922138 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-61dd02ba-57e5-48b4-b641-77ba7417e13a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:11:51.930405 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-61dd02ba-57e5-48b4-b641-77ba7417e13a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:51.930916 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-61dd02ba-57e5-48b4-b641-77ba7417e13a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:51.931754 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-61dd02ba-57e5-48b4-b641-77ba7417e13a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:51.932248 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-61dd02ba-57e5-48b4-b641-77ba7417e13a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:52.002669 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-61dd02ba-57e5-48b4-b641-77ba7417e13a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089460 Dec 16 15:11:52.003231 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 851/1695] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:11:51 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:11:52.077701 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-44eb878b-dd15-4c51-9f07-f5389e28b155 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:11:52.078502 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-44eb878b-dd15-4c51-9f07-f5389e28b155 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] [instance: 64774bdb-b85b-4d86-9110-0b37d9c15bed] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:11:52.082251 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 15:11:52.082394 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: Thu Dec 16 15:11:52 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed (ip 10.222.0.45) !!! Dec 16 15:11:52.102877 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-44eb878b-dd15-4c51-9f07-f5389e28b155 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:52.103385 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-44eb878b-dd15-4c51-9f07-f5389e28b155 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:52.104234 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-44eb878b-dd15-4c51-9f07-f5389e28b155 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:52.104725 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-44eb878b-dd15-4c51-9f07-f5389e28b155 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:52.237690 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-44eb878b-dd15-4c51-9f07-f5389e28b155 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ee0c9e767b4895b9e063b28ae947d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb300a155af646228f7c0b155a5d63ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:11:52.247083 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-44eb878b-dd15-4c51-9f07-f5389e28b155 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] 10.222.0.45 "GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed" status: 200 len: 1350 microversion: 2.1 time: 0.177221 Dec 16 15:11:52.247672 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 845/1696] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:11:52 2021] GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed => generated 1350 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:11:53.018527 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-789b25c5-674d-4f67-810a-10ac5556869d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:11:53.019579 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-789b25c5-674d-4f67-810a-10ac5556869d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:11:53.027435 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-789b25c5-674d-4f67-810a-10ac5556869d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:53.028065 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-789b25c5-674d-4f67-810a-10ac5556869d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:53.028797 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-789b25c5-674d-4f67-810a-10ac5556869d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:53.029289 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-789b25c5-674d-4f67-810a-10ac5556869d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:53.101336 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-789b25c5-674d-4f67-810a-10ac5556869d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090424 Dec 16 15:11:53.101894 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 852/1697] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:11:53 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:11:53.278560 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-1d325a60-55b9-4e80-a1c4-2d36518d1c8b tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:11:53.279555 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-1d325a60-55b9-4e80-a1c4-2d36518d1c8b tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] [instance: 64774bdb-b85b-4d86-9110-0b37d9c15bed] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:11:53.287748 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1d325a60-55b9-4e80-a1c4-2d36518d1c8b tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:53.288258 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1d325a60-55b9-4e80-a1c4-2d36518d1c8b tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:53.289263 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1d325a60-55b9-4e80-a1c4-2d36518d1c8b tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:53.289589 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1d325a60-55b9-4e80-a1c4-2d36518d1c8b tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:53.425650 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-1d325a60-55b9-4e80-a1c4-2d36518d1c8b tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ee0c9e767b4895b9e063b28ae947d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb300a155af646228f7c0b155a5d63ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:11:53.435178 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-1d325a60-55b9-4e80-a1c4-2d36518d1c8b tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] 10.222.0.45 "GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed" status: 200 len: 1350 microversion: 2.1 time: 0.174111 Dec 16 15:11:53.435736 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 846/1698] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:11:53 2021] GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed => generated 1350 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:11:54.117090 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-f1e47fbb-a88a-4a79-b9b6-4149e9836efc tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:11:54.118152 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-f1e47fbb-a88a-4a79-b9b6-4149e9836efc tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:11:54.126831 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f1e47fbb-a88a-4a79-b9b6-4149e9836efc tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:54.127334 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f1e47fbb-a88a-4a79-b9b6-4149e9836efc tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:54.128160 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f1e47fbb-a88a-4a79-b9b6-4149e9836efc tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:54.128648 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f1e47fbb-a88a-4a79-b9b6-4149e9836efc tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:54.202955 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-f1e47fbb-a88a-4a79-b9b6-4149e9836efc tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093891 Dec 16 15:11:54.203517 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 853/1699] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:11:54 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:11:54.456821 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-d8ca57d1-b5ad-4f5a-bc4f-dc927a2e99a9 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:11:54.457496 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-d8ca57d1-b5ad-4f5a-bc4f-dc927a2e99a9 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] [instance: 64774bdb-b85b-4d86-9110-0b37d9c15bed] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:11:54.465260 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d8ca57d1-b5ad-4f5a-bc4f-dc927a2e99a9 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:54.465770 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d8ca57d1-b5ad-4f5a-bc4f-dc927a2e99a9 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:54.466691 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d8ca57d1-b5ad-4f5a-bc4f-dc927a2e99a9 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:54.467187 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d8ca57d1-b5ad-4f5a-bc4f-dc927a2e99a9 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:54.594736 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-d8ca57d1-b5ad-4f5a-bc4f-dc927a2e99a9 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ee0c9e767b4895b9e063b28ae947d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb300a155af646228f7c0b155a5d63ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:11:54.604167 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-d8ca57d1-b5ad-4f5a-bc4f-dc927a2e99a9 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] 10.222.0.45 "GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed" status: 200 len: 1350 microversion: 2.1 time: 0.155162 Dec 16 15:11:54.604751 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 847/1700] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:11:54 2021] GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed => generated 1350 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:11:55.218710 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-1d6058e3-bdcf-4705-9191-11e1d6b572d8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:11:55.219755 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-1d6058e3-bdcf-4705-9191-11e1d6b572d8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:11:55.227591 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1d6058e3-bdcf-4705-9191-11e1d6b572d8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:55.228039 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1d6058e3-bdcf-4705-9191-11e1d6b572d8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:55.228883 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1d6058e3-bdcf-4705-9191-11e1d6b572d8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:55.229376 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1d6058e3-bdcf-4705-9191-11e1d6b572d8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:55.299750 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-1d6058e3-bdcf-4705-9191-11e1d6b572d8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088681 Dec 16 15:11:55.300365 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 854/1701] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:11:55 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:11:55.626880 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-1818465a-6d88-47a9-9022-0130eaa97434 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:11:55.627587 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-1818465a-6d88-47a9-9022-0130eaa97434 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] [instance: 64774bdb-b85b-4d86-9110-0b37d9c15bed] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:11:55.635332 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1818465a-6d88-47a9-9022-0130eaa97434 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:55.635868 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1818465a-6d88-47a9-9022-0130eaa97434 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:55.636698 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1818465a-6d88-47a9-9022-0130eaa97434 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:55.637180 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1818465a-6d88-47a9-9022-0130eaa97434 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:55.766672 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-1818465a-6d88-47a9-9022-0130eaa97434 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ee0c9e767b4895b9e063b28ae947d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb300a155af646228f7c0b155a5d63ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:11:55.776094 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-1818465a-6d88-47a9-9022-0130eaa97434 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] 10.222.0.45 "GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed" status: 200 len: 1350 microversion: 2.1 time: 0.157463 Dec 16 15:11:55.776628 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 848/1702] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:11:55 2021] GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed => generated 1350 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:11:56.316021 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-e7aa56f2-e28e-4cfe-99bb-f20b3c4d6215 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:11:56.317229 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-e7aa56f2-e28e-4cfe-99bb-f20b3c4d6215 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:11:56.326132 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e7aa56f2-e28e-4cfe-99bb-f20b3c4d6215 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:56.326132 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e7aa56f2-e28e-4cfe-99bb-f20b3c4d6215 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:56.326388 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e7aa56f2-e28e-4cfe-99bb-f20b3c4d6215 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:56.326719 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e7aa56f2-e28e-4cfe-99bb-f20b3c4d6215 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:56.399829 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-e7aa56f2-e28e-4cfe-99bb-f20b3c4d6215 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091879 Dec 16 15:11:56.400438 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 855/1703] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:11:56 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:11:56.797840 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-c1712521-459a-4421-b96b-88b72f62b9bf tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:11:56.798532 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-c1712521-459a-4421-b96b-88b72f62b9bf tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] [instance: 64774bdb-b85b-4d86-9110-0b37d9c15bed] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:11:56.806347 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c1712521-459a-4421-b96b-88b72f62b9bf tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:56.806853 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c1712521-459a-4421-b96b-88b72f62b9bf tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:56.807692 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c1712521-459a-4421-b96b-88b72f62b9bf tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:56.808187 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c1712521-459a-4421-b96b-88b72f62b9bf tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:56.945322 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-c1712521-459a-4421-b96b-88b72f62b9bf tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ee0c9e767b4895b9e063b28ae947d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb300a155af646228f7c0b155a5d63ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:11:56.955254 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-c1712521-459a-4421-b96b-88b72f62b9bf tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] 10.222.0.45 "GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed" status: 200 len: 1350 microversion: 2.1 time: 0.165039 Dec 16 15:11:56.955857 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 849/1704] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:11:56 2021] GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed => generated 1350 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:11:57.416231 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-236b7b40-561f-4758-a774-5b22fa8db0eb tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:11:57.417268 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-236b7b40-561f-4758-a774-5b22fa8db0eb tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:11:57.425314 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-236b7b40-561f-4758-a774-5b22fa8db0eb tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:57.425789 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-236b7b40-561f-4758-a774-5b22fa8db0eb tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:57.426656 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-236b7b40-561f-4758-a774-5b22fa8db0eb tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:57.427146 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-236b7b40-561f-4758-a774-5b22fa8db0eb tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:57.497928 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-236b7b40-561f-4758-a774-5b22fa8db0eb tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089336 Dec 16 15:11:57.498597 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 856/1705] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:11:57 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:11:57.977768 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-a98f6c1d-e928-4601-ae4d-12d915991bfe tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:11:57.978413 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-a98f6c1d-e928-4601-ae4d-12d915991bfe tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] [instance: 64774bdb-b85b-4d86-9110-0b37d9c15bed] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:11:57.986808 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a98f6c1d-e928-4601-ae4d-12d915991bfe tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:57.987309 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a98f6c1d-e928-4601-ae4d-12d915991bfe tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:57.988149 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a98f6c1d-e928-4601-ae4d-12d915991bfe tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:57.988633 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a98f6c1d-e928-4601-ae4d-12d915991bfe tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:58.117991 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-a98f6c1d-e928-4601-ae4d-12d915991bfe tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ee0c9e767b4895b9e063b28ae947d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb300a155af646228f7c0b155a5d63ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:11:58.127737 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-a98f6c1d-e928-4601-ae4d-12d915991bfe tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] 10.222.0.45 "GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed" status: 200 len: 1350 microversion: 2.1 time: 0.158235 Dec 16 15:11:58.128352 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 850/1706] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:11:57 2021] GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed => generated 1350 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:11:58.514832 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-1f69d7b4-1f8e-4a68-a0c6-8f0450698092 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:11:58.515852 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-1f69d7b4-1f8e-4a68-a0c6-8f0450698092 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:11:58.524310 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1f69d7b4-1f8e-4a68-a0c6-8f0450698092 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:58.524817 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1f69d7b4-1f8e-4a68-a0c6-8f0450698092 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:58.525658 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1f69d7b4-1f8e-4a68-a0c6-8f0450698092 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:58.526171 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1f69d7b4-1f8e-4a68-a0c6-8f0450698092 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:58.600502 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-1f69d7b4-1f8e-4a68-a0c6-8f0450698092 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093386 Dec 16 15:11:58.601106 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 857/1707] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:11:58 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:11:59.149653 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-d1dac773-1ecf-4663-85a0-75f7a1555d7b tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:11:59.150354 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-d1dac773-1ecf-4663-85a0-75f7a1555d7b tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] [instance: 64774bdb-b85b-4d86-9110-0b37d9c15bed] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:11:59.158715 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d1dac773-1ecf-4663-85a0-75f7a1555d7b tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:59.159230 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d1dac773-1ecf-4663-85a0-75f7a1555d7b tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:59.160069 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d1dac773-1ecf-4663-85a0-75f7a1555d7b tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:59.160564 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d1dac773-1ecf-4663-85a0-75f7a1555d7b tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:59.290217 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-d1dac773-1ecf-4663-85a0-75f7a1555d7b tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ee0c9e767b4895b9e063b28ae947d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb300a155af646228f7c0b155a5d63ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:11:59.300317 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-d1dac773-1ecf-4663-85a0-75f7a1555d7b tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] 10.222.0.45 "GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed" status: 200 len: 1350 microversion: 2.1 time: 0.158478 Dec 16 15:11:59.300903 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 851/1708] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:11:59 2021] GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed => generated 1350 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:11:59.615719 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-0bce0a38-c923-499e-842e-e20f01f77fdd tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:11:59.616762 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-0bce0a38-c923-499e-842e-e20f01f77fdd tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:11:59.624542 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0bce0a38-c923-499e-842e-e20f01f77fdd tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:59.625052 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0bce0a38-c923-499e-842e-e20f01f77fdd tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:59.625898 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0bce0a38-c923-499e-842e-e20f01f77fdd tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:11:59.626422 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0bce0a38-c923-499e-842e-e20f01f77fdd tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:11:59.698597 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-0bce0a38-c923-499e-842e-e20f01f77fdd tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090546 Dec 16 15:11:59.699254 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 858/1709] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:11:59 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:12:00.322981 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-aeaf0026-ffd2-4c8c-bb3e-061ee6506ec0 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:12:00.323606 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-aeaf0026-ffd2-4c8c-bb3e-061ee6506ec0 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] [instance: 64774bdb-b85b-4d86-9110-0b37d9c15bed] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:12:00.331932 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-aeaf0026-ffd2-4c8c-bb3e-061ee6506ec0 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:00.332436 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-aeaf0026-ffd2-4c8c-bb3e-061ee6506ec0 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:00.333260 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-aeaf0026-ffd2-4c8c-bb3e-061ee6506ec0 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:00.333742 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-aeaf0026-ffd2-4c8c-bb3e-061ee6506ec0 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:00.595165 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-aeaf0026-ffd2-4c8c-bb3e-061ee6506ec0 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ee0c9e767b4895b9e063b28ae947d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb300a155af646228f7c0b155a5d63ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:12:00.604478 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-aeaf0026-ffd2-4c8c-bb3e-061ee6506ec0 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] 10.222.0.45 "GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed" status: 200 len: 1350 microversion: 2.1 time: 0.289132 Dec 16 15:12:00.605067 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 852/1710] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:12:00 2021] GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed => generated 1350 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:12:00.714887 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-6fafaf42-75b7-434d-9995-50f90e6c9075 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:12:00.716052 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-6fafaf42-75b7-434d-9995-50f90e6c9075 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:12:00.723885 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6fafaf42-75b7-434d-9995-50f90e6c9075 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:00.724383 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6fafaf42-75b7-434d-9995-50f90e6c9075 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:00.725214 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6fafaf42-75b7-434d-9995-50f90e6c9075 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:00.725701 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6fafaf42-75b7-434d-9995-50f90e6c9075 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:00.799225 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-6fafaf42-75b7-434d-9995-50f90e6c9075 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092109 Dec 16 15:12:00.799862 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 859/1711] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:12:00 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:12:01.625940 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-c17df98c-0187-4823-aad3-9db1ee0bdadb tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:12:01.626638 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-c17df98c-0187-4823-aad3-9db1ee0bdadb tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] [instance: 64774bdb-b85b-4d86-9110-0b37d9c15bed] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:12:01.634478 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c17df98c-0187-4823-aad3-9db1ee0bdadb tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:01.634985 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c17df98c-0187-4823-aad3-9db1ee0bdadb tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:01.635824 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c17df98c-0187-4823-aad3-9db1ee0bdadb tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:01.636308 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c17df98c-0187-4823-aad3-9db1ee0bdadb tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:01.761784 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-c17df98c-0187-4823-aad3-9db1ee0bdadb tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ee0c9e767b4895b9e063b28ae947d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb300a155af646228f7c0b155a5d63ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:12:01.771763 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-c17df98c-0187-4823-aad3-9db1ee0bdadb tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] 10.222.0.45 "GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed" status: 200 len: 1350 microversion: 2.1 time: 0.153436 Dec 16 15:12:01.772358 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 853/1712] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:12:01 2021] GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed => generated 1350 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:12:01.817355 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-a80551ce-876e-4295-a49c-2c384d1449e3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:12:01.818434 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-a80551ce-876e-4295-a49c-2c384d1449e3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:12:01.826499 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a80551ce-876e-4295-a49c-2c384d1449e3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:01.827006 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a80551ce-876e-4295-a49c-2c384d1449e3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:01.827845 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a80551ce-876e-4295-a49c-2c384d1449e3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:01.828901 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a80551ce-876e-4295-a49c-2c384d1449e3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:01.907208 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-a80551ce-876e-4295-a49c-2c384d1449e3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.098568 Dec 16 15:12:01.907825 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 860/1713] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:12:01 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:12:02.794355 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-0335f35a-0c68-4e77-b187-31ed864718a6 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:12:02.794962 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-0335f35a-0c68-4e77-b187-31ed864718a6 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] [instance: 64774bdb-b85b-4d86-9110-0b37d9c15bed] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:12:02.803336 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0335f35a-0c68-4e77-b187-31ed864718a6 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:02.803847 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0335f35a-0c68-4e77-b187-31ed864718a6 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:02.804681 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0335f35a-0c68-4e77-b187-31ed864718a6 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:02.805173 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0335f35a-0c68-4e77-b187-31ed864718a6 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:02.923754 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-e68e2622-0bb6-4acc-aa92-97cd664069fa tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:12:02.925086 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-e68e2622-0bb6-4acc-aa92-97cd664069fa tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:12:02.933548 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e68e2622-0bb6-4acc-aa92-97cd664069fa tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:02.934070 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e68e2622-0bb6-4acc-aa92-97cd664069fa tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:02.934959 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e68e2622-0bb6-4acc-aa92-97cd664069fa tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:02.935472 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e68e2622-0bb6-4acc-aa92-97cd664069fa tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:02.936558 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-0335f35a-0c68-4e77-b187-31ed864718a6 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ee0c9e767b4895b9e063b28ae947d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb300a155af646228f7c0b155a5d63ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:12:02.946263 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-0335f35a-0c68-4e77-b187-31ed864718a6 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] 10.222.0.45 "GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed" status: 200 len: 1350 microversion: 2.1 time: 0.159679 Dec 16 15:12:02.947107 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 854/1714] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:12:02 2021] GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed => generated 1350 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:12:03.012219 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-e68e2622-0bb6-4acc-aa92-97cd664069fa tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097574 Dec 16 15:12:03.012842 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 861/1715] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:12:02 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 15:12:03.968246 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-0ad8d771-9411-4504-a32b-f87d6210407a tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:12:03.969001 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-0ad8d771-9411-4504-a32b-f87d6210407a tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] [instance: 64774bdb-b85b-4d86-9110-0b37d9c15bed] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:12:03.977320 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0ad8d771-9411-4504-a32b-f87d6210407a tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:03.977830 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0ad8d771-9411-4504-a32b-f87d6210407a tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:03.978696 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0ad8d771-9411-4504-a32b-f87d6210407a tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:03.979192 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0ad8d771-9411-4504-a32b-f87d6210407a tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:04.028181 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-f407b0c9-0cd9-4dc1-8b4c-924a6780691a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:12:04.029234 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-f407b0c9-0cd9-4dc1-8b4c-924a6780691a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:12:04.039005 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f407b0c9-0cd9-4dc1-8b4c-924a6780691a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:04.039523 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f407b0c9-0cd9-4dc1-8b4c-924a6780691a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:04.040379 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f407b0c9-0cd9-4dc1-8b4c-924a6780691a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:04.040874 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f407b0c9-0cd9-4dc1-8b4c-924a6780691a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:04.108870 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-0ad8d771-9411-4504-a32b-f87d6210407a tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ee0c9e767b4895b9e063b28ae947d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb300a155af646228f7c0b155a5d63ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:12:04.114759 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-f407b0c9-0cd9-4dc1-8b4c-924a6780691a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094358 Dec 16 15:12:04.115569 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 862/1716] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:12:04 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:12:04.118770 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-0ad8d771-9411-4504-a32b-f87d6210407a tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] 10.222.0.45 "GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed" status: 200 len: 1350 microversion: 2.1 time: 0.158120 Dec 16 15:12:04.119361 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 855/1717] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:12:03 2021] GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed => generated 1350 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:12:05.131510 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-acacd3dd-2dca-4b89-9ad3-6323dedba25f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:12:05.133161 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-acacd3dd-2dca-4b89-9ad3-6323dedba25f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:12:05.141598 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-ce6c0501-84ab-4963-a294-ed954a7478f7 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:12:05.142709 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-ce6c0501-84ab-4963-a294-ed954a7478f7 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] [instance: 64774bdb-b85b-4d86-9110-0b37d9c15bed] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:12:05.143227 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-acacd3dd-2dca-4b89-9ad3-6323dedba25f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:05.143744 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-acacd3dd-2dca-4b89-9ad3-6323dedba25f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:05.144600 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-acacd3dd-2dca-4b89-9ad3-6323dedba25f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:05.145097 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-acacd3dd-2dca-4b89-9ad3-6323dedba25f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:05.151643 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ce6c0501-84ab-4963-a294-ed954a7478f7 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:05.152495 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ce6c0501-84ab-4963-a294-ed954a7478f7 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:05.153506 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ce6c0501-84ab-4963-a294-ed954a7478f7 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:05.154219 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ce6c0501-84ab-4963-a294-ed954a7478f7 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:05.223360 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-acacd3dd-2dca-4b89-9ad3-6323dedba25f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.100149 Dec 16 15:12:05.223982 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 863/1718] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:12:05 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:12:05.486289 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-ce6c0501-84ab-4963-a294-ed954a7478f7 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ee0c9e767b4895b9e063b28ae947d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb300a155af646228f7c0b155a5d63ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:12:05.495942 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-ce6c0501-84ab-4963-a294-ed954a7478f7 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] 10.222.0.45 "GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed" status: 200 len: 1350 microversion: 2.1 time: 0.362919 Dec 16 15:12:05.496545 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 856/1719] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:12:05 2021] GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed => generated 1350 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:12:06.239858 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-c0f1c957-2898-4648-b88d-c985873e2460 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:12:06.240805 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-c0f1c957-2898-4648-b88d-c985873e2460 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:12:06.248671 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c0f1c957-2898-4648-b88d-c985873e2460 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:06.249169 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c0f1c957-2898-4648-b88d-c985873e2460 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:06.250011 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c0f1c957-2898-4648-b88d-c985873e2460 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:06.250725 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c0f1c957-2898-4648-b88d-c985873e2460 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:06.322572 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-c0f1c957-2898-4648-b88d-c985873e2460 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090542 Dec 16 15:12:06.323210 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 864/1720] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:12:06 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:12:06.518913 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-0e5a7ec4-f7ad-4bd7-9a6f-d08ee3d5bdcb tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:12:06.519770 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-0e5a7ec4-f7ad-4bd7-9a6f-d08ee3d5bdcb tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] [instance: 64774bdb-b85b-4d86-9110-0b37d9c15bed] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:12:06.527806 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0e5a7ec4-f7ad-4bd7-9a6f-d08ee3d5bdcb tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:06.528321 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0e5a7ec4-f7ad-4bd7-9a6f-d08ee3d5bdcb tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:06.529171 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0e5a7ec4-f7ad-4bd7-9a6f-d08ee3d5bdcb tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:06.529731 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0e5a7ec4-f7ad-4bd7-9a6f-d08ee3d5bdcb tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:06.657707 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-0e5a7ec4-f7ad-4bd7-9a6f-d08ee3d5bdcb tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ee0c9e767b4895b9e063b28ae947d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb300a155af646228f7c0b155a5d63ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:12:06.667184 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-0e5a7ec4-f7ad-4bd7-9a6f-d08ee3d5bdcb tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] 10.222.0.45 "GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed" status: 200 len: 1350 microversion: 2.1 time: 0.156731 Dec 16 15:12:06.667782 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 857/1721] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:12:06 2021] GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed => generated 1350 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:12:07.338846 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-4554e2b8-0e43-43ff-a3d9-dcd6007b3304 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:12:07.340067 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-4554e2b8-0e43-43ff-a3d9-dcd6007b3304 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:12:07.348947 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4554e2b8-0e43-43ff-a3d9-dcd6007b3304 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:07.349455 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4554e2b8-0e43-43ff-a3d9-dcd6007b3304 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:07.350327 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4554e2b8-0e43-43ff-a3d9-dcd6007b3304 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:07.350827 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4554e2b8-0e43-43ff-a3d9-dcd6007b3304 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:07.561746 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-4554e2b8-0e43-43ff-a3d9-dcd6007b3304 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.230759 Dec 16 15:12:07.562398 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 865/1722] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:12:07 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:12:07.689057 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-ee4e00d7-5097-4e23-b945-c40de8c0a4d3 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:12:07.689737 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-ee4e00d7-5097-4e23-b945-c40de8c0a4d3 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] [instance: 64774bdb-b85b-4d86-9110-0b37d9c15bed] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:12:07.697554 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ee4e00d7-5097-4e23-b945-c40de8c0a4d3 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:07.698091 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ee4e00d7-5097-4e23-b945-c40de8c0a4d3 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:07.698955 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ee4e00d7-5097-4e23-b945-c40de8c0a4d3 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:07.699455 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ee4e00d7-5097-4e23-b945-c40de8c0a4d3 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:07.824858 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-ee4e00d7-5097-4e23-b945-c40de8c0a4d3 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ee0c9e767b4895b9e063b28ae947d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb300a155af646228f7c0b155a5d63ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:12:07.834806 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-ee4e00d7-5097-4e23-b945-c40de8c0a4d3 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] 10.222.0.45 "GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed" status: 200 len: 1350 microversion: 2.1 time: 0.153677 Dec 16 15:12:07.835604 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 858/1723] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:12:07 2021] GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed => generated 1350 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:12:08.578689 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-472928c0-03e8-4763-93ea-33258181df0a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:12:08.579738 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-472928c0-03e8-4763-93ea-33258181df0a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:12:08.587548 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-472928c0-03e8-4763-93ea-33258181df0a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:08.588053 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-472928c0-03e8-4763-93ea-33258181df0a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:08.588889 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-472928c0-03e8-4763-93ea-33258181df0a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:08.589379 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-472928c0-03e8-4763-93ea-33258181df0a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:08.661723 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-472928c0-03e8-4763-93ea-33258181df0a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091456 Dec 16 15:12:08.662359 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 866/1724] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:12:08 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:12:08.857182 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-861a5db8-9a82-4808-85e7-000bcf01b58f tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:12:08.857854 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-861a5db8-9a82-4808-85e7-000bcf01b58f tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] [instance: 64774bdb-b85b-4d86-9110-0b37d9c15bed] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:12:08.865762 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-861a5db8-9a82-4808-85e7-000bcf01b58f tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:08.866316 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-861a5db8-9a82-4808-85e7-000bcf01b58f tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:08.867160 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-861a5db8-9a82-4808-85e7-000bcf01b58f tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:08.867661 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-861a5db8-9a82-4808-85e7-000bcf01b58f tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:08.999029 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-861a5db8-9a82-4808-85e7-000bcf01b58f tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ee0c9e767b4895b9e063b28ae947d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb300a155af646228f7c0b155a5d63ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:12:09.008445 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-861a5db8-9a82-4808-85e7-000bcf01b58f tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] 10.222.0.45 "GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed" status: 200 len: 1350 microversion: 2.1 time: 0.158880 Dec 16 15:12:09.009038 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 859/1725] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:12:08 2021] GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed => generated 1350 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:12:09.676791 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-a1aaea21-f136-4faa-a200-d74526b016a4 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:12:09.677835 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-a1aaea21-f136-4faa-a200-d74526b016a4 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:12:09.685647 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a1aaea21-f136-4faa-a200-d74526b016a4 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:09.686204 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a1aaea21-f136-4faa-a200-d74526b016a4 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:09.687052 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a1aaea21-f136-4faa-a200-d74526b016a4 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:09.688064 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a1aaea21-f136-4faa-a200-d74526b016a4 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:09.759480 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-a1aaea21-f136-4faa-a200-d74526b016a4 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090424 Dec 16 15:12:09.760099 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 867/1726] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:12:09 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:12:10.029946 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-a4786884-0b8a-4e3f-a3c5-9a9ad2b317b7 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:12:10.030651 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-a4786884-0b8a-4e3f-a3c5-9a9ad2b317b7 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] [instance: 64774bdb-b85b-4d86-9110-0b37d9c15bed] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:12:10.038871 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a4786884-0b8a-4e3f-a3c5-9a9ad2b317b7 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:10.039386 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a4786884-0b8a-4e3f-a3c5-9a9ad2b317b7 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:10.040247 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a4786884-0b8a-4e3f-a3c5-9a9ad2b317b7 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:10.040747 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a4786884-0b8a-4e3f-a3c5-9a9ad2b317b7 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:10.075804 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 15:12:10.076028 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: Thu Dec 16 15:12:10 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed (ip 10.222.0.45) !!! Dec 16 15:12:10.181232 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-a4786884-0b8a-4e3f-a3c5-9a9ad2b317b7 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ee0c9e767b4895b9e063b28ae947d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb300a155af646228f7c0b155a5d63ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:12:10.191389 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-a4786884-0b8a-4e3f-a3c5-9a9ad2b317b7 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] 10.222.0.45 "GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed" status: 200 len: 1350 microversion: 2.1 time: 0.169101 Dec 16 15:12:10.191978 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 860/1727] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:12:10 2021] GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed => generated 1350 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:12:10.775640 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-e569c600-e112-457d-865e-4217efc4171e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:12:10.776683 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-e569c600-e112-457d-865e-4217efc4171e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:12:10.785233 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e569c600-e112-457d-865e-4217efc4171e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:10.785739 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e569c600-e112-457d-865e-4217efc4171e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:10.786603 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e569c600-e112-457d-865e-4217efc4171e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:10.787099 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e569c600-e112-457d-865e-4217efc4171e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:10.862568 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-e569c600-e112-457d-865e-4217efc4171e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094558 Dec 16 15:12:10.863242 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 868/1728] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:12:10 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:12:11.212862 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-a3f7ce0f-488e-4853-b504-6b7b8cfb669e tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:12:11.213572 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-a3f7ce0f-488e-4853-b504-6b7b8cfb669e tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] [instance: 64774bdb-b85b-4d86-9110-0b37d9c15bed] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:12:11.223042 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a3f7ce0f-488e-4853-b504-6b7b8cfb669e tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:11.223552 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a3f7ce0f-488e-4853-b504-6b7b8cfb669e tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:11.224398 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a3f7ce0f-488e-4853-b504-6b7b8cfb669e tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:11.224883 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a3f7ce0f-488e-4853-b504-6b7b8cfb669e tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:11.351761 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-a3f7ce0f-488e-4853-b504-6b7b8cfb669e tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ee0c9e767b4895b9e063b28ae947d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb300a155af646228f7c0b155a5d63ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:12:11.361515 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-a3f7ce0f-488e-4853-b504-6b7b8cfb669e tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] 10.222.0.45 "GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed" status: 200 len: 1350 microversion: 2.1 time: 0.156246 Dec 16 15:12:11.362124 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 861/1729] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:12:11 2021] GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed => generated 1350 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:12:11.879243 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-1aa91d35-1450-44a2-aec1-bb56339c85a8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:12:11.880290 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-1aa91d35-1450-44a2-aec1-bb56339c85a8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:12:11.888115 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1aa91d35-1450-44a2-aec1-bb56339c85a8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:11.888620 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1aa91d35-1450-44a2-aec1-bb56339c85a8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:11.889457 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1aa91d35-1450-44a2-aec1-bb56339c85a8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:11.889951 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1aa91d35-1450-44a2-aec1-bb56339c85a8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:11.965299 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-1aa91d35-1450-44a2-aec1-bb56339c85a8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094398 Dec 16 15:12:11.965917 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 869/1730] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:12:11 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:12:12.383994 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-66b19045-6916-4e35-a8b6-0335bd34b772 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:12:12.384661 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-66b19045-6916-4e35-a8b6-0335bd34b772 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] [instance: 64774bdb-b85b-4d86-9110-0b37d9c15bed] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:12:12.392478 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-66b19045-6916-4e35-a8b6-0335bd34b772 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:12.392977 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-66b19045-6916-4e35-a8b6-0335bd34b772 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:12.393854 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-66b19045-6916-4e35-a8b6-0335bd34b772 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:12.394369 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-66b19045-6916-4e35-a8b6-0335bd34b772 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:12.522089 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-66b19045-6916-4e35-a8b6-0335bd34b772 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ee0c9e767b4895b9e063b28ae947d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb300a155af646228f7c0b155a5d63ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:12:12.531995 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-66b19045-6916-4e35-a8b6-0335bd34b772 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] 10.222.0.45 "GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed" status: 200 len: 1350 microversion: 2.1 time: 0.155061 Dec 16 15:12:12.532585 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 862/1731] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:12:12 2021] GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed => generated 1350 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:12:12.981238 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-23f454aa-a8ac-45bf-9be7-b4dd0890d2e5 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:12:12.982497 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-23f454aa-a8ac-45bf-9be7-b4dd0890d2e5 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:12:12.990380 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-23f454aa-a8ac-45bf-9be7-b4dd0890d2e5 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:12.990881 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-23f454aa-a8ac-45bf-9be7-b4dd0890d2e5 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:12.991711 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-23f454aa-a8ac-45bf-9be7-b4dd0890d2e5 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:12.992196 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-23f454aa-a8ac-45bf-9be7-b4dd0890d2e5 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:13.065074 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-23f454aa-a8ac-45bf-9be7-b4dd0890d2e5 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091367 Dec 16 15:12:13.065676 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 870/1732] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:12:12 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:12:13.554121 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-e79bb96d-0446-406f-9da9-23997824f53a tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:12:13.554703 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-e79bb96d-0446-406f-9da9-23997824f53a tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] [instance: 64774bdb-b85b-4d86-9110-0b37d9c15bed] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:12:13.563496 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e79bb96d-0446-406f-9da9-23997824f53a tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:13.564046 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e79bb96d-0446-406f-9da9-23997824f53a tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:13.564886 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e79bb96d-0446-406f-9da9-23997824f53a tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:13.565382 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e79bb96d-0446-406f-9da9-23997824f53a tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:13.693383 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-e79bb96d-0446-406f-9da9-23997824f53a tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ee0c9e767b4895b9e063b28ae947d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb300a155af646228f7c0b155a5d63ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:12:13.702638 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-e79bb96d-0446-406f-9da9-23997824f53a tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] 10.222.0.45 "GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed" status: 200 len: 1350 microversion: 2.1 time: 0.156766 Dec 16 15:12:13.703222 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 863/1733] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:12:13 2021] GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed => generated 1350 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:12:14.080572 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-af6391ac-a895-4665-bd2c-888432d89aae tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:12:14.081613 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-af6391ac-a895-4665-bd2c-888432d89aae tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:12:14.089638 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-af6391ac-a895-4665-bd2c-888432d89aae tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:14.090165 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-af6391ac-a895-4665-bd2c-888432d89aae tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:14.090994 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-af6391ac-a895-4665-bd2c-888432d89aae tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:14.091478 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-af6391ac-a895-4665-bd2c-888432d89aae tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:14.162119 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-af6391ac-a895-4665-bd2c-888432d89aae tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089322 Dec 16 15:12:14.162739 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 871/1734] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:12:14 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:12:14.724488 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-4a693ab2-ec4b-4128-a05c-4b1f312e8da5 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:12:14.725082 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-4a693ab2-ec4b-4128-a05c-4b1f312e8da5 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] [instance: 64774bdb-b85b-4d86-9110-0b37d9c15bed] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:12:14.732967 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4a693ab2-ec4b-4128-a05c-4b1f312e8da5 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:14.733469 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4a693ab2-ec4b-4128-a05c-4b1f312e8da5 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:14.734390 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4a693ab2-ec4b-4128-a05c-4b1f312e8da5 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:14.734889 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4a693ab2-ec4b-4128-a05c-4b1f312e8da5 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:14.859760 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-4a693ab2-ec4b-4128-a05c-4b1f312e8da5 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ee0c9e767b4895b9e063b28ae947d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb300a155af646228f7c0b155a5d63ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:12:14.869178 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-4a693ab2-ec4b-4128-a05c-4b1f312e8da5 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] 10.222.0.45 "GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed" status: 200 len: 1350 microversion: 2.1 time: 0.152446 Dec 16 15:12:14.869770 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 864/1735] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:12:14 2021] GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed => generated 1350 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:12:15.178736 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-51fc248c-be81-4a73-8e36-971b3152eb60 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:12:15.179776 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-51fc248c-be81-4a73-8e36-971b3152eb60 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:12:15.188858 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-51fc248c-be81-4a73-8e36-971b3152eb60 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:15.189417 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-51fc248c-be81-4a73-8e36-971b3152eb60 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:15.190413 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-51fc248c-be81-4a73-8e36-971b3152eb60 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:15.190963 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-51fc248c-be81-4a73-8e36-971b3152eb60 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:15.264720 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-51fc248c-be81-4a73-8e36-971b3152eb60 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094327 Dec 16 15:12:15.265371 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 872/1736] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:12:15 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:12:15.891902 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-069c7973-1fad-4c7f-b5bd-ab95176721e0 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:12:15.892568 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-069c7973-1fad-4c7f-b5bd-ab95176721e0 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] [instance: 64774bdb-b85b-4d86-9110-0b37d9c15bed] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:12:15.900328 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-069c7973-1fad-4c7f-b5bd-ab95176721e0 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:15.900831 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-069c7973-1fad-4c7f-b5bd-ab95176721e0 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:15.901661 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-069c7973-1fad-4c7f-b5bd-ab95176721e0 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:15.902171 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-069c7973-1fad-4c7f-b5bd-ab95176721e0 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:16.030369 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-069c7973-1fad-4c7f-b5bd-ab95176721e0 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ee0c9e767b4895b9e063b28ae947d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb300a155af646228f7c0b155a5d63ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:12:16.040218 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-069c7973-1fad-4c7f-b5bd-ab95176721e0 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] 10.222.0.45 "GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed" status: 200 len: 1350 microversion: 2.1 time: 0.156645 Dec 16 15:12:16.040801 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 865/1737] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:12:15 2021] GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed => generated 1350 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:12:16.281340 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-290ae449-44d7-47fc-b112-944c9b03b712 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:12:16.282323 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-290ae449-44d7-47fc-b112-944c9b03b712 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:12:16.291355 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-290ae449-44d7-47fc-b112-944c9b03b712 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:16.293736 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-290ae449-44d7-47fc-b112-944c9b03b712 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:16.294641 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-290ae449-44d7-47fc-b112-944c9b03b712 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:16.295141 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-290ae449-44d7-47fc-b112-944c9b03b712 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:16.366141 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-290ae449-44d7-47fc-b112-944c9b03b712 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092611 Dec 16 15:12:16.366763 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 873/1738] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:12:16 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:12:17.063339 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-b13109e0-9f0e-4be9-9167-8aacf54cd4d1 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:12:17.064018 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-b13109e0-9f0e-4be9-9167-8aacf54cd4d1 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] [instance: 64774bdb-b85b-4d86-9110-0b37d9c15bed] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:12:17.071997 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b13109e0-9f0e-4be9-9167-8aacf54cd4d1 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:17.072507 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b13109e0-9f0e-4be9-9167-8aacf54cd4d1 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:17.073355 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b13109e0-9f0e-4be9-9167-8aacf54cd4d1 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:17.073858 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b13109e0-9f0e-4be9-9167-8aacf54cd4d1 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:17.202020 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-b13109e0-9f0e-4be9-9167-8aacf54cd4d1 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ee0c9e767b4895b9e063b28ae947d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb300a155af646228f7c0b155a5d63ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:12:17.211352 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-b13109e0-9f0e-4be9-9167-8aacf54cd4d1 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] 10.222.0.45 "GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed" status: 200 len: 1350 microversion: 2.1 time: 0.156023 Dec 16 15:12:17.211936 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 866/1739] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:12:17 2021] GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed => generated 1350 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:12:17.382827 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-c3101d1a-44f5-48d9-b3b9-521898afa8d1 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:12:17.383991 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-c3101d1a-44f5-48d9-b3b9-521898afa8d1 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:12:17.392345 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c3101d1a-44f5-48d9-b3b9-521898afa8d1 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:17.392846 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c3101d1a-44f5-48d9-b3b9-521898afa8d1 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:17.393679 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c3101d1a-44f5-48d9-b3b9-521898afa8d1 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:17.394188 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c3101d1a-44f5-48d9-b3b9-521898afa8d1 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:17.463666 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-c3101d1a-44f5-48d9-b3b9-521898afa8d1 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089187 Dec 16 15:12:17.464277 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 874/1740] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:12:17 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:12:18.233545 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-3f7ee6c1-0a76-4073-82db-6f2f4227a7fc tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:12:18.234248 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-3f7ee6c1-0a76-4073-82db-6f2f4227a7fc tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] [instance: 64774bdb-b85b-4d86-9110-0b37d9c15bed] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:12:18.241991 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3f7ee6c1-0a76-4073-82db-6f2f4227a7fc tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:18.242554 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3f7ee6c1-0a76-4073-82db-6f2f4227a7fc tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:18.243406 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3f7ee6c1-0a76-4073-82db-6f2f4227a7fc tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:18.243898 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3f7ee6c1-0a76-4073-82db-6f2f4227a7fc tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:18.373341 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-3f7ee6c1-0a76-4073-82db-6f2f4227a7fc tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ee0c9e767b4895b9e063b28ae947d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb300a155af646228f7c0b155a5d63ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:12:18.382825 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-3f7ee6c1-0a76-4073-82db-6f2f4227a7fc tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] 10.222.0.45 "GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed" status: 200 len: 1350 microversion: 2.1 time: 0.156875 Dec 16 15:12:18.383417 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 867/1741] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:12:18 2021] GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed => generated 1350 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:12:18.480932 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-66c0d862-acbd-4212-a2b1-d7988800ee5d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:12:18.481979 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-66c0d862-acbd-4212-a2b1-d7988800ee5d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:12:18.489959 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-66c0d862-acbd-4212-a2b1-d7988800ee5d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:18.490448 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-66c0d862-acbd-4212-a2b1-d7988800ee5d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:18.491296 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-66c0d862-acbd-4212-a2b1-d7988800ee5d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:18.491790 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-66c0d862-acbd-4212-a2b1-d7988800ee5d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:18.563986 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-66c0d862-acbd-4212-a2b1-d7988800ee5d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091943 Dec 16 15:12:18.564596 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 875/1742] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:12:18 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:12:19.406973 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-873ce516-2b07-44b3-b7e5-eddfbc87c488 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:12:19.407648 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-873ce516-2b07-44b3-b7e5-eddfbc87c488 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] [instance: 64774bdb-b85b-4d86-9110-0b37d9c15bed] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:12:19.416393 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-873ce516-2b07-44b3-b7e5-eddfbc87c488 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:19.416902 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-873ce516-2b07-44b3-b7e5-eddfbc87c488 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:19.417750 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-873ce516-2b07-44b3-b7e5-eddfbc87c488 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:19.418275 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-873ce516-2b07-44b3-b7e5-eddfbc87c488 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:19.546093 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-873ce516-2b07-44b3-b7e5-eddfbc87c488 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ee0c9e767b4895b9e063b28ae947d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb300a155af646228f7c0b155a5d63ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:12:19.555941 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-873ce516-2b07-44b3-b7e5-eddfbc87c488 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] 10.222.0.45 "GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed" status: 200 len: 1350 microversion: 2.1 time: 0.158638 Dec 16 15:12:19.556534 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 868/1743] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:12:19 2021] GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed => generated 1350 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:12:19.579874 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-4e961dd2-8b60-4cc6-a773-ab31d12ebf76 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:12:19.580902 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-4e961dd2-8b60-4cc6-a773-ab31d12ebf76 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:12:19.588591 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4e961dd2-8b60-4cc6-a773-ab31d12ebf76 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:19.589097 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4e961dd2-8b60-4cc6-a773-ab31d12ebf76 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:19.589922 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4e961dd2-8b60-4cc6-a773-ab31d12ebf76 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:19.590429 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4e961dd2-8b60-4cc6-a773-ab31d12ebf76 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:19.663282 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-4e961dd2-8b60-4cc6-a773-ab31d12ebf76 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091048 Dec 16 15:12:19.663803 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 876/1744] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:12:19 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:12:20.579119 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-e45be670-5dc4-45f6-a417-3f8ee2cbffb3 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:12:20.579804 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-e45be670-5dc4-45f6-a417-3f8ee2cbffb3 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] [instance: 64774bdb-b85b-4d86-9110-0b37d9c15bed] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:12:20.587591 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e45be670-5dc4-45f6-a417-3f8ee2cbffb3 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:20.588103 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e45be670-5dc4-45f6-a417-3f8ee2cbffb3 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:20.592820 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e45be670-5dc4-45f6-a417-3f8ee2cbffb3 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:20.592820 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e45be670-5dc4-45f6-a417-3f8ee2cbffb3 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:20.679396 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-21d5642c-2157-4f1c-ac85-e3d5b090bc09 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:12:20.680412 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-21d5642c-2157-4f1c-ac85-e3d5b090bc09 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:12:20.689040 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-21d5642c-2157-4f1c-ac85-e3d5b090bc09 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:20.689547 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-21d5642c-2157-4f1c-ac85-e3d5b090bc09 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:20.690462 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-21d5642c-2157-4f1c-ac85-e3d5b090bc09 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:20.690949 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-21d5642c-2157-4f1c-ac85-e3d5b090bc09 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:20.718705 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-e45be670-5dc4-45f6-a417-3f8ee2cbffb3 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ee0c9e767b4895b9e063b28ae947d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb300a155af646228f7c0b155a5d63ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:12:20.727998 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-e45be670-5dc4-45f6-a417-3f8ee2cbffb3 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] 10.222.0.45 "GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed" status: 200 len: 1350 microversion: 2.1 time: 0.157017 Dec 16 15:12:20.728597 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 869/1745] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:12:20 2021] GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed => generated 1350 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:12:20.761949 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-21d5642c-2157-4f1c-ac85-e3d5b090bc09 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090496 Dec 16 15:12:20.762599 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 877/1746] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:12:20 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 15:12:21.749675 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-7e07455c-f2af-495f-881d-9d956f2f8966 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:12:21.750909 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-7e07455c-f2af-495f-881d-9d956f2f8966 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] [instance: 64774bdb-b85b-4d86-9110-0b37d9c15bed] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:12:21.758859 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7e07455c-f2af-495f-881d-9d956f2f8966 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:21.759369 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7e07455c-f2af-495f-881d-9d956f2f8966 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:21.760203 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7e07455c-f2af-495f-881d-9d956f2f8966 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:21.760701 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7e07455c-f2af-495f-881d-9d956f2f8966 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:21.778370 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-e8f24aeb-cdc6-4fb3-b250-1fdf1a43e65e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:12:21.779413 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-e8f24aeb-cdc6-4fb3-b250-1fdf1a43e65e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:12:21.787231 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e8f24aeb-cdc6-4fb3-b250-1fdf1a43e65e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:21.787748 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e8f24aeb-cdc6-4fb3-b250-1fdf1a43e65e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:21.788581 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e8f24aeb-cdc6-4fb3-b250-1fdf1a43e65e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:21.789078 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e8f24aeb-cdc6-4fb3-b250-1fdf1a43e65e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:21.860625 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-e8f24aeb-cdc6-4fb3-b250-1fdf1a43e65e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089878 Dec 16 15:12:21.861258 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 878/1747] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:12:21 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 15:12:21.887749 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-7e07455c-f2af-495f-881d-9d956f2f8966 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ee0c9e767b4895b9e063b28ae947d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb300a155af646228f7c0b155a5d63ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:12:21.897175 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-7e07455c-f2af-495f-881d-9d956f2f8966 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] 10.222.0.45 "GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed" status: 200 len: 1350 microversion: 2.1 time: 0.155030 Dec 16 15:12:21.897763 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 870/1748] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:12:21 2021] GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed => generated 1350 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:12:22.876629 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-ac53e3b9-6f3c-41f6-9247-46032c13725c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:12:22.877671 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-ac53e3b9-6f3c-41f6-9247-46032c13725c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:12:22.880751 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 15:12:22.880901 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: Thu Dec 16 15:12:22 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments (ip 10.222.0.45) !!! Dec 16 15:12:22.897274 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ac53e3b9-6f3c-41f6-9247-46032c13725c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:22.897785 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ac53e3b9-6f3c-41f6-9247-46032c13725c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:22.898661 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ac53e3b9-6f3c-41f6-9247-46032c13725c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:22.899160 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ac53e3b9-6f3c-41f6-9247-46032c13725c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:22.918421 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-6f7b3c8d-47f6-4569-b3ca-c863090f9ee4 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:12:22.919086 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-6f7b3c8d-47f6-4569-b3ca-c863090f9ee4 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] [instance: 64774bdb-b85b-4d86-9110-0b37d9c15bed] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:12:22.927354 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6f7b3c8d-47f6-4569-b3ca-c863090f9ee4 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:22.927874 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6f7b3c8d-47f6-4569-b3ca-c863090f9ee4 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:22.928710 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6f7b3c8d-47f6-4569-b3ca-c863090f9ee4 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:22.929193 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6f7b3c8d-47f6-4569-b3ca-c863090f9ee4 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:22.976323 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-ac53e3b9-6f3c-41f6-9247-46032c13725c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.107414 Dec 16 15:12:22.976938 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 879/1749] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:12:22 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:12:23.059433 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-6f7b3c8d-47f6-4569-b3ca-c863090f9ee4 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ee0c9e767b4895b9e063b28ae947d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb300a155af646228f7c0b155a5d63ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:12:23.069479 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-6f7b3c8d-47f6-4569-b3ca-c863090f9ee4 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] 10.222.0.45 "GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed" status: 200 len: 1350 microversion: 2.1 time: 0.158680 Dec 16 15:12:23.070077 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 871/1750] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:12:22 2021] GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed => generated 1350 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:12:23.992668 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-452a1c11-8ef4-4135-a36c-ad4d439e35da tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:12:23.993713 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-452a1c11-8ef4-4135-a36c-ad4d439e35da tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:12:24.001682 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-452a1c11-8ef4-4135-a36c-ad4d439e35da tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:24.002246 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-452a1c11-8ef4-4135-a36c-ad4d439e35da tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:24.003090 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-452a1c11-8ef4-4135-a36c-ad4d439e35da tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:24.003582 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-452a1c11-8ef4-4135-a36c-ad4d439e35da tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:24.080562 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-452a1c11-8ef4-4135-a36c-ad4d439e35da tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096229 Dec 16 15:12:24.081182 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 880/1751] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:12:23 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:12:24.091630 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-4daa1092-ac4f-4382-9b75-0b9cf39ba739 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:12:24.092300 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-4daa1092-ac4f-4382-9b75-0b9cf39ba739 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] [instance: 64774bdb-b85b-4d86-9110-0b37d9c15bed] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:12:24.101021 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4daa1092-ac4f-4382-9b75-0b9cf39ba739 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:24.101515 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4daa1092-ac4f-4382-9b75-0b9cf39ba739 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:24.102392 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4daa1092-ac4f-4382-9b75-0b9cf39ba739 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:24.102879 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4daa1092-ac4f-4382-9b75-0b9cf39ba739 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:24.235196 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-4daa1092-ac4f-4382-9b75-0b9cf39ba739 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ee0c9e767b4895b9e063b28ae947d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb300a155af646228f7c0b155a5d63ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:12:24.244689 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-4daa1092-ac4f-4382-9b75-0b9cf39ba739 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] 10.222.0.45 "GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed" status: 200 len: 1350 microversion: 2.1 time: 0.160634 Dec 16 15:12:24.245214 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 872/1752] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:12:24 2021] GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed => generated 1350 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:12:25.089499 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c006f2bf-d7e6-4bb8-aace-c3797b4b538d] AMQP server on 10.222.0.45:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 15:12:25.096923 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-a85ca852-e3df-44d6-b61d-4b9ded382ea2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:12:25.097948 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-a85ca852-e3df-44d6-b61d-4b9ded382ea2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:12:25.106402 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a85ca852-e3df-44d6-b61d-4b9ded382ea2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:25.106913 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a85ca852-e3df-44d6-b61d-4b9ded382ea2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:25.107812 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a85ca852-e3df-44d6-b61d-4b9ded382ea2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:25.108300 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a85ca852-e3df-44d6-b61d-4b9ded382ea2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:25.232587 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-a85ca852-e3df-44d6-b61d-4b9ded382ea2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.144464 Dec 16 15:12:25.233199 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 881/1753] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:12:25 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:12:25.266184 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-b2687187-fad8-47f7-89be-ca8548181124 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:12:25.266857 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-b2687187-fad8-47f7-89be-ca8548181124 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] [instance: 64774bdb-b85b-4d86-9110-0b37d9c15bed] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:12:25.274680 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b2687187-fad8-47f7-89be-ca8548181124 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:25.275195 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b2687187-fad8-47f7-89be-ca8548181124 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:25.276037 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b2687187-fad8-47f7-89be-ca8548181124 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:25.276536 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b2687187-fad8-47f7-89be-ca8548181124 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:25.404570 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-b2687187-fad8-47f7-89be-ca8548181124 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ee0c9e767b4895b9e063b28ae947d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb300a155af646228f7c0b155a5d63ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:12:25.414019 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-b2687187-fad8-47f7-89be-ca8548181124 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] 10.222.0.45 "GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed" status: 200 len: 1350 microversion: 2.1 time: 0.155405 Dec 16 15:12:25.414639 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 873/1754] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:12:25 2021] GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed => generated 1350 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:12:26.249331 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-d0372696-1a91-4202-ac20-50f2bb61b0df tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:12:26.250892 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-d0372696-1a91-4202-ac20-50f2bb61b0df tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:12:26.270614 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d0372696-1a91-4202-ac20-50f2bb61b0df tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:26.271128 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d0372696-1a91-4202-ac20-50f2bb61b0df tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:26.271983 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d0372696-1a91-4202-ac20-50f2bb61b0df tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:26.272473 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d0372696-1a91-4202-ac20-50f2bb61b0df tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:26.305752 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO oslo.messaging._drivers.impl_rabbit [-] [c006f2bf-d7e6-4bb8-aace-c3797b4b538d] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 47752. Dec 16 15:12:26.344473 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-d0372696-1a91-4202-ac20-50f2bb61b0df tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.103029 Dec 16 15:12:26.345298 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 882/1755] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:12:26 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:12:26.435665 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-8a9ff6dc-3492-4814-be02-931f9586e474 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:12:26.436343 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-8a9ff6dc-3492-4814-be02-931f9586e474 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] [instance: 64774bdb-b85b-4d86-9110-0b37d9c15bed] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:12:26.445163 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8a9ff6dc-3492-4814-be02-931f9586e474 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:26.445672 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8a9ff6dc-3492-4814-be02-931f9586e474 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:26.446566 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8a9ff6dc-3492-4814-be02-931f9586e474 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:26.447066 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8a9ff6dc-3492-4814-be02-931f9586e474 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:26.588036 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-8a9ff6dc-3492-4814-be02-931f9586e474 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ee0c9e767b4895b9e063b28ae947d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb300a155af646228f7c0b155a5d63ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:12:26.597725 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-8a9ff6dc-3492-4814-be02-931f9586e474 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] 10.222.0.45 "GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed" status: 200 len: 1350 microversion: 2.1 time: 0.169594 Dec 16 15:12:26.598329 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 874/1756] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:12:26 2021] GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed => generated 1350 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:12:27.360980 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-9d68930f-7bfb-411f-8196-ed19fa0371b2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:12:27.362028 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-9d68930f-7bfb-411f-8196-ed19fa0371b2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:12:27.369858 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9d68930f-7bfb-411f-8196-ed19fa0371b2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:27.370396 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9d68930f-7bfb-411f-8196-ed19fa0371b2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:27.371241 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9d68930f-7bfb-411f-8196-ed19fa0371b2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:27.371730 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9d68930f-7bfb-411f-8196-ed19fa0371b2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:27.446324 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-9d68930f-7bfb-411f-8196-ed19fa0371b2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093363 Dec 16 15:12:27.446936 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 883/1757] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:12:27 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:12:27.620112 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-79353ad4-d21b-43cb-9400-ab91774bb8f4 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:12:27.620724 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-79353ad4-d21b-43cb-9400-ab91774bb8f4 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] [instance: 64774bdb-b85b-4d86-9110-0b37d9c15bed] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:12:27.628634 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-79353ad4-d21b-43cb-9400-ab91774bb8f4 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:27.629147 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-79353ad4-d21b-43cb-9400-ab91774bb8f4 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:27.630032 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-79353ad4-d21b-43cb-9400-ab91774bb8f4 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:27.630551 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-79353ad4-d21b-43cb-9400-ab91774bb8f4 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:27.761140 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-79353ad4-d21b-43cb-9400-ab91774bb8f4 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ee0c9e767b4895b9e063b28ae947d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb300a155af646228f7c0b155a5d63ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:12:27.770888 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-79353ad4-d21b-43cb-9400-ab91774bb8f4 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] 10.222.0.45 "GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed" status: 200 len: 1350 microversion: 2.1 time: 0.158529 Dec 16 15:12:27.771484 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 875/1758] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:12:27 2021] GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed => generated 1350 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:12:28.463019 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-56c23314-f9b0-459d-87a4-1409d8be667b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:12:28.464061 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-56c23314-f9b0-459d-87a4-1409d8be667b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:12:28.471908 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-56c23314-f9b0-459d-87a4-1409d8be667b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:28.472415 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-56c23314-f9b0-459d-87a4-1409d8be667b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:28.473255 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-56c23314-f9b0-459d-87a4-1409d8be667b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:28.473742 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-56c23314-f9b0-459d-87a4-1409d8be667b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:28.543963 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-56c23314-f9b0-459d-87a4-1409d8be667b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088729 Dec 16 15:12:28.544574 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 884/1759] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:12:28 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:12:28.836245 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-e543a3f0-0c37-46cb-914d-b51e592971cf tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:12:28.836926 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-e543a3f0-0c37-46cb-914d-b51e592971cf tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] [instance: 64774bdb-b85b-4d86-9110-0b37d9c15bed] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:12:28.845663 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e543a3f0-0c37-46cb-914d-b51e592971cf tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:28.846201 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e543a3f0-0c37-46cb-914d-b51e592971cf tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:28.847077 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e543a3f0-0c37-46cb-914d-b51e592971cf tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:28.847575 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e543a3f0-0c37-46cb-914d-b51e592971cf tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:28.983801 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-e543a3f0-0c37-46cb-914d-b51e592971cf tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ee0c9e767b4895b9e063b28ae947d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb300a155af646228f7c0b155a5d63ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:12:28.993339 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-e543a3f0-0c37-46cb-914d-b51e592971cf tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] 10.222.0.45 "GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed" status: 200 len: 1350 microversion: 2.1 time: 0.165575 Dec 16 15:12:28.993944 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 876/1760] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:12:28 2021] GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed => generated 1350 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:12:29.560488 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-0fb1c6dd-6029-4d28-b4b2-aae8036fc17a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:12:29.561536 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-0fb1c6dd-6029-4d28-b4b2-aae8036fc17a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:12:29.569672 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0fb1c6dd-6029-4d28-b4b2-aae8036fc17a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:29.570238 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0fb1c6dd-6029-4d28-b4b2-aae8036fc17a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:29.571080 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0fb1c6dd-6029-4d28-b4b2-aae8036fc17a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:29.571575 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0fb1c6dd-6029-4d28-b4b2-aae8036fc17a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:29.642352 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-0fb1c6dd-6029-4d28-b4b2-aae8036fc17a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089507 Dec 16 15:12:29.642905 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 885/1761] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:12:29 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:12:30.015574 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-5710aecd-cc11-4adf-9a54-d234618ba2c0 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:12:30.016891 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-5710aecd-cc11-4adf-9a54-d234618ba2c0 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] [instance: 64774bdb-b85b-4d86-9110-0b37d9c15bed] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:12:30.024857 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5710aecd-cc11-4adf-9a54-d234618ba2c0 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:30.025374 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5710aecd-cc11-4adf-9a54-d234618ba2c0 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:30.026300 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5710aecd-cc11-4adf-9a54-d234618ba2c0 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:30.026813 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5710aecd-cc11-4adf-9a54-d234618ba2c0 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:30.165568 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-5710aecd-cc11-4adf-9a54-d234618ba2c0 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ee0c9e767b4895b9e063b28ae947d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb300a155af646228f7c0b155a5d63ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:12:30.175289 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-5710aecd-cc11-4adf-9a54-d234618ba2c0 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] 10.222.0.45 "GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed" status: 200 len: 1350 microversion: 2.1 time: 0.167411 Dec 16 15:12:30.175895 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 877/1762] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:12:30 2021] GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed => generated 1350 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:12:30.658204 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-a9643af0-3e8b-4596-a45e-3f1c3d63f9a7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:12:30.659239 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-a9643af0-3e8b-4596-a45e-3f1c3d63f9a7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:12:30.666975 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a9643af0-3e8b-4596-a45e-3f1c3d63f9a7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:30.667479 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a9643af0-3e8b-4596-a45e-3f1c3d63f9a7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:30.668307 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a9643af0-3e8b-4596-a45e-3f1c3d63f9a7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:30.668789 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a9643af0-3e8b-4596-a45e-3f1c3d63f9a7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:30.738755 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-a9643af0-3e8b-4596-a45e-3f1c3d63f9a7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088116 Dec 16 15:12:30.739283 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 886/1763] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:12:30 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:12:31.197359 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-497074bd-136f-4942-a5ab-121f8dd55c62 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:12:31.198089 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-497074bd-136f-4942-a5ab-121f8dd55c62 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] [instance: 64774bdb-b85b-4d86-9110-0b37d9c15bed] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:12:31.206129 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-497074bd-136f-4942-a5ab-121f8dd55c62 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:31.206648 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-497074bd-136f-4942-a5ab-121f8dd55c62 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:31.207721 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-497074bd-136f-4942-a5ab-121f8dd55c62 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:31.207987 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-497074bd-136f-4942-a5ab-121f8dd55c62 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:31.339370 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-497074bd-136f-4942-a5ab-121f8dd55c62 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ee0c9e767b4895b9e063b28ae947d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb300a155af646228f7c0b155a5d63ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:12:31.349449 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-497074bd-136f-4942-a5ab-121f8dd55c62 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] 10.222.0.45 "GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed" status: 200 len: 1350 microversion: 2.1 time: 0.159775 Dec 16 15:12:31.350242 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 878/1764] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:12:31 2021] GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed => generated 1350 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:12:31.754867 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-b5a169cd-2a0d-4ba3-a827-0eb7eaf63d98 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:12:31.755894 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-b5a169cd-2a0d-4ba3-a827-0eb7eaf63d98 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:12:31.763818 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b5a169cd-2a0d-4ba3-a827-0eb7eaf63d98 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:31.764312 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b5a169cd-2a0d-4ba3-a827-0eb7eaf63d98 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:31.765143 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b5a169cd-2a0d-4ba3-a827-0eb7eaf63d98 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:31.765628 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b5a169cd-2a0d-4ba3-a827-0eb7eaf63d98 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:31.845593 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-b5a169cd-2a0d-4ba3-a827-0eb7eaf63d98 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.098555 Dec 16 15:12:31.846312 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 887/1765] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:12:31 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:12:32.371274 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-f75057cc-c4be-483c-9776-b369fa25c8df tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:12:32.371947 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-f75057cc-c4be-483c-9776-b369fa25c8df tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] [instance: 64774bdb-b85b-4d86-9110-0b37d9c15bed] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:12:32.380595 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f75057cc-c4be-483c-9776-b369fa25c8df tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:32.381104 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f75057cc-c4be-483c-9776-b369fa25c8df tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:32.381954 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f75057cc-c4be-483c-9776-b369fa25c8df tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:32.382668 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f75057cc-c4be-483c-9776-b369fa25c8df tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:32.519093 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-f75057cc-c4be-483c-9776-b369fa25c8df tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ee0c9e767b4895b9e063b28ae947d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb300a155af646228f7c0b155a5d63ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:12:32.528406 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-f75057cc-c4be-483c-9776-b369fa25c8df tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] 10.222.0.45 "GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed" status: 200 len: 1350 microversion: 2.1 time: 0.164918 Dec 16 15:12:32.528972 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 879/1766] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:12:32 2021] GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed => generated 1350 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:12:32.862119 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-95ff6f08-7e13-4fc7-b5b8-e9d816599ed7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:12:32.863161 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-95ff6f08-7e13-4fc7-b5b8-e9d816599ed7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:12:32.870909 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-95ff6f08-7e13-4fc7-b5b8-e9d816599ed7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:32.871411 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-95ff6f08-7e13-4fc7-b5b8-e9d816599ed7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:32.872239 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-95ff6f08-7e13-4fc7-b5b8-e9d816599ed7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:32.872764 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-95ff6f08-7e13-4fc7-b5b8-e9d816599ed7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:32.943967 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-95ff6f08-7e13-4fc7-b5b8-e9d816599ed7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090100 Dec 16 15:12:32.944581 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 888/1767] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:12:32 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:12:33.550493 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-0ead8417-91dd-4295-9db6-dcb3ea9bd8e0 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:12:33.551169 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-0ead8417-91dd-4295-9db6-dcb3ea9bd8e0 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] [instance: 64774bdb-b85b-4d86-9110-0b37d9c15bed] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:12:33.558984 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0ead8417-91dd-4295-9db6-dcb3ea9bd8e0 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:33.559495 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0ead8417-91dd-4295-9db6-dcb3ea9bd8e0 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:33.560338 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0ead8417-91dd-4295-9db6-dcb3ea9bd8e0 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:33.560838 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0ead8417-91dd-4295-9db6-dcb3ea9bd8e0 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:33.688553 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-0ead8417-91dd-4295-9db6-dcb3ea9bd8e0 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ee0c9e767b4895b9e063b28ae947d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb300a155af646228f7c0b155a5d63ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:12:33.697795 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-0ead8417-91dd-4295-9db6-dcb3ea9bd8e0 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] 10.222.0.45 "GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed" status: 200 len: 1350 microversion: 2.1 time: 0.155560 Dec 16 15:12:33.698475 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 880/1768] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:12:33 2021] GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed => generated 1350 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:12:33.960615 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-f9ecee89-59cb-4af2-9f3f-4ab2e235cef1 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:12:33.961699 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-f9ecee89-59cb-4af2-9f3f-4ab2e235cef1 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:12:33.970160 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f9ecee89-59cb-4af2-9f3f-4ab2e235cef1 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:33.970673 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f9ecee89-59cb-4af2-9f3f-4ab2e235cef1 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:33.971513 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f9ecee89-59cb-4af2-9f3f-4ab2e235cef1 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:33.972013 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f9ecee89-59cb-4af2-9f3f-4ab2e235cef1 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:34.042331 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-f9ecee89-59cb-4af2-9f3f-4ab2e235cef1 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089796 Dec 16 15:12:34.042951 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 889/1769] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:12:33 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:12:34.720087 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-d39be196-7cfb-42d8-af60-219503152871 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:12:34.720758 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-d39be196-7cfb-42d8-af60-219503152871 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] [instance: 64774bdb-b85b-4d86-9110-0b37d9c15bed] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:12:34.728891 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d39be196-7cfb-42d8-af60-219503152871 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:34.729403 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d39be196-7cfb-42d8-af60-219503152871 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:34.730276 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d39be196-7cfb-42d8-af60-219503152871 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:34.730778 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d39be196-7cfb-42d8-af60-219503152871 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:34.863634 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-d39be196-7cfb-42d8-af60-219503152871 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ee0c9e767b4895b9e063b28ae947d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb300a155af646228f7c0b155a5d63ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:12:34.873025 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-d39be196-7cfb-42d8-af60-219503152871 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] 10.222.0.45 "GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed" status: 200 len: 1350 microversion: 2.1 time: 0.161132 Dec 16 15:12:34.873629 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 881/1770] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:12:34 2021] GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed => generated 1350 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:12:35.057944 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-b846b951-32ad-4936-aba8-71e8cba7650b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:12:35.058957 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-b846b951-32ad-4936-aba8-71e8cba7650b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:12:35.067439 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b846b951-32ad-4936-aba8-71e8cba7650b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:35.067943 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b846b951-32ad-4936-aba8-71e8cba7650b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:35.068765 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b846b951-32ad-4936-aba8-71e8cba7650b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:35.069248 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b846b951-32ad-4936-aba8-71e8cba7650b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:35.139268 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-b846b951-32ad-4936-aba8-71e8cba7650b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089215 Dec 16 15:12:35.139886 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 890/1771] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:12:35 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:12:35.894968 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-5824467b-2903-4b7c-a561-c9ce9075fd98 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:12:35.895641 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-5824467b-2903-4b7c-a561-c9ce9075fd98 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] [instance: 64774bdb-b85b-4d86-9110-0b37d9c15bed] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:12:35.903453 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5824467b-2903-4b7c-a561-c9ce9075fd98 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:35.903969 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5824467b-2903-4b7c-a561-c9ce9075fd98 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:35.904812 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5824467b-2903-4b7c-a561-c9ce9075fd98 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:35.905309 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5824467b-2903-4b7c-a561-c9ce9075fd98 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:36.031275 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-5824467b-2903-4b7c-a561-c9ce9075fd98 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ee0c9e767b4895b9e063b28ae947d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb300a155af646228f7c0b155a5d63ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:12:36.041149 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-5824467b-2903-4b7c-a561-c9ce9075fd98 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] 10.222.0.45 "GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed" status: 200 len: 1350 microversion: 2.1 time: 0.153926 Dec 16 15:12:36.041737 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 882/1772] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:12:35 2021] GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed => generated 1350 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:12:36.155885 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-90c367e4-76d2-4315-ac97-fc549d36e585 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:12:36.157523 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-90c367e4-76d2-4315-ac97-fc549d36e585 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:12:36.165303 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-90c367e4-76d2-4315-ac97-fc549d36e585 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:36.165815 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-90c367e4-76d2-4315-ac97-fc549d36e585 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:36.166705 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-90c367e4-76d2-4315-ac97-fc549d36e585 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:36.167198 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-90c367e4-76d2-4315-ac97-fc549d36e585 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:36.244668 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-90c367e4-76d2-4315-ac97-fc549d36e585 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096536 Dec 16 15:12:36.245622 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 891/1773] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:12:36 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:12:37.063148 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-b7115fe8-727d-447d-b014-0ad2838e9834 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:12:37.063814 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-b7115fe8-727d-447d-b014-0ad2838e9834 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] [instance: 64774bdb-b85b-4d86-9110-0b37d9c15bed] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:12:37.071617 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b7115fe8-727d-447d-b014-0ad2838e9834 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:37.072131 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b7115fe8-727d-447d-b014-0ad2838e9834 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:37.072974 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b7115fe8-727d-447d-b014-0ad2838e9834 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:37.073473 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b7115fe8-727d-447d-b014-0ad2838e9834 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:37.206707 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-b7115fe8-727d-447d-b014-0ad2838e9834 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ee0c9e767b4895b9e063b28ae947d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb300a155af646228f7c0b155a5d63ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:12:37.216076 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-b7115fe8-727d-447d-b014-0ad2838e9834 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] 10.222.0.45 "GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed" status: 200 len: 1350 microversion: 2.1 time: 0.161369 Dec 16 15:12:37.216674 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 883/1774] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:12:37 2021] GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed => generated 1350 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:12:37.260531 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-ca9df6f4-d938-4f19-a55d-a2826c7a90b4 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:12:37.261576 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-ca9df6f4-d938-4f19-a55d-a2826c7a90b4 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:12:37.269390 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ca9df6f4-d938-4f19-a55d-a2826c7a90b4 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:37.269903 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ca9df6f4-d938-4f19-a55d-a2826c7a90b4 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:37.270791 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ca9df6f4-d938-4f19-a55d-a2826c7a90b4 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:37.271286 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ca9df6f4-d938-4f19-a55d-a2826c7a90b4 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:37.343380 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-ca9df6f4-d938-4f19-a55d-a2826c7a90b4 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090584 Dec 16 15:12:37.344516 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 892/1775] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:12:37 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:12:38.240769 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-1e1fa3c3-07ff-41ec-a700-e901bf5b3fd7 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:12:38.241576 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-1e1fa3c3-07ff-41ec-a700-e901bf5b3fd7 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] [instance: 64774bdb-b85b-4d86-9110-0b37d9c15bed] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:12:38.250349 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1e1fa3c3-07ff-41ec-a700-e901bf5b3fd7 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:38.250950 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1e1fa3c3-07ff-41ec-a700-e901bf5b3fd7 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:38.251847 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1e1fa3c3-07ff-41ec-a700-e901bf5b3fd7 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:38.252347 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1e1fa3c3-07ff-41ec-a700-e901bf5b3fd7 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:38.360861 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-01be3354-52fd-49c0-8a9f-f36cd838cc43 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:12:38.361909 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-01be3354-52fd-49c0-8a9f-f36cd838cc43 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:12:38.369950 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-01be3354-52fd-49c0-8a9f-f36cd838cc43 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:38.370490 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-01be3354-52fd-49c0-8a9f-f36cd838cc43 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:38.371339 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-01be3354-52fd-49c0-8a9f-f36cd838cc43 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:38.371829 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-01be3354-52fd-49c0-8a9f-f36cd838cc43 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:38.381310 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-1e1fa3c3-07ff-41ec-a700-e901bf5b3fd7 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ee0c9e767b4895b9e063b28ae947d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb300a155af646228f7c0b155a5d63ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:12:38.392930 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-1e1fa3c3-07ff-41ec-a700-e901bf5b3fd7 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] 10.222.0.45 "GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed" status: 200 len: 1350 microversion: 2.1 time: 0.162279 Dec 16 15:12:38.393754 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 884/1776] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:12:38 2021] GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed => generated 1350 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:12:38.443581 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-01be3354-52fd-49c0-8a9f-f36cd838cc43 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091415 Dec 16 15:12:38.444190 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 893/1777] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:12:38 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:12:39.415227 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-bc5a8761-5987-4f31-9539-5e22dd3330cc tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:12:39.415905 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-bc5a8761-5987-4f31-9539-5e22dd3330cc tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] [instance: 64774bdb-b85b-4d86-9110-0b37d9c15bed] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:12:39.424445 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-bc5a8761-5987-4f31-9539-5e22dd3330cc tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:39.424963 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-bc5a8761-5987-4f31-9539-5e22dd3330cc tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:39.425810 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-bc5a8761-5987-4f31-9539-5e22dd3330cc tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:39.426336 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-bc5a8761-5987-4f31-9539-5e22dd3330cc tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:39.459204 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-69829f0f-cf06-4518-a3a3-d6e881dac63d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:12:39.460237 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-69829f0f-cf06-4518-a3a3-d6e881dac63d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:12:39.468046 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-69829f0f-cf06-4518-a3a3-d6e881dac63d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:39.468544 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-69829f0f-cf06-4518-a3a3-d6e881dac63d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:39.469892 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-69829f0f-cf06-4518-a3a3-d6e881dac63d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:39.470425 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-69829f0f-cf06-4518-a3a3-d6e881dac63d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:39.541795 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-69829f0f-cf06-4518-a3a3-d6e881dac63d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090294 Dec 16 15:12:39.542575 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 894/1778] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:12:39 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 15:12:39.552967 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-bc5a8761-5987-4f31-9539-5e22dd3330cc tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ee0c9e767b4895b9e063b28ae947d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb300a155af646228f7c0b155a5d63ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:12:39.562631 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-bc5a8761-5987-4f31-9539-5e22dd3330cc tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] 10.222.0.45 "GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed" status: 200 len: 1350 microversion: 2.1 time: 0.154784 Dec 16 15:12:39.563220 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 885/1779] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:12:39 2021] GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed => generated 1350 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:12:40.557577 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-b0b21e14-e5d6-426d-9aed-7d432d0d12da tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:12:40.558589 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-b0b21e14-e5d6-426d-9aed-7d432d0d12da tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:12:40.568403 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b0b21e14-e5d6-426d-9aed-7d432d0d12da tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:40.568912 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b0b21e14-e5d6-426d-9aed-7d432d0d12da tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:40.569758 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b0b21e14-e5d6-426d-9aed-7d432d0d12da tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:40.570299 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b0b21e14-e5d6-426d-9aed-7d432d0d12da tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:40.583839 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-9e771037-32a8-41b3-ae2a-6a85b1539ac4 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:12:40.584509 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-9e771037-32a8-41b3-ae2a-6a85b1539ac4 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] [instance: 64774bdb-b85b-4d86-9110-0b37d9c15bed] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:12:40.592363 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9e771037-32a8-41b3-ae2a-6a85b1539ac4 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:40.592869 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9e771037-32a8-41b3-ae2a-6a85b1539ac4 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:40.593712 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9e771037-32a8-41b3-ae2a-6a85b1539ac4 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:40.594239 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9e771037-32a8-41b3-ae2a-6a85b1539ac4 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:40.646321 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-b0b21e14-e5d6-426d-9aed-7d432d0d12da tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096490 Dec 16 15:12:40.646912 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 895/1780] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:12:40 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:12:40.724159 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-9e771037-32a8-41b3-ae2a-6a85b1539ac4 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ee0c9e767b4895b9e063b28ae947d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb300a155af646228f7c0b155a5d63ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:12:40.733456 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-9e771037-32a8-41b3-ae2a-6a85b1539ac4 tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] 10.222.0.45 "GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed" status: 200 len: 1350 microversion: 2.1 time: 0.157443 Dec 16 15:12:40.734057 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 886/1781] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:12:40 2021] GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed => generated 1350 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:12:41.662968 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-d028c0c0-7f0a-4fb5-9bbb-074d9013d5f5 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:12:41.664028 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-d028c0c0-7f0a-4fb5-9bbb-074d9013d5f5 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:12:41.671908 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d028c0c0-7f0a-4fb5-9bbb-074d9013d5f5 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:41.672366 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d028c0c0-7f0a-4fb5-9bbb-074d9013d5f5 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:41.673212 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d028c0c0-7f0a-4fb5-9bbb-074d9013d5f5 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:41.673710 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d028c0c0-7f0a-4fb5-9bbb-074d9013d5f5 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:41.752368 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-d028c0c0-7f0a-4fb5-9bbb-074d9013d5f5 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097836 Dec 16 15:12:41.752988 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 896/1782] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:12:41 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:12:41.756517 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-c22d4360-76dc-4016-90e2-c14cf4d0887f tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:12:41.757179 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-c22d4360-76dc-4016-90e2-c14cf4d0887f tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] [instance: 64774bdb-b85b-4d86-9110-0b37d9c15bed] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:12:41.766414 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c22d4360-76dc-4016-90e2-c14cf4d0887f tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:41.766925 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c22d4360-76dc-4016-90e2-c14cf4d0887f tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:41.767938 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c22d4360-76dc-4016-90e2-c14cf4d0887f tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:41.768435 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c22d4360-76dc-4016-90e2-c14cf4d0887f tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:41.822912 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.wsgi [None req-c22d4360-76dc-4016-90e2-c14cf4d0887f tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] HTTP exception thrown: Instance 64774bdb-b85b-4d86-9110-0b37d9c15bed could not be found. Dec 16 15:12:41.823606 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-c22d4360-76dc-4016-90e2-c14cf4d0887f tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] Returning 404 to user: Instance 64774bdb-b85b-4d86-9110-0b37d9c15bed could not be found. {{(pid=101355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:941}} Dec 16 15:12:41.824506 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-c22d4360-76dc-4016-90e2-c14cf4d0887f tempest-VolumesSnapshotTestJSON-661080088 tempest-VolumesSnapshotTestJSON-661080088-project] 10.222.0.45 "GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed" status: 404 len: 111 microversion: 2.1 time: 0.076397 Dec 16 15:12:41.825154 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 887/1783] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:12:41 2021] GET /compute/v2.1/servers/64774bdb-b85b-4d86-9110-0b37d9c15bed => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 16 15:12:42.772223 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-c29fdad9-b09c-48f6-975b-e608582152d2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:12:42.773295 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-c29fdad9-b09c-48f6-975b-e608582152d2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:12:42.781817 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c29fdad9-b09c-48f6-975b-e608582152d2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:42.782790 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c29fdad9-b09c-48f6-975b-e608582152d2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:42.783218 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c29fdad9-b09c-48f6-975b-e608582152d2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:42.783714 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c29fdad9-b09c-48f6-975b-e608582152d2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:42.854927 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-c29fdad9-b09c-48f6-975b-e608582152d2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094566 Dec 16 15:12:42.855553 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 897/1784] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:12:42 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:12:43.871027 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-e0edfc1f-9d57-4042-8122-57da35f73a3f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:12:43.872073 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-e0edfc1f-9d57-4042-8122-57da35f73a3f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:12:43.880998 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e0edfc1f-9d57-4042-8122-57da35f73a3f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:43.881505 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e0edfc1f-9d57-4042-8122-57da35f73a3f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:43.882376 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e0edfc1f-9d57-4042-8122-57da35f73a3f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:43.882875 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e0edfc1f-9d57-4042-8122-57da35f73a3f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:43.957092 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-e0edfc1f-9d57-4042-8122-57da35f73a3f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093819 Dec 16 15:12:43.957703 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 888/1785] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:12:43 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:12:44.973139 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-4219f65d-b3a4-4c80-ace7-c27a8c2d683e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:12:44.974111 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-4219f65d-b3a4-4c80-ace7-c27a8c2d683e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:12:44.981841 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4219f65d-b3a4-4c80-ace7-c27a8c2d683e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:44.982371 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4219f65d-b3a4-4c80-ace7-c27a8c2d683e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:44.983193 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4219f65d-b3a4-4c80-ace7-c27a8c2d683e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:44.983679 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4219f65d-b3a4-4c80-ace7-c27a8c2d683e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:45.054216 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-4219f65d-b3a4-4c80-ace7-c27a8c2d683e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088775 Dec 16 15:12:45.059406 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 898/1786] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:12:44 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:12:46.073180 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-7be98b77-2784-485d-8324-41f5e0cd6040 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:12:46.074243 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-7be98b77-2784-485d-8324-41f5e0cd6040 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:12:46.082541 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7be98b77-2784-485d-8324-41f5e0cd6040 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:46.083048 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7be98b77-2784-485d-8324-41f5e0cd6040 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:46.083879 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7be98b77-2784-485d-8324-41f5e0cd6040 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:46.084369 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7be98b77-2784-485d-8324-41f5e0cd6040 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:46.154019 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-7be98b77-2784-485d-8324-41f5e0cd6040 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088464 Dec 16 15:12:46.154667 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 889/1787] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:12:46 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:12:47.170740 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-effa4cc7-e7f3-4525-98f6-b1486ccd814b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:12:47.171797 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-effa4cc7-e7f3-4525-98f6-b1486ccd814b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:12:47.179600 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-effa4cc7-e7f3-4525-98f6-b1486ccd814b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:47.180109 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-effa4cc7-e7f3-4525-98f6-b1486ccd814b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:47.180949 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-effa4cc7-e7f3-4525-98f6-b1486ccd814b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:47.181441 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-effa4cc7-e7f3-4525-98f6-b1486ccd814b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:47.266919 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-effa4cc7-e7f3-4525-98f6-b1486ccd814b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.103880 Dec 16 15:12:47.267534 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 899/1788] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:12:47 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:12:48.283170 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-8d107062-6b82-4445-bd40-39caad9ed460 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:12:48.284116 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-8d107062-6b82-4445-bd40-39caad9ed460 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:12:48.292077 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8d107062-6b82-4445-bd40-39caad9ed460 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:48.292583 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8d107062-6b82-4445-bd40-39caad9ed460 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:48.293414 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8d107062-6b82-4445-bd40-39caad9ed460 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:48.293899 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8d107062-6b82-4445-bd40-39caad9ed460 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:48.366789 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-8d107062-6b82-4445-bd40-39caad9ed460 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091655 Dec 16 15:12:48.367424 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 890/1789] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:12:48 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:12:49.383687 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-c4e08ce8-d844-4d58-a5dd-72cb52506d97 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:12:49.384739 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-c4e08ce8-d844-4d58-a5dd-72cb52506d97 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:12:49.393592 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c4e08ce8-d844-4d58-a5dd-72cb52506d97 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:49.394130 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c4e08ce8-d844-4d58-a5dd-72cb52506d97 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:49.394980 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c4e08ce8-d844-4d58-a5dd-72cb52506d97 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:49.395475 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c4e08ce8-d844-4d58-a5dd-72cb52506d97 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:49.467158 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-c4e08ce8-d844-4d58-a5dd-72cb52506d97 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091450 Dec 16 15:12:49.467779 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 900/1790] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:12:49 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:12:50.486629 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-7dc35393-cee6-4d57-84fd-34b0367bfad7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:12:50.487684 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-7dc35393-cee6-4d57-84fd-34b0367bfad7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:12:50.496078 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7dc35393-cee6-4d57-84fd-34b0367bfad7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:50.496599 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7dc35393-cee6-4d57-84fd-34b0367bfad7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:50.497466 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7dc35393-cee6-4d57-84fd-34b0367bfad7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:50.497961 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7dc35393-cee6-4d57-84fd-34b0367bfad7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:50.575861 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-7dc35393-cee6-4d57-84fd-34b0367bfad7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.098314 Dec 16 15:12:50.576543 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 891/1791] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:12:50 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:12:51.593039 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-09b14b63-427f-4769-b4bb-9fe444ad04e0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:12:51.595184 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-09b14b63-427f-4769-b4bb-9fe444ad04e0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:12:51.603709 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-09b14b63-427f-4769-b4bb-9fe444ad04e0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:51.604211 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-09b14b63-427f-4769-b4bb-9fe444ad04e0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:51.605062 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-09b14b63-427f-4769-b4bb-9fe444ad04e0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:51.605544 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-09b14b63-427f-4769-b4bb-9fe444ad04e0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:51.678436 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-09b14b63-427f-4769-b4bb-9fe444ad04e0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093214 Dec 16 15:12:51.679069 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 901/1792] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:12:51 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:12:52.695717 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-b1746ca4-e0f9-4bf6-9b08-a144216baef2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:12:52.696752 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-b1746ca4-e0f9-4bf6-9b08-a144216baef2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:12:52.704663 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b1746ca4-e0f9-4bf6-9b08-a144216baef2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:52.705171 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b1746ca4-e0f9-4bf6-9b08-a144216baef2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:52.706012 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b1746ca4-e0f9-4bf6-9b08-a144216baef2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:52.706545 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b1746ca4-e0f9-4bf6-9b08-a144216baef2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:52.782377 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-b1746ca4-e0f9-4bf6-9b08-a144216baef2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094933 Dec 16 15:12:52.782908 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 892/1793] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:12:52 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:12:53.798858 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-aa33a8f6-685d-4ac3-aad6-8754ff25332f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:12:53.799907 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-aa33a8f6-685d-4ac3-aad6-8754ff25332f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:12:53.807893 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-aa33a8f6-685d-4ac3-aad6-8754ff25332f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:53.808445 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-aa33a8f6-685d-4ac3-aad6-8754ff25332f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:53.809286 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-aa33a8f6-685d-4ac3-aad6-8754ff25332f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:53.809776 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-aa33a8f6-685d-4ac3-aad6-8754ff25332f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:53.882723 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-aa33a8f6-685d-4ac3-aad6-8754ff25332f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093092 Dec 16 15:12:53.883345 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 902/1794] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:12:53 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:12:54.900028 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-46736247-fa80-471f-bfe9-dbf018f37a92 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:12:54.901315 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-46736247-fa80-471f-bfe9-dbf018f37a92 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:12:54.915721 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-46736247-fa80-471f-bfe9-dbf018f37a92 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:54.916569 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-46736247-fa80-471f-bfe9-dbf018f37a92 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:54.918078 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-46736247-fa80-471f-bfe9-dbf018f37a92 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:54.918949 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-46736247-fa80-471f-bfe9-dbf018f37a92 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:54.998218 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-46736247-fa80-471f-bfe9-dbf018f37a92 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.105860 Dec 16 15:12:54.998945 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 893/1795] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:12:54 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:12:56.014776 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-666d9d96-6daa-46c9-ac13-b134f56954e2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:12:56.015830 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-666d9d96-6daa-46c9-ac13-b134f56954e2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:12:56.024288 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-666d9d96-6daa-46c9-ac13-b134f56954e2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:56.024804 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-666d9d96-6daa-46c9-ac13-b134f56954e2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:56.025671 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-666d9d96-6daa-46c9-ac13-b134f56954e2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:56.026190 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-666d9d96-6daa-46c9-ac13-b134f56954e2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:56.103926 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-666d9d96-6daa-46c9-ac13-b134f56954e2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096989 Dec 16 15:12:56.104544 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 903/1796] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:12:56 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:12:57.120439 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-60093674-f3c7-4073-860a-a9d5994e8dc1 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:12:57.121514 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-60093674-f3c7-4073-860a-a9d5994e8dc1 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:12:57.129392 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-60093674-f3c7-4073-860a-a9d5994e8dc1 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:57.129904 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-60093674-f3c7-4073-860a-a9d5994e8dc1 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:57.130808 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-60093674-f3c7-4073-860a-a9d5994e8dc1 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:57.131312 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-60093674-f3c7-4073-860a-a9d5994e8dc1 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:57.204582 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-60093674-f3c7-4073-860a-a9d5994e8dc1 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092079 Dec 16 15:12:57.205128 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 894/1797] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:12:57 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:12:58.222548 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-6e4f022d-e9b8-4cfd-9fcf-ca48ae6074ca tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:12:58.230634 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-6e4f022d-e9b8-4cfd-9fcf-ca48ae6074ca tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:12:58.231609 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6e4f022d-e9b8-4cfd-9fcf-ca48ae6074ca tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:58.232119 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6e4f022d-e9b8-4cfd-9fcf-ca48ae6074ca tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:58.233018 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6e4f022d-e9b8-4cfd-9fcf-ca48ae6074ca tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:58.233508 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6e4f022d-e9b8-4cfd-9fcf-ca48ae6074ca tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:58.314622 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-6e4f022d-e9b8-4cfd-9fcf-ca48ae6074ca tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.101097 Dec 16 15:12:58.315237 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 904/1798] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:12:58 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:12:59.332542 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-0cdd0d72-b0ff-4649-a5ac-d10e7f843526 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:12:59.333577 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-0cdd0d72-b0ff-4649-a5ac-d10e7f843526 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:12:59.341526 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0cdd0d72-b0ff-4649-a5ac-d10e7f843526 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:59.342059 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0cdd0d72-b0ff-4649-a5ac-d10e7f843526 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:59.342927 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0cdd0d72-b0ff-4649-a5ac-d10e7f843526 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:12:59.344052 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0cdd0d72-b0ff-4649-a5ac-d10e7f843526 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:12:59.416139 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-0cdd0d72-b0ff-4649-a5ac-d10e7f843526 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091835 Dec 16 15:12:59.416758 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 895/1799] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:12:59 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:13:00.432614 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-beb55c12-4b8e-4db9-964b-ed816653c3ba tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:13:00.435202 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-beb55c12-4b8e-4db9-964b-ed816653c3ba tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:13:00.441835 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-beb55c12-4b8e-4db9-964b-ed816653c3ba tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:00.442383 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-beb55c12-4b8e-4db9-964b-ed816653c3ba tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:00.443273 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-beb55c12-4b8e-4db9-964b-ed816653c3ba tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:00.443767 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-beb55c12-4b8e-4db9-964b-ed816653c3ba tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:00.517033 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-beb55c12-4b8e-4db9-964b-ed816653c3ba tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092207 Dec 16 15:13:00.517678 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 905/1800] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:13:00 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:13:01.534015 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-dcb66749-ef43-43c1-8446-a2a94b748565 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:13:01.535135 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-dcb66749-ef43-43c1-8446-a2a94b748565 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:13:01.543572 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-dcb66749-ef43-43c1-8446-a2a94b748565 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:01.544104 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-dcb66749-ef43-43c1-8446-a2a94b748565 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:01.544961 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-dcb66749-ef43-43c1-8446-a2a94b748565 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:01.545454 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-dcb66749-ef43-43c1-8446-a2a94b748565 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:01.623260 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-dcb66749-ef43-43c1-8446-a2a94b748565 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.098071 Dec 16 15:13:01.623865 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 896/1801] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:13:01 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:13:02.640269 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-54c5e483-2dd5-48e2-a7eb-ea0af25eb31c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:13:02.641346 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-54c5e483-2dd5-48e2-a7eb-ea0af25eb31c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:13:02.649155 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-54c5e483-2dd5-48e2-a7eb-ea0af25eb31c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:02.649663 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-54c5e483-2dd5-48e2-a7eb-ea0af25eb31c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:02.650695 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-54c5e483-2dd5-48e2-a7eb-ea0af25eb31c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:02.651012 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-54c5e483-2dd5-48e2-a7eb-ea0af25eb31c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:02.726086 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-54c5e483-2dd5-48e2-a7eb-ea0af25eb31c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092707 Dec 16 15:13:02.726666 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 906/1802] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:13:02 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:13:03.747817 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-bea046bd-d937-4a56-b8b4-f3ff5ea207a5 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:13:03.748930 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-bea046bd-d937-4a56-b8b4-f3ff5ea207a5 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:13:03.757159 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-bea046bd-d937-4a56-b8b4-f3ff5ea207a5 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:03.757694 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-bea046bd-d937-4a56-b8b4-f3ff5ea207a5 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:03.758564 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-bea046bd-d937-4a56-b8b4-f3ff5ea207a5 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:03.759058 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-bea046bd-d937-4a56-b8b4-f3ff5ea207a5 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:03.833310 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-bea046bd-d937-4a56-b8b4-f3ff5ea207a5 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096249 Dec 16 15:13:03.833937 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 897/1803] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:13:03 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:13:04.858295 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-7ca0bb5a-8fd3-4ce0-9fca-343acbefea8e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:13:04.860549 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-7ca0bb5a-8fd3-4ce0-9fca-343acbefea8e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:13:04.869911 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7ca0bb5a-8fd3-4ce0-9fca-343acbefea8e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:04.870453 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7ca0bb5a-8fd3-4ce0-9fca-343acbefea8e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:04.871299 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7ca0bb5a-8fd3-4ce0-9fca-343acbefea8e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:04.871805 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7ca0bb5a-8fd3-4ce0-9fca-343acbefea8e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:04.952633 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-7ca0bb5a-8fd3-4ce0-9fca-343acbefea8e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.109577 Dec 16 15:13:04.953288 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 907/1804] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:13:04 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:13:05.969216 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-2ddae388-7f62-4771-8ea2-f30176b0931f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:13:05.970434 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-2ddae388-7f62-4771-8ea2-f30176b0931f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:13:05.978849 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2ddae388-7f62-4771-8ea2-f30176b0931f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:05.979370 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2ddae388-7f62-4771-8ea2-f30176b0931f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:05.980245 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2ddae388-7f62-4771-8ea2-f30176b0931f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:05.980747 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2ddae388-7f62-4771-8ea2-f30176b0931f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:06.057815 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-2ddae388-7f62-4771-8ea2-f30176b0931f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097629 Dec 16 15:13:06.058481 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 898/1805] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:13:05 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:13:07.074565 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-bd7153d6-9cc4-4eea-9906-b6569b31e141 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:13:07.075735 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-bd7153d6-9cc4-4eea-9906-b6569b31e141 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:13:07.084227 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-bd7153d6-9cc4-4eea-9906-b6569b31e141 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:07.084731 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-bd7153d6-9cc4-4eea-9906-b6569b31e141 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:07.085619 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-bd7153d6-9cc4-4eea-9906-b6569b31e141 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:07.086134 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-bd7153d6-9cc4-4eea-9906-b6569b31e141 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:07.161969 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-bd7153d6-9cc4-4eea-9906-b6569b31e141 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095242 Dec 16 15:13:07.162643 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 908/1806] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:13:07 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:13:08.179106 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-9e5e76cd-abf5-4b92-91dd-ba875ece2b71 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:13:08.180159 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-9e5e76cd-abf5-4b92-91dd-ba875ece2b71 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:13:08.188509 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9e5e76cd-abf5-4b92-91dd-ba875ece2b71 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:08.189021 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9e5e76cd-abf5-4b92-91dd-ba875ece2b71 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:08.189889 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9e5e76cd-abf5-4b92-91dd-ba875ece2b71 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:08.190448 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9e5e76cd-abf5-4b92-91dd-ba875ece2b71 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:08.265247 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-9e5e76cd-abf5-4b92-91dd-ba875ece2b71 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094226 Dec 16 15:13:08.266712 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 899/1807] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:13:08 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:13:09.281612 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-407039fa-a98e-4522-ace4-25c9dc851b17 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:13:09.282704 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-407039fa-a98e-4522-ace4-25c9dc851b17 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:13:09.290931 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-407039fa-a98e-4522-ace4-25c9dc851b17 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:09.291441 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-407039fa-a98e-4522-ace4-25c9dc851b17 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:09.292288 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-407039fa-a98e-4522-ace4-25c9dc851b17 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:09.292774 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-407039fa-a98e-4522-ace4-25c9dc851b17 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:09.369321 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-407039fa-a98e-4522-ace4-25c9dc851b17 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095759 Dec 16 15:13:09.370097 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 909/1808] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:13:09 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:13:10.385396 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-103ae356-b1bc-43c0-af27-c9f02b4d34c5 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:13:10.386619 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-103ae356-b1bc-43c0-af27-c9f02b4d34c5 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:13:10.395278 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-103ae356-b1bc-43c0-af27-c9f02b4d34c5 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:10.395788 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-103ae356-b1bc-43c0-af27-c9f02b4d34c5 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:10.396680 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-103ae356-b1bc-43c0-af27-c9f02b4d34c5 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:10.397165 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-103ae356-b1bc-43c0-af27-c9f02b4d34c5 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:10.475361 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-103ae356-b1bc-43c0-af27-c9f02b4d34c5 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.098057 Dec 16 15:13:10.475984 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 900/1809] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:13:10 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:13:11.492612 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-5f2c993e-3331-47b4-a7cd-d1d52f6e3a10 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:13:11.493651 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-5f2c993e-3331-47b4-a7cd-d1d52f6e3a10 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:13:11.502068 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5f2c993e-3331-47b4-a7cd-d1d52f6e3a10 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:11.502561 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5f2c993e-3331-47b4-a7cd-d1d52f6e3a10 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:11.503397 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5f2c993e-3331-47b4-a7cd-d1d52f6e3a10 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:11.503879 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5f2c993e-3331-47b4-a7cd-d1d52f6e3a10 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:11.589703 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-5f2c993e-3331-47b4-a7cd-d1d52f6e3a10 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.105184 Dec 16 15:13:11.590403 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 910/1810] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:13:11 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:13:12.605913 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-550b92bf-73aa-474a-a92c-f4f12bf295bb tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:13:12.607020 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-550b92bf-73aa-474a-a92c-f4f12bf295bb tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:13:12.615108 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-550b92bf-73aa-474a-a92c-f4f12bf295bb tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:12.615629 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-550b92bf-73aa-474a-a92c-f4f12bf295bb tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:12.616517 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-550b92bf-73aa-474a-a92c-f4f12bf295bb tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:12.617015 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-550b92bf-73aa-474a-a92c-f4f12bf295bb tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:12.692488 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-550b92bf-73aa-474a-a92c-f4f12bf295bb tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094592 Dec 16 15:13:12.693137 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 901/1811] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:13:12 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:13:13.709078 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-75d36d58-b0f5-4b61-88be-4378b219135a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:13:13.710073 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-75d36d58-b0f5-4b61-88be-4378b219135a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:13:13.718424 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-75d36d58-b0f5-4b61-88be-4378b219135a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:13.718935 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-75d36d58-b0f5-4b61-88be-4378b219135a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:13.719806 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-75d36d58-b0f5-4b61-88be-4378b219135a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:13.720278 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-75d36d58-b0f5-4b61-88be-4378b219135a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:13.797433 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-75d36d58-b0f5-4b61-88be-4378b219135a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096395 Dec 16 15:13:13.798096 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 911/1812] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:13:13 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:13:14.814067 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-b1c12ef6-9c5e-4376-877a-e36a3c4d3d36 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:13:14.815656 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-b1c12ef6-9c5e-4376-877a-e36a3c4d3d36 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:13:14.829802 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b1c12ef6-9c5e-4376-877a-e36a3c4d3d36 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:14.830479 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b1c12ef6-9c5e-4376-877a-e36a3c4d3d36 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:14.831460 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b1c12ef6-9c5e-4376-877a-e36a3c4d3d36 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:14.832111 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b1c12ef6-9c5e-4376-877a-e36a3c4d3d36 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:14.908301 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-b1c12ef6-9c5e-4376-877a-e36a3c4d3d36 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.102371 Dec 16 15:13:14.908853 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 902/1813] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:13:14 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:13:15.924060 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-ee65c1bf-e09d-4c7a-9d45-4ff26ab3a4bd tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:13:15.925032 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-ee65c1bf-e09d-4c7a-9d45-4ff26ab3a4bd tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:13:15.933779 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ee65c1bf-e09d-4c7a-9d45-4ff26ab3a4bd tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:15.934325 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ee65c1bf-e09d-4c7a-9d45-4ff26ab3a4bd tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:15.935177 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ee65c1bf-e09d-4c7a-9d45-4ff26ab3a4bd tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:15.935665 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ee65c1bf-e09d-4c7a-9d45-4ff26ab3a4bd tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:16.011908 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-ee65c1bf-e09d-4c7a-9d45-4ff26ab3a4bd tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095880 Dec 16 15:13:16.012549 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 912/1814] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:13:15 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:13:17.028599 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-a28b201d-742b-412c-9f1f-d5b26c6866f0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:13:17.029636 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-a28b201d-742b-412c-9f1f-d5b26c6866f0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:13:17.038808 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a28b201d-742b-412c-9f1f-d5b26c6866f0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:17.039316 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a28b201d-742b-412c-9f1f-d5b26c6866f0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:17.040282 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a28b201d-742b-412c-9f1f-d5b26c6866f0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:17.040776 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a28b201d-742b-412c-9f1f-d5b26c6866f0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:17.114870 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-a28b201d-742b-412c-9f1f-d5b26c6866f0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094065 Dec 16 15:13:17.115498 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 903/1815] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:13:17 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:13:18.131856 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-4ad80bbb-b07a-4e95-88d6-0b921d03c26a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:13:18.132924 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-4ad80bbb-b07a-4e95-88d6-0b921d03c26a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:13:18.141174 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4ad80bbb-b07a-4e95-88d6-0b921d03c26a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:18.141613 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4ad80bbb-b07a-4e95-88d6-0b921d03c26a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:18.142514 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4ad80bbb-b07a-4e95-88d6-0b921d03c26a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:18.143007 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4ad80bbb-b07a-4e95-88d6-0b921d03c26a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:18.216856 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-4ad80bbb-b07a-4e95-88d6-0b921d03c26a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092772 Dec 16 15:13:18.217496 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 913/1816] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:13:18 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:13:19.233652 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-358c4a46-4ff1-49ae-976d-48fad3ce3f52 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:13:19.234727 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-358c4a46-4ff1-49ae-976d-48fad3ce3f52 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:13:19.242609 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-358c4a46-4ff1-49ae-976d-48fad3ce3f52 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:19.243113 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-358c4a46-4ff1-49ae-976d-48fad3ce3f52 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:19.244045 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-358c4a46-4ff1-49ae-976d-48fad3ce3f52 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:19.244534 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-358c4a46-4ff1-49ae-976d-48fad3ce3f52 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:19.333614 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-358c4a46-4ff1-49ae-976d-48fad3ce3f52 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.108024 Dec 16 15:13:19.334322 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 904/1817] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:13:19 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:13:20.349902 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-6ce34db3-79f6-4577-a461-18edde3baa20 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:13:20.351004 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-6ce34db3-79f6-4577-a461-18edde3baa20 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:13:20.358983 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6ce34db3-79f6-4577-a461-18edde3baa20 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:20.359419 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6ce34db3-79f6-4577-a461-18edde3baa20 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:20.360259 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6ce34db3-79f6-4577-a461-18edde3baa20 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:20.360746 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6ce34db3-79f6-4577-a461-18edde3baa20 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:20.431703 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-6ce34db3-79f6-4577-a461-18edde3baa20 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089668 Dec 16 15:13:20.432320 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 914/1818] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:13:20 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:13:21.448840 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-89497432-c13c-405e-a9a5-ea19d2731aee tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:13:21.449891 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-89497432-c13c-405e-a9a5-ea19d2731aee tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:13:21.458585 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-89497432-c13c-405e-a9a5-ea19d2731aee tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:21.459011 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-89497432-c13c-405e-a9a5-ea19d2731aee tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:21.459859 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-89497432-c13c-405e-a9a5-ea19d2731aee tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:21.460347 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-89497432-c13c-405e-a9a5-ea19d2731aee tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:21.534575 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-89497432-c13c-405e-a9a5-ea19d2731aee tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094259 Dec 16 15:13:21.535191 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 905/1819] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:13:21 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:13:22.552472 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-9331c912-ae4d-436c-84f2-83f17f01d7a8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:13:22.553515 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-9331c912-ae4d-436c-84f2-83f17f01d7a8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:13:22.562102 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9331c912-ae4d-436c-84f2-83f17f01d7a8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:22.562594 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9331c912-ae4d-436c-84f2-83f17f01d7a8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:22.563454 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9331c912-ae4d-436c-84f2-83f17f01d7a8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:22.563947 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9331c912-ae4d-436c-84f2-83f17f01d7a8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:22.641028 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-9331c912-ae4d-436c-84f2-83f17f01d7a8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097976 Dec 16 15:13:22.641660 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 915/1820] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:13:22 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:13:23.661745 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-186e08de-7267-4009-b957-063f86a6fe1a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:13:23.663560 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-186e08de-7267-4009-b957-063f86a6fe1a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:13:23.674658 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-186e08de-7267-4009-b957-063f86a6fe1a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:23.675174 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-186e08de-7267-4009-b957-063f86a6fe1a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:23.676082 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-186e08de-7267-4009-b957-063f86a6fe1a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:23.676655 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-186e08de-7267-4009-b957-063f86a6fe1a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:23.757069 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-186e08de-7267-4009-b957-063f86a6fe1a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.107404 Dec 16 15:13:23.760438 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 906/1821] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:13:23 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:13:24.778499 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-ea123468-d9a9-4693-b670-a7313bb0d7f7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:13:24.779553 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-ea123468-d9a9-4693-b670-a7313bb0d7f7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:13:24.791305 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ea123468-d9a9-4693-b670-a7313bb0d7f7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:24.791818 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ea123468-d9a9-4693-b670-a7313bb0d7f7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:24.792673 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ea123468-d9a9-4693-b670-a7313bb0d7f7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:24.793170 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ea123468-d9a9-4693-b670-a7313bb0d7f7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:24.867118 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-ea123468-d9a9-4693-b670-a7313bb0d7f7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096337 Dec 16 15:13:24.867748 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 916/1822] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:13:24 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:13:25.884400 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-dbc94bf7-797c-4652-bd82-1f65e16ca334 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:13:25.885456 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-dbc94bf7-797c-4652-bd82-1f65e16ca334 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:13:25.893671 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-dbc94bf7-797c-4652-bd82-1f65e16ca334 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:25.894449 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-dbc94bf7-797c-4652-bd82-1f65e16ca334 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:25.895323 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-dbc94bf7-797c-4652-bd82-1f65e16ca334 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:25.895823 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-dbc94bf7-797c-4652-bd82-1f65e16ca334 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:25.969626 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-dbc94bf7-797c-4652-bd82-1f65e16ca334 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093919 Dec 16 15:13:25.970203 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 907/1823] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:13:25 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 15:13:26.986626 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-1e4cc504-164f-4fa4-b075-6992df1d97c7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:13:26.987669 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-1e4cc504-164f-4fa4-b075-6992df1d97c7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:13:26.995617 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1e4cc504-164f-4fa4-b075-6992df1d97c7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:26.996129 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1e4cc504-164f-4fa4-b075-6992df1d97c7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:26.996976 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1e4cc504-164f-4fa4-b075-6992df1d97c7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:26.997469 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1e4cc504-164f-4fa4-b075-6992df1d97c7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:27.071208 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-1e4cc504-164f-4fa4-b075-6992df1d97c7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092721 Dec 16 15:13:27.071741 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 917/1824] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:13:26 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:13:28.087830 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-f2384f9c-44ef-459a-ad99-5d84bb5d6adf tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:13:28.088878 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-f2384f9c-44ef-459a-ad99-5d84bb5d6adf tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:13:28.099046 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f2384f9c-44ef-459a-ad99-5d84bb5d6adf tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:28.099554 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f2384f9c-44ef-459a-ad99-5d84bb5d6adf tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:28.100409 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f2384f9c-44ef-459a-ad99-5d84bb5d6adf tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:28.100897 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f2384f9c-44ef-459a-ad99-5d84bb5d6adf tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:28.179239 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-f2384f9c-44ef-459a-ad99-5d84bb5d6adf tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.099841 Dec 16 15:13:28.179769 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 908/1825] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:13:28 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:13:29.196076 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-b5ed0ba8-b77b-43c4-9d19-6d605881f625 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:13:29.197353 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-b5ed0ba8-b77b-43c4-9d19-6d605881f625 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:13:29.206030 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b5ed0ba8-b77b-43c4-9d19-6d605881f625 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:29.206578 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b5ed0ba8-b77b-43c4-9d19-6d605881f625 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:29.207428 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b5ed0ba8-b77b-43c4-9d19-6d605881f625 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:29.207936 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b5ed0ba8-b77b-43c4-9d19-6d605881f625 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:29.281866 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-b5ed0ba8-b77b-43c4-9d19-6d605881f625 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093655 Dec 16 15:13:29.282461 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 918/1826] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:13:29 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:13:30.298617 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-149c6bf9-ff2d-4878-b3ed-720940294dad tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:13:30.299592 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-149c6bf9-ff2d-4878-b3ed-720940294dad tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:13:30.307518 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-149c6bf9-ff2d-4878-b3ed-720940294dad tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:30.308027 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-149c6bf9-ff2d-4878-b3ed-720940294dad tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:30.308879 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-149c6bf9-ff2d-4878-b3ed-720940294dad tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:30.309371 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-149c6bf9-ff2d-4878-b3ed-720940294dad tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:30.384359 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-149c6bf9-ff2d-4878-b3ed-720940294dad tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093996 Dec 16 15:13:30.384984 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 909/1827] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:13:30 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:13:31.400467 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-a20f58b1-e0a1-453e-a577-8d06973dce76 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:13:31.401579 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-a20f58b1-e0a1-453e-a577-8d06973dce76 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:13:31.409436 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a20f58b1-e0a1-453e-a577-8d06973dce76 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:31.409947 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a20f58b1-e0a1-453e-a577-8d06973dce76 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:31.410813 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a20f58b1-e0a1-453e-a577-8d06973dce76 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:31.411310 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a20f58b1-e0a1-453e-a577-8d06973dce76 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:31.487082 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-a20f58b1-e0a1-453e-a577-8d06973dce76 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093638 Dec 16 15:13:31.487632 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 919/1828] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:13:31 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:13:32.503423 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-efd56e39-a049-46a7-b003-97cffd8e5a25 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:13:32.504397 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-efd56e39-a049-46a7-b003-97cffd8e5a25 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:13:32.513305 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-efd56e39-a049-46a7-b003-97cffd8e5a25 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:32.513802 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-efd56e39-a049-46a7-b003-97cffd8e5a25 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:32.514668 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-efd56e39-a049-46a7-b003-97cffd8e5a25 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:32.515155 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-efd56e39-a049-46a7-b003-97cffd8e5a25 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:32.590794 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-efd56e39-a049-46a7-b003-97cffd8e5a25 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095622 Dec 16 15:13:32.591424 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 910/1829] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:13:32 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:13:33.607243 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-17ab95b3-8432-4a2f-92db-e9ac5cd03a1c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:13:33.608280 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-17ab95b3-8432-4a2f-92db-e9ac5cd03a1c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:13:33.619276 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-17ab95b3-8432-4a2f-92db-e9ac5cd03a1c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:33.619771 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-17ab95b3-8432-4a2f-92db-e9ac5cd03a1c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:33.620625 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-17ab95b3-8432-4a2f-92db-e9ac5cd03a1c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:33.621112 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-17ab95b3-8432-4a2f-92db-e9ac5cd03a1c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:33.705392 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-17ab95b3-8432-4a2f-92db-e9ac5cd03a1c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.105348 Dec 16 15:13:33.705945 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 920/1830] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:13:33 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:13:34.722210 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-5875a14f-3d71-48f6-a1b7-bed6efaf3f9c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:13:34.723342 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-5875a14f-3d71-48f6-a1b7-bed6efaf3f9c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:13:34.731510 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5875a14f-3d71-48f6-a1b7-bed6efaf3f9c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:34.732021 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5875a14f-3d71-48f6-a1b7-bed6efaf3f9c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:34.732890 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5875a14f-3d71-48f6-a1b7-bed6efaf3f9c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:34.733392 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5875a14f-3d71-48f6-a1b7-bed6efaf3f9c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:34.808439 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-5875a14f-3d71-48f6-a1b7-bed6efaf3f9c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094389 Dec 16 15:13:34.809011 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 911/1831] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:13:34 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:13:35.826433 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-8eeb5a94-4467-4701-85aa-4f05e96abba9 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:13:35.827489 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-8eeb5a94-4467-4701-85aa-4f05e96abba9 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:13:35.837828 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8eeb5a94-4467-4701-85aa-4f05e96abba9 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:35.838371 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8eeb5a94-4467-4701-85aa-4f05e96abba9 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:35.839236 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8eeb5a94-4467-4701-85aa-4f05e96abba9 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:35.839741 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8eeb5a94-4467-4701-85aa-4f05e96abba9 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:35.912560 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-8eeb5a94-4467-4701-85aa-4f05e96abba9 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094223 Dec 16 15:13:35.913112 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 921/1832] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:13:35 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:13:36.930287 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-8d490dbf-0630-41ea-bd90-ab8b2a769932 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:13:36.931274 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-8d490dbf-0630-41ea-bd90-ab8b2a769932 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:13:36.940826 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8d490dbf-0630-41ea-bd90-ab8b2a769932 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:36.941257 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8d490dbf-0630-41ea-bd90-ab8b2a769932 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:36.942317 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8d490dbf-0630-41ea-bd90-ab8b2a769932 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:36.942652 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8d490dbf-0630-41ea-bd90-ab8b2a769932 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:37.023107 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-8d490dbf-0630-41ea-bd90-ab8b2a769932 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.102164 Dec 16 15:13:37.023749 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 912/1833] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:13:36 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:13:38.041517 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-30b5af53-eee6-447a-aa22-95ff16ba7985 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:13:38.043078 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-30b5af53-eee6-447a-aa22-95ff16ba7985 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:13:38.054803 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-30b5af53-eee6-447a-aa22-95ff16ba7985 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:38.055315 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-30b5af53-eee6-447a-aa22-95ff16ba7985 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:38.056184 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-30b5af53-eee6-447a-aa22-95ff16ba7985 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:38.056680 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-30b5af53-eee6-447a-aa22-95ff16ba7985 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:38.131851 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-30b5af53-eee6-447a-aa22-95ff16ba7985 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.099754 Dec 16 15:13:38.132474 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 922/1834] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:13:38 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:13:39.147557 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-50912497-0745-458a-ab0d-f0f71cf49bd0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:13:39.148605 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-50912497-0745-458a-ab0d-f0f71cf49bd0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:13:39.156543 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-50912497-0745-458a-ab0d-f0f71cf49bd0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:39.157058 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-50912497-0745-458a-ab0d-f0f71cf49bd0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:39.158577 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-50912497-0745-458a-ab0d-f0f71cf49bd0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:39.159073 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-50912497-0745-458a-ab0d-f0f71cf49bd0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:39.239179 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-50912497-0745-458a-ab0d-f0f71cf49bd0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.099197 Dec 16 15:13:39.239824 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 913/1835] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:13:39 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:13:40.256134 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-ba008656-6815-49e8-9541-fcbaa37b72d8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:13:40.257095 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-ba008656-6815-49e8-9541-fcbaa37b72d8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:13:40.265104 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ba008656-6815-49e8-9541-fcbaa37b72d8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:40.265613 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ba008656-6815-49e8-9541-fcbaa37b72d8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:40.266487 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ba008656-6815-49e8-9541-fcbaa37b72d8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:40.266975 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ba008656-6815-49e8-9541-fcbaa37b72d8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:40.342070 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-ba008656-6815-49e8-9541-fcbaa37b72d8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094453 Dec 16 15:13:40.343061 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 923/1836] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:13:40 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:13:41.359147 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-7738d0f9-7160-4d71-a4b2-c512f5b9d7c8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:13:41.360193 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-7738d0f9-7160-4d71-a4b2-c512f5b9d7c8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:13:41.369725 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7738d0f9-7160-4d71-a4b2-c512f5b9d7c8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:41.370254 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7738d0f9-7160-4d71-a4b2-c512f5b9d7c8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:41.371154 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7738d0f9-7160-4d71-a4b2-c512f5b9d7c8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:41.371651 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7738d0f9-7160-4d71-a4b2-c512f5b9d7c8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:41.444855 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-7738d0f9-7160-4d71-a4b2-c512f5b9d7c8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093606 Dec 16 15:13:41.445474 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 914/1837] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:13:41 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:13:42.461164 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-3c7c7e7e-fa69-4f11-bfc9-845ceacdbc17 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:13:42.462140 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-3c7c7e7e-fa69-4f11-bfc9-845ceacdbc17 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:13:42.470258 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3c7c7e7e-fa69-4f11-bfc9-845ceacdbc17 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:42.470774 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3c7c7e7e-fa69-4f11-bfc9-845ceacdbc17 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:42.471622 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3c7c7e7e-fa69-4f11-bfc9-845ceacdbc17 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:42.472112 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3c7c7e7e-fa69-4f11-bfc9-845ceacdbc17 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:42.543853 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-3c7c7e7e-fa69-4f11-bfc9-845ceacdbc17 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090617 Dec 16 15:13:42.544472 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 924/1838] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:13:42 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:13:43.560228 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-99ebe0c1-0c34-4fc0-a2a2-07ea00a344e8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:13:43.561473 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-99ebe0c1-0c34-4fc0-a2a2-07ea00a344e8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:13:43.570167 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-99ebe0c1-0c34-4fc0-a2a2-07ea00a344e8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:43.570676 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-99ebe0c1-0c34-4fc0-a2a2-07ea00a344e8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:43.571536 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-99ebe0c1-0c34-4fc0-a2a2-07ea00a344e8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:43.572025 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-99ebe0c1-0c34-4fc0-a2a2-07ea00a344e8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:43.647236 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-99ebe0c1-0c34-4fc0-a2a2-07ea00a344e8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094883 Dec 16 15:13:43.647872 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 915/1839] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:13:43 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:13:44.664479 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-fe46e7e0-e583-4aeb-af94-6c428f1e4475 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:13:44.665452 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-fe46e7e0-e583-4aeb-af94-6c428f1e4475 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:13:44.673343 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fe46e7e0-e583-4aeb-af94-6c428f1e4475 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:44.673853 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fe46e7e0-e583-4aeb-af94-6c428f1e4475 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:44.674746 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fe46e7e0-e583-4aeb-af94-6c428f1e4475 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:44.675241 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fe46e7e0-e583-4aeb-af94-6c428f1e4475 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:44.747130 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-fe46e7e0-e583-4aeb-af94-6c428f1e4475 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091260 Dec 16 15:13:44.747750 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 925/1840] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:13:44 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:13:45.763866 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-870036d9-f62c-41c8-b47c-3efc02312ffc tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:13:45.764962 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-870036d9-f62c-41c8-b47c-3efc02312ffc tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:13:45.773678 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-870036d9-f62c-41c8-b47c-3efc02312ffc tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:45.774243 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-870036d9-f62c-41c8-b47c-3efc02312ffc tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:45.775087 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-870036d9-f62c-41c8-b47c-3efc02312ffc tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:45.775576 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-870036d9-f62c-41c8-b47c-3efc02312ffc tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:45.851745 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-870036d9-f62c-41c8-b47c-3efc02312ffc tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095837 Dec 16 15:13:45.852407 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 916/1841] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:13:45 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:13:46.867621 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-5d239cf3-3ff0-4eb4-a17c-701d5ad42cb1 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:13:46.868654 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-5d239cf3-3ff0-4eb4-a17c-701d5ad42cb1 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:13:46.876539 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5d239cf3-3ff0-4eb4-a17c-701d5ad42cb1 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:46.877033 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5d239cf3-3ff0-4eb4-a17c-701d5ad42cb1 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:46.877883 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5d239cf3-3ff0-4eb4-a17c-701d5ad42cb1 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:46.878396 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5d239cf3-3ff0-4eb4-a17c-701d5ad42cb1 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:46.949396 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-5d239cf3-3ff0-4eb4-a17c-701d5ad42cb1 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089353 Dec 16 15:13:46.949934 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 926/1842] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:13:46 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:13:47.967111 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-1cdd7cd6-4845-4288-9b19-27ff5e4236df tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:13:47.968284 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-1cdd7cd6-4845-4288-9b19-27ff5e4236df tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:13:47.976754 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1cdd7cd6-4845-4288-9b19-27ff5e4236df tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:47.977259 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1cdd7cd6-4845-4288-9b19-27ff5e4236df tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:47.978161 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1cdd7cd6-4845-4288-9b19-27ff5e4236df tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:47.978655 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1cdd7cd6-4845-4288-9b19-27ff5e4236df tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:48.050555 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-1cdd7cd6-4845-4288-9b19-27ff5e4236df tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092700 Dec 16 15:13:48.051096 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 917/1843] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:13:47 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:13:49.045051 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-a9d3687e-956e-45a2-b961-6d2517fb241e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:13:49.045621 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-a9d3687e-956e-45a2-b961-6d2517fb241e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: 54869618-8ecd-4fac-8904-fe0b3bf2d3b5] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:13:49.048658 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 15:13:49.048793 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: Thu Dec 16 15:13:49 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5 (ip 10.222.0.45) !!! Dec 16 15:13:49.067072 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-df034ee6-879a-43cd-9300-bdd9867bfa46 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:13:49.068110 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-df034ee6-879a-43cd-9300-bdd9867bfa46 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:13:49.069242 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a9d3687e-956e-45a2-b961-6d2517fb241e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:49.069760 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a9d3687e-956e-45a2-b961-6d2517fb241e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:49.070931 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a9d3687e-956e-45a2-b961-6d2517fb241e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:49.071149 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a9d3687e-956e-45a2-b961-6d2517fb241e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:49.085287 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-df034ee6-879a-43cd-9300-bdd9867bfa46 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:49.085737 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-df034ee6-879a-43cd-9300-bdd9867bfa46 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:49.086656 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-df034ee6-879a-43cd-9300-bdd9867bfa46 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:49.087150 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-df034ee6-879a-43cd-9300-bdd9867bfa46 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:49.150443 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-a9d3687e-956e-45a2-b961-6d2517fb241e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: 54869618-8ecd-4fac-8904-fe0b3bf2d3b5] Going to try to terminate instance {{(pid=101356) delete /opt/stack/nova/nova/compute/api.py:2496}} Dec 16 15:13:49.177853 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-df034ee6-879a-43cd-9300-bdd9867bfa46 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.119079 Dec 16 15:13:49.178544 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 918/1844] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:13:49 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:13:49.355032 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a9d3687e-956e-45a2-b961-6d2517fb241e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [2b4fd057-4535-4860-bbaf-e5d479a38a66] AMQP server on 10.222.0.45:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 16 15:13:50.195649 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-99c22950-5627-4462-9822-6cbfe1269e56 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:13:50.196702 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-99c22950-5627-4462-9822-6cbfe1269e56 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:13:50.205422 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-99c22950-5627-4462-9822-6cbfe1269e56 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:50.206533 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-99c22950-5627-4462-9822-6cbfe1269e56 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:50.207383 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-99c22950-5627-4462-9822-6cbfe1269e56 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:50.207892 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-99c22950-5627-4462-9822-6cbfe1269e56 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:50.301383 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-99c22950-5627-4462-9822-6cbfe1269e56 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.114208 Dec 16 15:13:50.302025 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 919/1845] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:13:50 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 15:13:50.371881 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO oslo.messaging._drivers.impl_rabbit [None req-a9d3687e-956e-45a2-b961-6d2517fb241e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [2b4fd057-4535-4860-bbaf-e5d479a38a66] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 48692. Dec 16 15:13:50.432986 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-a9d3687e-956e-45a2-b961-6d2517fb241e tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "DELETE /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5" status: 204 len: 0 microversion: 2.20 time: 1.395358 Dec 16 15:13:50.433647 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 927/1846] 10.222.0.45 () {60 vars in 1270 bytes} [Thu Dec 16 15:13:49 2021] DELETE /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5 => generated 0 bytes in 1397 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Dec 16 15:13:50.447855 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-8f1805c5-d9e4-4df7-9bc0-37b4814d2804 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:13:50.448438 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-8f1805c5-d9e4-4df7-9bc0-37b4814d2804 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: 54869618-8ecd-4fac-8904-fe0b3bf2d3b5] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:13:50.457160 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8f1805c5-d9e4-4df7-9bc0-37b4814d2804 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:50.457680 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8f1805c5-d9e4-4df7-9bc0-37b4814d2804 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:50.458718 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8f1805c5-d9e4-4df7-9bc0-37b4814d2804 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:50.459277 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8f1805c5-d9e4-4df7-9bc0-37b4814d2804 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:50.704170 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-8f1805c5-d9e4-4df7-9bc0-37b4814d2804 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:13:50.716903 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-8f1805c5-d9e4-4df7-9bc0-37b4814d2804 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:13:50.721547 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-8f1805c5-d9e4-4df7-9bc0-37b4814d2804 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:13:50.722788 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-8f1805c5-d9e4-4df7-9bc0-37b4814d2804 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5" status: 200 len: 1724 microversion: 2.20 time: 0.284052 Dec 16 15:13:50.723376 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 920/1847] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:13:50 2021] GET /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5 => generated 1724 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:13:51.318429 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-71b4c7be-3910-4496-ab77-44d3e8c7f99d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:13:51.319506 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-71b4c7be-3910-4496-ab77-44d3e8c7f99d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:13:51.328240 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-71b4c7be-3910-4496-ab77-44d3e8c7f99d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:51.328745 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-71b4c7be-3910-4496-ab77-44d3e8c7f99d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:51.329671 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-71b4c7be-3910-4496-ab77-44d3e8c7f99d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:51.330198 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-71b4c7be-3910-4496-ab77-44d3e8c7f99d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:51.403780 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-71b4c7be-3910-4496-ab77-44d3e8c7f99d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094015 Dec 16 15:13:51.404390 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 928/1848] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:13:51 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:13:51.747098 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-1c5996be-4014-45de-9da9-98852c88fc2c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:13:51.747767 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-1c5996be-4014-45de-9da9-98852c88fc2c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: 54869618-8ecd-4fac-8904-fe0b3bf2d3b5] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:13:51.755723 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1c5996be-4014-45de-9da9-98852c88fc2c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:51.756238 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1c5996be-4014-45de-9da9-98852c88fc2c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:51.757080 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1c5996be-4014-45de-9da9-98852c88fc2c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:51.757574 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1c5996be-4014-45de-9da9-98852c88fc2c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:52.421714 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-5af6499a-3184-43f5-8657-a9c2e2fc58d6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:13:52.423103 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-5af6499a-3184-43f5-8657-a9c2e2fc58d6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:13:52.431189 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5af6499a-3184-43f5-8657-a9c2e2fc58d6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:52.431826 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5af6499a-3184-43f5-8657-a9c2e2fc58d6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:52.432928 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5af6499a-3184-43f5-8657-a9c2e2fc58d6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:52.433543 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5af6499a-3184-43f5-8657-a9c2e2fc58d6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:52.465029 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-1c5996be-4014-45de-9da9-98852c88fc2c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:13:52.489688 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-1c5996be-4014-45de-9da9-98852c88fc2c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:13:52.495850 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-1c5996be-4014-45de-9da9-98852c88fc2c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:13:52.497282 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-1c5996be-4014-45de-9da9-98852c88fc2c tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5" status: 200 len: 1724 microversion: 2.20 time: 0.758641 Dec 16 15:13:52.498032 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 921/1849] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:13:51 2021] GET /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5 => generated 1724 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:13:52.516819 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-5af6499a-3184-43f5-8657-a9c2e2fc58d6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.103131 Dec 16 15:13:52.517671 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 929/1850] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:13:52 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:13:53.400316 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [req-bc71a92a-fc22-447c-b93b-973bb2ba7a92 req-522781f0-68ce-4fd9-9e4a-67096a2576e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54869618-8ecd-4fac-8904-fe0b3bf2d3b5", "name": "network-vif-deleted", "tag": "1bad7080-7c47-432c-95a6-beb94a24904a"}]} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:13:53.409954 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:13:53.409954 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: warnings.warn(msg) Dec 16 15:13:53.420182 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-bc71a92a-fc22-447c-b93b-973bb2ba7a92 req-522781f0-68ce-4fd9-9e4a-67096a2576e4 service nova] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:53.420820 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-bc71a92a-fc22-447c-b93b-973bb2ba7a92 req-522781f0-68ce-4fd9-9e4a-67096a2576e4 service nova] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:53.442349 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.compute.server_external_events [req-bc71a92a-fc22-447c-b93b-973bb2ba7a92 req-522781f0-68ce-4fd9-9e4a-67096a2576e4 service nova] Creating event network-vif-deleted:1bad7080-7c47-432c-95a6-beb94a24904a for instance 54869618-8ecd-4fac-8904-fe0b3bf2d3b5 on hv-cinder-82189 Dec 16 15:13:53.449344 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [req-bc71a92a-fc22-447c-b93b-973bb2ba7a92 req-522781f0-68ce-4fd9-9e4a-67096a2576e4 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056817 Dec 16 15:13:53.450002 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 922/1851] 10.222.0.45 () {64 vars in 1308 bytes} [Thu Dec 16 15:13:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:13:53.522837 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-4a8e4880-29a8-400b-add2-c326f9005ea8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:13:53.523696 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-4a8e4880-29a8-400b-add2-c326f9005ea8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: 54869618-8ecd-4fac-8904-fe0b3bf2d3b5] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:13:53.532645 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4a8e4880-29a8-400b-add2-c326f9005ea8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:53.533429 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4a8e4880-29a8-400b-add2-c326f9005ea8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:53.535699 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4a8e4880-29a8-400b-add2-c326f9005ea8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:53.535699 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4a8e4880-29a8-400b-add2-c326f9005ea8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:53.549583 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-0eacedb2-b3e1-4db1-8add-7e2c2297565c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:13:53.551514 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-0eacedb2-b3e1-4db1-8add-7e2c2297565c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:13:53.571849 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0eacedb2-b3e1-4db1-8add-7e2c2297565c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:53.572345 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0eacedb2-b3e1-4db1-8add-7e2c2297565c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:53.573214 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0eacedb2-b3e1-4db1-8add-7e2c2297565c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:53.573707 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0eacedb2-b3e1-4db1-8add-7e2c2297565c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:53.692404 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-4a8e4880-29a8-400b-add2-c326f9005ea8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:13:53.705986 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-4a8e4880-29a8-400b-add2-c326f9005ea8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:13:53.711151 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-4a8e4880-29a8-400b-add2-c326f9005ea8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f435da8bee949fda856a880c75dfa46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff7a06ecc2404836b66f3a06d4f34d63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:13:53.711412 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-0eacedb2-b3e1-4db1-8add-7e2c2297565c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.185983 Dec 16 15:13:53.712322 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 923/1852] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:13:53 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:13:53.713214 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-4a8e4880-29a8-400b-add2-c326f9005ea8 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5" status: 200 len: 1367 microversion: 2.20 time: 0.199975 Dec 16 15:13:53.713962 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 930/1853] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:13:53 2021] GET /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5 => generated 1367 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 16 15:13:54.728117 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-18ba73bd-e6d7-4ebc-a02f-eb51087df904 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:13:54.729106 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-18ba73bd-e6d7-4ebc-a02f-eb51087df904 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:13:54.737928 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-18ba73bd-e6d7-4ebc-a02f-eb51087df904 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:54.738465 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-18ba73bd-e6d7-4ebc-a02f-eb51087df904 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:54.739332 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-18ba73bd-e6d7-4ebc-a02f-eb51087df904 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:54.739827 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-18ba73bd-e6d7-4ebc-a02f-eb51087df904 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:54.740268 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-a861b113-ade2-4523-a67a-4ea4a4600010 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:13:54.741280 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-a861b113-ade2-4523-a67a-4ea4a4600010 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: 54869618-8ecd-4fac-8904-fe0b3bf2d3b5] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:13:54.750122 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a861b113-ade2-4523-a67a-4ea4a4600010 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:54.750833 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a861b113-ade2-4523-a67a-4ea4a4600010 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:54.752045 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a861b113-ade2-4523-a67a-4ea4a4600010 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:54.753171 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a861b113-ade2-4523-a67a-4ea4a4600010 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:54.817490 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.wsgi [None req-a861b113-ade2-4523-a67a-4ea4a4600010 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] HTTP exception thrown: Instance 54869618-8ecd-4fac-8904-fe0b3bf2d3b5 could not be found. Dec 16 15:13:54.818874 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-a861b113-ade2-4523-a67a-4ea4a4600010 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Returning 404 to user: Instance 54869618-8ecd-4fac-8904-fe0b3bf2d3b5 could not be found. {{(pid=101356) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:941}} Dec 16 15:13:54.819797 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-a861b113-ade2-4523-a67a-4ea4a4600010 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5" status: 404 len: 111 microversion: 2.20 time: 0.089120 Dec 16 15:13:54.820427 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 931/1854] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:13:54 2021] GET /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 16 15:13:54.825448 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-18ba73bd-e6d7-4ebc-a02f-eb51087df904 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.105813 Dec 16 15:13:54.826085 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 924/1855] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:13:54 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:13:54.833614 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-8d99daf3-945c-40ba-a7f0-bbdc09d3db83 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '.version_select at 0x7f14f73a2510>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:13:54.922762 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-8d99daf3-945c-40ba-a7f0-bbdc09d3db83 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1018199780" status: 204 len: 0 microversion: 2.20 time: 0.097300 Dec 16 15:13:54.923401 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 932/1856] 10.222.0.45 () {60 vars in 1252 bytes} [Thu Dec 16 15:13:54 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1018199780 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Dec 16 15:13:55.842466 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-63ceeba9-8fde-4c4e-9581-bc66d065e8de tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:13:55.843567 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-63ceeba9-8fde-4c4e-9581-bc66d065e8de tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:13:55.852486 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-63ceeba9-8fde-4c4e-9581-bc66d065e8de tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:55.853119 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-63ceeba9-8fde-4c4e-9581-bc66d065e8de tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:55.853973 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-63ceeba9-8fde-4c4e-9581-bc66d065e8de tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:55.854491 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-63ceeba9-8fde-4c4e-9581-bc66d065e8de tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:55.929906 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-63ceeba9-8fde-4c4e-9581-bc66d065e8de tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096097 Dec 16 15:13:55.930588 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 925/1857] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:13:55 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:13:56.946550 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-810c6e3d-d8a1-49fc-ac3c-6adb632c9e0c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:13:56.947506 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-810c6e3d-d8a1-49fc-ac3c-6adb632c9e0c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:13:56.955985 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-810c6e3d-d8a1-49fc-ac3c-6adb632c9e0c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:56.956504 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-810c6e3d-d8a1-49fc-ac3c-6adb632c9e0c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:56.957350 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-810c6e3d-d8a1-49fc-ac3c-6adb632c9e0c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:56.957842 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-810c6e3d-d8a1-49fc-ac3c-6adb632c9e0c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:57.029310 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-810c6e3d-d8a1-49fc-ac3c-6adb632c9e0c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090757 Dec 16 15:13:57.029943 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 933/1858] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:13:56 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:13:58.045600 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-6e4db3a0-2a71-4afd-b00b-88524ca0c7c8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:13:58.046642 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-6e4db3a0-2a71-4afd-b00b-88524ca0c7c8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:13:58.055268 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6e4db3a0-2a71-4afd-b00b-88524ca0c7c8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:58.055777 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6e4db3a0-2a71-4afd-b00b-88524ca0c7c8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:58.056638 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6e4db3a0-2a71-4afd-b00b-88524ca0c7c8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:58.057135 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6e4db3a0-2a71-4afd-b00b-88524ca0c7c8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:58.129174 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-6e4db3a0-2a71-4afd-b00b-88524ca0c7c8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091510 Dec 16 15:13:58.129999 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 926/1859] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:13:58 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:13:59.145736 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-1b7c9ceb-44ec-458a-8d07-83590d69cea7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:13:59.146810 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-1b7c9ceb-44ec-458a-8d07-83590d69cea7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:13:59.155246 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1b7c9ceb-44ec-458a-8d07-83590d69cea7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:59.155754 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1b7c9ceb-44ec-458a-8d07-83590d69cea7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:59.156602 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1b7c9ceb-44ec-458a-8d07-83590d69cea7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:13:59.157093 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1b7c9ceb-44ec-458a-8d07-83590d69cea7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:13:59.234699 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-1b7c9ceb-44ec-458a-8d07-83590d69cea7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096801 Dec 16 15:13:59.235323 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 934/1860] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:13:59 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:14:00.251349 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-a2be84ca-fa69-441a-b48e-622bf5582b03 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:14:00.252320 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-a2be84ca-fa69-441a-b48e-622bf5582b03 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:14:00.263179 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a2be84ca-fa69-441a-b48e-622bf5582b03 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:14:00.263697 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a2be84ca-fa69-441a-b48e-622bf5582b03 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:14:00.264561 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a2be84ca-fa69-441a-b48e-622bf5582b03 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:14:00.265054 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a2be84ca-fa69-441a-b48e-622bf5582b03 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:14:00.347891 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-a2be84ca-fa69-441a-b48e-622bf5582b03 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.104469 Dec 16 15:14:00.348858 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 927/1861] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:14:00 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:14:01.365207 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-e76cdbf4-80d9-43fc-9e87-a459847058c6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:14:01.366861 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-e76cdbf4-80d9-43fc-9e87-a459847058c6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:14:01.375482 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e76cdbf4-80d9-43fc-9e87-a459847058c6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:14:01.375991 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e76cdbf4-80d9-43fc-9e87-a459847058c6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:14:01.376850 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e76cdbf4-80d9-43fc-9e87-a459847058c6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:14:01.377347 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e76cdbf4-80d9-43fc-9e87-a459847058c6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:14:01.449618 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-e76cdbf4-80d9-43fc-9e87-a459847058c6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092427 Dec 16 15:14:01.450309 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 935/1862] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:14:01 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:14:02.466828 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-319fee30-0cf4-455e-a9ac-b78059512807 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:14:02.467912 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-319fee30-0cf4-455e-a9ac-b78059512807 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:14:02.476367 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-319fee30-0cf4-455e-a9ac-b78059512807 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:14:02.476867 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-319fee30-0cf4-455e-a9ac-b78059512807 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:14:02.477717 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-319fee30-0cf4-455e-a9ac-b78059512807 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:14:02.478239 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-319fee30-0cf4-455e-a9ac-b78059512807 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:14:02.679700 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-319fee30-0cf4-455e-a9ac-b78059512807 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.220929 Dec 16 15:14:02.680866 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 928/1863] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:14:02 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:14:03.697264 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-4fad9317-8a53-4b8b-914f-c562517073ee tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:14:03.698337 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-4fad9317-8a53-4b8b-914f-c562517073ee tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:14:03.706586 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4fad9317-8a53-4b8b-914f-c562517073ee tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:14:03.707094 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4fad9317-8a53-4b8b-914f-c562517073ee tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:14:03.707938 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4fad9317-8a53-4b8b-914f-c562517073ee tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:14:03.708436 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4fad9317-8a53-4b8b-914f-c562517073ee tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:14:03.781315 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-4fad9317-8a53-4b8b-914f-c562517073ee tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092481 Dec 16 15:14:03.781951 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 936/1864] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:14:03 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:14:04.798870 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-aba84271-de4a-42a6-8647-a2c1e0522baa tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:14:04.799518 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-aba84271-de4a-42a6-8647-a2c1e0522baa tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:14:04.807103 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-aba84271-de4a-42a6-8647-a2c1e0522baa tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:14:04.807635 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-aba84271-de4a-42a6-8647-a2c1e0522baa tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:14:04.808473 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-aba84271-de4a-42a6-8647-a2c1e0522baa tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:14:04.808967 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-aba84271-de4a-42a6-8647-a2c1e0522baa tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:14:04.880948 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-aba84271-de4a-42a6-8647-a2c1e0522baa tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091217 Dec 16 15:14:04.881606 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 929/1865] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:14:04 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:14:05.897071 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-2afa7ea0-7bc1-46f4-a531-06c717e77d75 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:14:05.898139 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-2afa7ea0-7bc1-46f4-a531-06c717e77d75 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:14:05.906825 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2afa7ea0-7bc1-46f4-a531-06c717e77d75 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:14:05.907337 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2afa7ea0-7bc1-46f4-a531-06c717e77d75 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:14:05.908183 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2afa7ea0-7bc1-46f4-a531-06c717e77d75 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:14:05.908679 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2afa7ea0-7bc1-46f4-a531-06c717e77d75 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:14:05.980920 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-2afa7ea0-7bc1-46f4-a531-06c717e77d75 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091653 Dec 16 15:14:05.981548 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 937/1866] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:14:05 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:14:06.997301 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-c49aab7a-de0f-4450-b3f6-530bd7d72ef4 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:14:06.998376 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-c49aab7a-de0f-4450-b3f6-530bd7d72ef4 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:14:07.006394 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c49aab7a-de0f-4450-b3f6-530bd7d72ef4 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:14:07.006908 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c49aab7a-de0f-4450-b3f6-530bd7d72ef4 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:14:07.008691 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c49aab7a-de0f-4450-b3f6-530bd7d72ef4 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:14:07.008691 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c49aab7a-de0f-4450-b3f6-530bd7d72ef4 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:14:07.085390 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-c49aab7a-de0f-4450-b3f6-530bd7d72ef4 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096059 Dec 16 15:14:07.086009 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 930/1867] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:14:06 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:14:08.102225 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-b0409612-de7b-4ed9-a338-5efacfb62290 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:14:08.103284 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-b0409612-de7b-4ed9-a338-5efacfb62290 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:14:08.111251 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b0409612-de7b-4ed9-a338-5efacfb62290 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:14:08.111761 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b0409612-de7b-4ed9-a338-5efacfb62290 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:14:08.112601 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b0409612-de7b-4ed9-a338-5efacfb62290 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:14:08.113092 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b0409612-de7b-4ed9-a338-5efacfb62290 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:14:08.190159 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-b0409612-de7b-4ed9-a338-5efacfb62290 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095845 Dec 16 15:14:08.190790 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 938/1868] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:14:08 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:14:09.206241 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-0b4fce27-d8c1-4600-ba90-180bec2cbc91 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:14:09.207273 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-0b4fce27-d8c1-4600-ba90-180bec2cbc91 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:14:09.215977 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0b4fce27-d8c1-4600-ba90-180bec2cbc91 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:14:09.216597 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0b4fce27-d8c1-4600-ba90-180bec2cbc91 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:14:09.217551 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0b4fce27-d8c1-4600-ba90-180bec2cbc91 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:14:09.218185 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0b4fce27-d8c1-4600-ba90-180bec2cbc91 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:14:09.293342 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-0b4fce27-d8c1-4600-ba90-180bec2cbc91 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095424 Dec 16 15:14:09.293951 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 931/1869] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:14:09 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:14:10.309592 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-d6c71472-5739-47a5-92c0-16a515e7f3d2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:14:10.310900 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-d6c71472-5739-47a5-92c0-16a515e7f3d2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:14:10.318884 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d6c71472-5739-47a5-92c0-16a515e7f3d2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:14:10.319391 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d6c71472-5739-47a5-92c0-16a515e7f3d2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:14:10.320221 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d6c71472-5739-47a5-92c0-16a515e7f3d2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:14:10.320744 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d6c71472-5739-47a5-92c0-16a515e7f3d2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:14:10.459628 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-d6c71472-5739-47a5-92c0-16a515e7f3d2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action" status: 200 len: 76479 microversion: 2.1 time: 0.157600 Dec 16 15:14:10.460352 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 939/1870] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 15:14:10 2021] POST /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14/action => generated 76479 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:19:56.850361 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c89047bd-5046-4dc5-81a4-5f3a093a9e0b] AMQP server on 10.222.0.45:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 15:19:56.857645 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-f57adba4-2941-45f1-9dd2-c81994815ff0 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:19:56.858181 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-f57adba4-2941-45f1-9dd2-c81994815ff0 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: 54869618-8ecd-4fac-8904-fe0b3bf2d3b5] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:19:56.862653 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Dec 16 15:19:56.862845 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: Thu Dec 16 15:19:56 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5 (ip 10.222.0.45) !!! Dec 16 15:19:56.874532 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 15:19:56.874724 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: Thu Dec 16 15:19:56 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5 (ip 10.222.0.45) !!! Dec 16 15:19:56.885215 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 15:19:56.885954 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: Thu Dec 16 15:19:56 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5 (ip 10.222.0.45) !!! Dec 16 15:19:56.906157 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f57adba4-2941-45f1-9dd2-c81994815ff0 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:19:56.906659 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f57adba4-2941-45f1-9dd2-c81994815ff0 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:19:56.907505 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f57adba4-2941-45f1-9dd2-c81994815ff0 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:19:56.908001 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f57adba4-2941-45f1-9dd2-c81994815ff0 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:19:56.963638 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.wsgi [None req-f57adba4-2941-45f1-9dd2-c81994815ff0 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] HTTP exception thrown: Instance 54869618-8ecd-4fac-8904-fe0b3bf2d3b5 could not be found. Dec 16 15:19:56.964218 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-f57adba4-2941-45f1-9dd2-c81994815ff0 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Returning 404 to user: Instance 54869618-8ecd-4fac-8904-fe0b3bf2d3b5 could not be found. {{(pid=101355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:941}} Dec 16 15:19:56.965114 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-f57adba4-2941-45f1-9dd2-c81994815ff0 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "DELETE /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5" status: 404 len: 111 microversion: 2.20 time: 0.116392 Dec 16 15:19:56.965746 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 932/1871] 10.222.0.45 () {60 vars in 1270 bytes} [Thu Dec 16 15:19:56 2021] DELETE /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 16 15:19:56.979046 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-62fecf8c-fd22-43e1-b1c6-77ce604c2f51 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:19:56.979815 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-62fecf8c-fd22-43e1-b1c6-77ce604c2f51 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: 54869618-8ecd-4fac-8904-fe0b3bf2d3b5] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:19:56.983600 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c006f2bf-d7e6-4bb8-aace-c3797b4b538d] AMQP server on 10.222.0.45:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 15:19:56.985434 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Dec 16 15:19:56.985616 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: Thu Dec 16 15:19:56 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5 (ip 10.222.0.45) !!! Dec 16 15:19:56.997034 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Dec 16 15:19:56.997354 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: Thu Dec 16 15:19:56 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5 (ip 10.222.0.45) !!! Dec 16 15:19:57.008198 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 15:19:57.008381 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: Thu Dec 16 15:19:57 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5 (ip 10.222.0.45) !!! Dec 16 15:19:57.033157 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-62fecf8c-fd22-43e1-b1c6-77ce604c2f51 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:19:57.033681 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-62fecf8c-fd22-43e1-b1c6-77ce604c2f51 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:19:57.034570 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-62fecf8c-fd22-43e1-b1c6-77ce604c2f51 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:19:57.035075 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-62fecf8c-fd22-43e1-b1c6-77ce604c2f51 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:19:57.091271 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.wsgi [None req-62fecf8c-fd22-43e1-b1c6-77ce604c2f51 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] HTTP exception thrown: Instance 54869618-8ecd-4fac-8904-fe0b3bf2d3b5 could not be found. Dec 16 15:19:57.091946 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-62fecf8c-fd22-43e1-b1c6-77ce604c2f51 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Returning 404 to user: Instance 54869618-8ecd-4fac-8904-fe0b3bf2d3b5 could not be found. {{(pid=101356) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:941}} Dec 16 15:19:57.092859 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-62fecf8c-fd22-43e1-b1c6-77ce604c2f51 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5" status: 404 len: 111 microversion: 2.20 time: 0.122139 Dec 16 15:19:57.093486 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 940/1872] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:19:56 2021] GET /compute/v2.1/servers/54869618-8ecd-4fac-8904-fe0b3bf2d3b5 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 16 15:20:10.130789 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-e88b69c3-e6d3-4223-acb0-cfd827e56164 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:20:10.131417 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-e88b69c3-e6d3-4223-acb0-cfd827e56164 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:20:10.155269 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e88b69c3-e6d3-4223-acb0-cfd827e56164 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:20:10.155782 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e88b69c3-e6d3-4223-acb0-cfd827e56164 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:20:10.156790 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e88b69c3-e6d3-4223-acb0-cfd827e56164 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:20:10.157281 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e88b69c3-e6d3-4223-acb0-cfd827e56164 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:20:10.213386 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO oslo.messaging._drivers.impl_rabbit [-] [c89047bd-5046-4dc5-81a4-5f3a093a9e0b] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 52916. Dec 16 15:20:10.228276 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-e88b69c3-e6d3-4223-acb0-cfd827e56164 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Going to try to terminate instance {{(pid=101355) delete /opt/stack/nova/nova/compute/api.py:2496}} Dec 16 15:20:10.458785 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-e88b69c3-e6d3-4223-acb0-cfd827e56164 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "DELETE /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14" status: 204 len: 0 microversion: 2.1 time: 0.335390 Dec 16 15:20:10.462840 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 933/1873] 10.222.0.45 () {58 vars in 1229 bytes} [Thu Dec 16 15:20:10 2021] DELETE /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 16 15:20:10.472190 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-2cdccfae-de17-48ac-af98-d1f681079c81 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:20:10.472865 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-2cdccfae-de17-48ac-af98-d1f681079c81 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:20:10.493246 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2cdccfae-de17-48ac-af98-d1f681079c81 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:20:10.496065 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2cdccfae-de17-48ac-af98-d1f681079c81 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:20:10.496065 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2cdccfae-de17-48ac-af98-d1f681079c81 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:20:10.496065 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2cdccfae-de17-48ac-af98-d1f681079c81 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:20:10.536170 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO oslo.messaging._drivers.impl_rabbit [-] [c006f2bf-d7e6-4bb8-aace-c3797b4b538d] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 52922. Dec 16 15:20:10.901803 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-2cdccfae-de17-48ac-af98-d1f681079c81 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:20:10.911038 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-2cdccfae-de17-48ac-af98-d1f681079c81 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14" status: 200 len: 1720 microversion: 2.1 time: 0.446712 Dec 16 15:20:10.911638 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 941/1874] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:20:10 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14 => generated 1720 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:20:11.935224 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-f2d4f8f5-afca-43d7-9ffb-4bc51d5850db tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:20:11.936008 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-f2d4f8f5-afca-43d7-9ffb-4bc51d5850db tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:20:11.944220 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f2d4f8f5-afca-43d7-9ffb-4bc51d5850db tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:20:11.944734 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f2d4f8f5-afca-43d7-9ffb-4bc51d5850db tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:20:11.945590 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f2d4f8f5-afca-43d7-9ffb-4bc51d5850db tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:20:11.946116 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f2d4f8f5-afca-43d7-9ffb-4bc51d5850db tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:20:12.783759 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-f2d4f8f5-afca-43d7-9ffb-4bc51d5850db tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:20:12.794864 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-f2d4f8f5-afca-43d7-9ffb-4bc51d5850db tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14" status: 200 len: 1720 microversion: 2.1 time: 0.869183 Dec 16 15:20:12.795493 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 934/1875] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:20:11 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14 => generated 1720 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:20:13.650862 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [req-82a51955-c019-4745-a042-4e219f4f68dc req-d8e85288-b3a8-4ba2-b2bd-fc44b90219ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2989cd04-6526-4aca-8f1f-771371323c14", "name": "network-vif-deleted", "tag": "d2035528-d3ab-4af2-aaf2-d63a3fd8324b"}]} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:20:13.657449 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:20:13.657449 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: warnings.warn(msg) Dec 16 15:20:13.668617 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-82a51955-c019-4745-a042-4e219f4f68dc req-d8e85288-b3a8-4ba2-b2bd-fc44b90219ce service nova] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:20:13.669124 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-82a51955-c019-4745-a042-4e219f4f68dc req-d8e85288-b3a8-4ba2-b2bd-fc44b90219ce service nova] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:20:13.689541 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.compute.server_external_events [req-82a51955-c019-4745-a042-4e219f4f68dc req-d8e85288-b3a8-4ba2-b2bd-fc44b90219ce service nova] Creating event network-vif-deleted:d2035528-d3ab-4af2-aaf2-d63a3fd8324b for instance 2989cd04-6526-4aca-8f1f-771371323c14 on hv-cinder-82189 Dec 16 15:20:13.695931 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [req-82a51955-c019-4745-a042-4e219f4f68dc req-d8e85288-b3a8-4ba2-b2bd-fc44b90219ce service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153168 Dec 16 15:20:13.698301 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 942/1876] 10.222.0.45 () {64 vars in 1308 bytes} [Thu Dec 16 15:20:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:20:13.818110 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-52a44149-70ff-48bd-ae06-93eb699a0485 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:20:13.818974 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-52a44149-70ff-48bd-ae06-93eb699a0485 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:20:13.828103 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-52a44149-70ff-48bd-ae06-93eb699a0485 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:20:13.828615 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-52a44149-70ff-48bd-ae06-93eb699a0485 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:20:13.829669 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-52a44149-70ff-48bd-ae06-93eb699a0485 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:20:13.830202 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-52a44149-70ff-48bd-ae06-93eb699a0485 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:20:14.014932 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-52a44149-70ff-48bd-ae06-93eb699a0485 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:20:14.024242 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-52a44149-70ff-48bd-ae06-93eb699a0485 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14" status: 200 len: 1368 microversion: 2.1 time: 0.214700 Dec 16 15:20:14.025023 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 935/1877] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:20:13 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14 => generated 1368 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:20:15.048131 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-28a58191-5a6f-4d1b-91e7-1f69fede36f3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:20:15.049545 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-28a58191-5a6f-4d1b-91e7-1f69fede36f3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:20:15.059442 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-28a58191-5a6f-4d1b-91e7-1f69fede36f3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:20:15.059954 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-28a58191-5a6f-4d1b-91e7-1f69fede36f3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:20:15.060854 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-28a58191-5a6f-4d1b-91e7-1f69fede36f3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:20:15.061352 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-28a58191-5a6f-4d1b-91e7-1f69fede36f3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:20:15.193429 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-28a58191-5a6f-4d1b-91e7-1f69fede36f3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:20:15.203538 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-28a58191-5a6f-4d1b-91e7-1f69fede36f3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14" status: 200 len: 1368 microversion: 2.1 time: 0.163987 Dec 16 15:20:15.204130 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 943/1878] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:20:15 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14 => generated 1368 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:20:16.225640 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-4747ebd7-f0e7-4fdb-ad03-3c83cba466b6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:20:16.226337 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-4747ebd7-f0e7-4fdb-ad03-3c83cba466b6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:20:16.234789 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4747ebd7-f0e7-4fdb-ad03-3c83cba466b6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:20:16.235293 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4747ebd7-f0e7-4fdb-ad03-3c83cba466b6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:20:16.236134 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4747ebd7-f0e7-4fdb-ad03-3c83cba466b6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:20:16.236628 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4747ebd7-f0e7-4fdb-ad03-3c83cba466b6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:20:16.367212 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-4747ebd7-f0e7-4fdb-ad03-3c83cba466b6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:20:16.383394 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-4747ebd7-f0e7-4fdb-ad03-3c83cba466b6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14" status: 200 len: 1368 microversion: 2.1 time: 0.164600 Dec 16 15:20:16.384465 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 936/1879] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:20:16 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14 => generated 1368 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:20:17.404689 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-d7213d6d-ac69-4d74-b8c0-b8d4d4044801 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:20:17.405356 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-d7213d6d-ac69-4d74-b8c0-b8d4d4044801 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:20:17.413849 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d7213d6d-ac69-4d74-b8c0-b8d4d4044801 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:20:17.414383 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d7213d6d-ac69-4d74-b8c0-b8d4d4044801 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:20:17.415226 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d7213d6d-ac69-4d74-b8c0-b8d4d4044801 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:20:17.415715 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d7213d6d-ac69-4d74-b8c0-b8d4d4044801 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:20:17.552604 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-d7213d6d-ac69-4d74-b8c0-b8d4d4044801 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:20:17.562896 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-d7213d6d-ac69-4d74-b8c0-b8d4d4044801 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14" status: 200 len: 1368 microversion: 2.1 time: 0.165983 Dec 16 15:20:17.563501 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 944/1880] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:20:17 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14 => generated 1368 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:20:18.584026 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-7d67e80f-be88-4e3e-8067-77e84f676819 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:20:18.584698 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-7d67e80f-be88-4e3e-8067-77e84f676819 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:20:18.592644 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7d67e80f-be88-4e3e-8067-77e84f676819 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:20:18.593153 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7d67e80f-be88-4e3e-8067-77e84f676819 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:20:18.593994 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7d67e80f-be88-4e3e-8067-77e84f676819 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:20:18.594514 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7d67e80f-be88-4e3e-8067-77e84f676819 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:20:18.723165 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-7d67e80f-be88-4e3e-8067-77e84f676819 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:20:18.732438 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-7d67e80f-be88-4e3e-8067-77e84f676819 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14" status: 200 len: 1368 microversion: 2.1 time: 0.156267 Dec 16 15:20:18.733026 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 937/1881] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:20:18 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14 => generated 1368 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:20:19.754872 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-c09532f1-a00a-410d-86df-7c5a9a8fc59c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:20:19.755467 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-c09532f1-a00a-410d-86df-7c5a9a8fc59c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:20:19.763619 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c09532f1-a00a-410d-86df-7c5a9a8fc59c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:20:19.764127 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c09532f1-a00a-410d-86df-7c5a9a8fc59c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:20:19.764978 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c09532f1-a00a-410d-86df-7c5a9a8fc59c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:20:19.765471 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c09532f1-a00a-410d-86df-7c5a9a8fc59c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:20:19.895297 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-c09532f1-a00a-410d-86df-7c5a9a8fc59c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:20:19.904715 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-c09532f1-a00a-410d-86df-7c5a9a8fc59c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14" status: 200 len: 1368 microversion: 2.1 time: 0.157795 Dec 16 15:20:19.905317 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 945/1882] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:20:19 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14 => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:20:20.925738 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-cec035ac-afa6-4622-becb-86f198b88501 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:20:20.926485 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-cec035ac-afa6-4622-becb-86f198b88501 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:20:20.935845 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cec035ac-afa6-4622-becb-86f198b88501 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:20:20.936359 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cec035ac-afa6-4622-becb-86f198b88501 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:20:20.937235 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cec035ac-afa6-4622-becb-86f198b88501 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:20:20.937736 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cec035ac-afa6-4622-becb-86f198b88501 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:20:21.064376 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-cec035ac-afa6-4622-becb-86f198b88501 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:20:21.076137 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-cec035ac-afa6-4622-becb-86f198b88501 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14" status: 200 len: 1368 microversion: 2.1 time: 0.158089 Dec 16 15:20:21.076969 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 938/1883] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:20:20 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14 => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:20:22.098850 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-2965c917-3bc9-493a-9eb7-5865dfb53da6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:20:22.099714 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-2965c917-3bc9-493a-9eb7-5865dfb53da6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:20:22.107964 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2965c917-3bc9-493a-9eb7-5865dfb53da6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:20:22.108463 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2965c917-3bc9-493a-9eb7-5865dfb53da6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:20:22.109315 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2965c917-3bc9-493a-9eb7-5865dfb53da6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:20:22.109796 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2965c917-3bc9-493a-9eb7-5865dfb53da6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:20:22.240456 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-2965c917-3bc9-493a-9eb7-5865dfb53da6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:20:22.250719 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-2965c917-3bc9-493a-9eb7-5865dfb53da6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14" status: 200 len: 1368 microversion: 2.1 time: 0.159618 Dec 16 15:20:22.251553 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 946/1884] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:20:22 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14 => generated 1368 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:20:23.275237 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-5bb40ae0-ec0d-4b32-9a17-23cf157a6d30 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:20:23.275963 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-5bb40ae0-ec0d-4b32-9a17-23cf157a6d30 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:20:23.284708 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5bb40ae0-ec0d-4b32-9a17-23cf157a6d30 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:20:23.285212 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5bb40ae0-ec0d-4b32-9a17-23cf157a6d30 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:20:23.286088 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5bb40ae0-ec0d-4b32-9a17-23cf157a6d30 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:20:23.286579 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5bb40ae0-ec0d-4b32-9a17-23cf157a6d30 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:20:23.436100 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-5bb40ae0-ec0d-4b32-9a17-23cf157a6d30 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:20:23.445806 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-5bb40ae0-ec0d-4b32-9a17-23cf157a6d30 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14" status: 200 len: 1368 microversion: 2.1 time: 0.178344 Dec 16 15:20:23.446448 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 939/1885] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:20:23 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14 => generated 1368 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:20:24.468353 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-37c82aec-45af-4236-933e-9fb4fcae5e32 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:20:24.469073 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-37c82aec-45af-4236-933e-9fb4fcae5e32 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:20:24.477001 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-37c82aec-45af-4236-933e-9fb4fcae5e32 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:20:24.477510 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-37c82aec-45af-4236-933e-9fb4fcae5e32 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:20:24.478419 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-37c82aec-45af-4236-933e-9fb4fcae5e32 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:20:24.478921 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-37c82aec-45af-4236-933e-9fb4fcae5e32 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:20:24.608960 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-37c82aec-45af-4236-933e-9fb4fcae5e32 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:20:24.618318 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-37c82aec-45af-4236-933e-9fb4fcae5e32 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14" status: 200 len: 1368 microversion: 2.1 time: 0.157761 Dec 16 15:20:24.618917 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 947/1886] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:20:24 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14 => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:20:25.641336 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-62743ee8-f6c5-4fb6-9e14-4cf129068382 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:20:25.642011 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-62743ee8-f6c5-4fb6-9e14-4cf129068382 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:20:25.650259 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-62743ee8-f6c5-4fb6-9e14-4cf129068382 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:20:25.650764 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-62743ee8-f6c5-4fb6-9e14-4cf129068382 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:20:25.651682 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-62743ee8-f6c5-4fb6-9e14-4cf129068382 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:20:25.652166 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-62743ee8-f6c5-4fb6-9e14-4cf129068382 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:20:25.781989 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-62743ee8-f6c5-4fb6-9e14-4cf129068382 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:20:25.791249 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-62743ee8-f6c5-4fb6-9e14-4cf129068382 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14" status: 200 len: 1368 microversion: 2.1 time: 0.158142 Dec 16 15:20:25.791833 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 940/1887] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:20:25 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14 => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:20:26.813347 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-17c827dd-9938-4c76-ba16-5c17992f6a74 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:20:26.814020 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-17c827dd-9938-4c76-ba16-5c17992f6a74 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:20:26.821787 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-17c827dd-9938-4c76-ba16-5c17992f6a74 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:20:26.822342 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-17c827dd-9938-4c76-ba16-5c17992f6a74 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:20:26.823837 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-17c827dd-9938-4c76-ba16-5c17992f6a74 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:20:26.824346 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-17c827dd-9938-4c76-ba16-5c17992f6a74 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:20:27.157245 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-17c827dd-9938-4c76-ba16-5c17992f6a74 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:20:27.166650 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-17c827dd-9938-4c76-ba16-5c17992f6a74 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14" status: 200 len: 1368 microversion: 2.1 time: 0.361441 Dec 16 15:20:27.167781 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 948/1888] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:20:26 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14 => generated 1368 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:20:28.287469 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-d45bb073-25c5-463d-b388-b0c1e7d143a3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:20:28.288140 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-d45bb073-25c5-463d-b388-b0c1e7d143a3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:20:28.296680 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d45bb073-25c5-463d-b388-b0c1e7d143a3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:20:28.297185 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d45bb073-25c5-463d-b388-b0c1e7d143a3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:20:28.298069 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d45bb073-25c5-463d-b388-b0c1e7d143a3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:20:28.298773 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d45bb073-25c5-463d-b388-b0c1e7d143a3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:20:28.425164 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-d45bb073-25c5-463d-b388-b0c1e7d143a3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:20:28.434804 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-d45bb073-25c5-463d-b388-b0c1e7d143a3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14" status: 200 len: 1368 microversion: 2.1 time: 0.253381 Dec 16 15:20:28.435395 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 941/1889] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:20:28 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14 => generated 1368 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:20:29.455701 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-5f297f32-45bc-4e61-8c61-f42fe77adb79 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:20:29.456367 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-5f297f32-45bc-4e61-8c61-f42fe77adb79 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:20:29.464198 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5f297f32-45bc-4e61-8c61-f42fe77adb79 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:20:29.464693 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5f297f32-45bc-4e61-8c61-f42fe77adb79 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:20:29.465537 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5f297f32-45bc-4e61-8c61-f42fe77adb79 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:20:29.466022 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5f297f32-45bc-4e61-8c61-f42fe77adb79 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:20:29.591120 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-5f297f32-45bc-4e61-8c61-f42fe77adb79 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:20:29.600529 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-5f297f32-45bc-4e61-8c61-f42fe77adb79 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14" status: 200 len: 1368 microversion: 2.1 time: 0.152441 Dec 16 15:20:29.601122 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 949/1890] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:20:29 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14 => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:20:30.624214 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-e27764a8-a57a-414b-8235-72d5b32031c3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:20:30.624886 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-e27764a8-a57a-414b-8235-72d5b32031c3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:20:30.632832 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e27764a8-a57a-414b-8235-72d5b32031c3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:20:30.633348 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e27764a8-a57a-414b-8235-72d5b32031c3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:20:30.634271 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e27764a8-a57a-414b-8235-72d5b32031c3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:20:30.634769 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e27764a8-a57a-414b-8235-72d5b32031c3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:20:30.763493 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-e27764a8-a57a-414b-8235-72d5b32031c3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:20:30.772673 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-e27764a8-a57a-414b-8235-72d5b32031c3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14" status: 200 len: 1368 microversion: 2.1 time: 0.156758 Dec 16 15:20:30.773259 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 942/1891] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:20:30 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14 => generated 1368 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:20:31.795440 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-8e90fe1b-b6c5-463c-a797-f5a27a7845e0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:20:31.796065 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-8e90fe1b-b6c5-463c-a797-f5a27a7845e0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:20:31.804870 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8e90fe1b-b6c5-463c-a797-f5a27a7845e0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:20:31.805367 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8e90fe1b-b6c5-463c-a797-f5a27a7845e0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:20:31.806297 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8e90fe1b-b6c5-463c-a797-f5a27a7845e0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:20:31.807204 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8e90fe1b-b6c5-463c-a797-f5a27a7845e0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:20:31.941213 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-8e90fe1b-b6c5-463c-a797-f5a27a7845e0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:20:31.951027 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-8e90fe1b-b6c5-463c-a797-f5a27a7845e0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14" status: 200 len: 1368 microversion: 2.1 time: 0.164356 Dec 16 15:20:31.951625 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 950/1892] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:20:31 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14 => generated 1368 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:20:32.972898 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-63b86025-26bb-4fc0-9cf0-9322c5ad2cd3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:20:32.973466 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-63b86025-26bb-4fc0-9cf0-9322c5ad2cd3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:20:32.981417 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-63b86025-26bb-4fc0-9cf0-9322c5ad2cd3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:20:32.981931 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-63b86025-26bb-4fc0-9cf0-9322c5ad2cd3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:20:32.982807 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-63b86025-26bb-4fc0-9cf0-9322c5ad2cd3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:20:32.983302 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-63b86025-26bb-4fc0-9cf0-9322c5ad2cd3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:20:33.114923 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-63b86025-26bb-4fc0-9cf0-9322c5ad2cd3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:20:33.124858 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-63b86025-26bb-4fc0-9cf0-9322c5ad2cd3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14" status: 200 len: 1368 microversion: 2.1 time: 0.160445 Dec 16 15:20:33.125439 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 943/1893] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:20:32 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14 => generated 1368 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:20:34.146707 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-56dc69ea-d668-4e4a-a04e-fbcc506025f9 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:20:34.147416 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-56dc69ea-d668-4e4a-a04e-fbcc506025f9 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:20:34.155918 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-56dc69ea-d668-4e4a-a04e-fbcc506025f9 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:20:34.156414 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-56dc69ea-d668-4e4a-a04e-fbcc506025f9 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:20:34.157240 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-56dc69ea-d668-4e4a-a04e-fbcc506025f9 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:20:34.157723 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-56dc69ea-d668-4e4a-a04e-fbcc506025f9 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:20:34.289987 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-56dc69ea-d668-4e4a-a04e-fbcc506025f9 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:20:34.299455 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-56dc69ea-d668-4e4a-a04e-fbcc506025f9 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14" status: 200 len: 1368 microversion: 2.1 time: 0.160376 Dec 16 15:20:34.300047 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 951/1894] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:20:34 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14 => generated 1368 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:20:35.321408 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-eb8081ff-0583-4d3c-866f-24d3ed0a28f5 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:20:35.322008 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-eb8081ff-0583-4d3c-866f-24d3ed0a28f5 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:20:35.329883 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-eb8081ff-0583-4d3c-866f-24d3ed0a28f5 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:20:35.330445 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-eb8081ff-0583-4d3c-866f-24d3ed0a28f5 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:20:35.331290 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-eb8081ff-0583-4d3c-866f-24d3ed0a28f5 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:20:35.331789 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-eb8081ff-0583-4d3c-866f-24d3ed0a28f5 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:20:35.458768 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-eb8081ff-0583-4d3c-866f-24d3ed0a28f5 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:20:35.468766 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-eb8081ff-0583-4d3c-866f-24d3ed0a28f5 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14" status: 200 len: 1368 microversion: 2.1 time: 0.155168 Dec 16 15:20:35.469361 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 944/1895] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:20:35 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14 => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:20:36.490321 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-e57b510f-b8f1-4f06-b682-b026d10a42c8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:20:36.490984 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-e57b510f-b8f1-4f06-b682-b026d10a42c8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:20:36.499430 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e57b510f-b8f1-4f06-b682-b026d10a42c8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:20:36.499928 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e57b510f-b8f1-4f06-b682-b026d10a42c8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:20:36.500798 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e57b510f-b8f1-4f06-b682-b026d10a42c8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:20:36.501284 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e57b510f-b8f1-4f06-b682-b026d10a42c8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:20:36.627279 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-e57b510f-b8f1-4f06-b682-b026d10a42c8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:20:36.637214 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-e57b510f-b8f1-4f06-b682-b026d10a42c8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14" status: 200 len: 1368 microversion: 2.1 time: 0.154362 Dec 16 15:20:36.637820 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 952/1896] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:20:36 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14 => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:20:37.659368 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-31f6e425-542d-4c97-91c7-b3d6bbc87937 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:20:37.660082 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-31f6e425-542d-4c97-91c7-b3d6bbc87937 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:20:37.668504 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-31f6e425-542d-4c97-91c7-b3d6bbc87937 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:20:37.669019 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-31f6e425-542d-4c97-91c7-b3d6bbc87937 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:20:37.669865 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-31f6e425-542d-4c97-91c7-b3d6bbc87937 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:20:37.670393 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-31f6e425-542d-4c97-91c7-b3d6bbc87937 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:20:37.799421 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-31f6e425-542d-4c97-91c7-b3d6bbc87937 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:20:37.809088 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-31f6e425-542d-4c97-91c7-b3d6bbc87937 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14" status: 200 len: 1368 microversion: 2.1 time: 0.157488 Dec 16 15:20:37.809680 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 945/1897] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:20:37 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14 => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:20:38.831585 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-b206c15b-3b33-4bfe-b98c-84a767f4db32 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:20:38.832242 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-b206c15b-3b33-4bfe-b98c-84a767f4db32 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:20:38.840170 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b206c15b-3b33-4bfe-b98c-84a767f4db32 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:20:38.840669 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b206c15b-3b33-4bfe-b98c-84a767f4db32 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:20:38.841501 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b206c15b-3b33-4bfe-b98c-84a767f4db32 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:20:38.841986 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b206c15b-3b33-4bfe-b98c-84a767f4db32 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:20:38.970851 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-b206c15b-3b33-4bfe-b98c-84a767f4db32 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:20:38.980137 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-b206c15b-3b33-4bfe-b98c-84a767f4db32 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14" status: 200 len: 1368 microversion: 2.1 time: 0.156764 Dec 16 15:20:38.980719 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 953/1898] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:20:38 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14 => generated 1368 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:20:40.001871 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-43efa491-aa9e-417c-a87d-663c3c20bc9a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:20:40.002577 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-43efa491-aa9e-417c-a87d-663c3c20bc9a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:20:40.011041 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-43efa491-aa9e-417c-a87d-663c3c20bc9a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:20:40.011556 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-43efa491-aa9e-417c-a87d-663c3c20bc9a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:20:40.012401 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-43efa491-aa9e-417c-a87d-663c3c20bc9a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:20:40.012900 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-43efa491-aa9e-417c-a87d-663c3c20bc9a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:20:40.143237 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-43efa491-aa9e-417c-a87d-663c3c20bc9a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:20:40.153478 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-43efa491-aa9e-417c-a87d-663c3c20bc9a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14" status: 200 len: 1368 microversion: 2.1 time: 0.159363 Dec 16 15:20:40.154147 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 946/1899] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:20:39 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14 => generated 1368 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:20:41.175176 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-fa66c9d4-5bbd-41c6-a814-50477297741d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:20:41.175851 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-fa66c9d4-5bbd-41c6-a814-50477297741d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:20:41.184743 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fa66c9d4-5bbd-41c6-a814-50477297741d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:20:41.185251 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fa66c9d4-5bbd-41c6-a814-50477297741d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:20:41.186436 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fa66c9d4-5bbd-41c6-a814-50477297741d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:20:41.186597 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fa66c9d4-5bbd-41c6-a814-50477297741d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:20:41.320783 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-fa66c9d4-5bbd-41c6-a814-50477297741d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:20:41.331056 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-fa66c9d4-5bbd-41c6-a814-50477297741d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14" status: 200 len: 1368 microversion: 2.1 time: 0.163589 Dec 16 15:20:41.331647 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 954/1900] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:20:41 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14 => generated 1368 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:20:42.354578 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-b74c540b-cb7f-475b-bc86-d037b2dc6dd4 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:20:42.355131 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-b74c540b-cb7f-475b-bc86-d037b2dc6dd4 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:20:42.362882 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b74c540b-cb7f-475b-bc86-d037b2dc6dd4 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:20:42.363363 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b74c540b-cb7f-475b-bc86-d037b2dc6dd4 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:20:42.364215 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b74c540b-cb7f-475b-bc86-d037b2dc6dd4 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:20:42.364712 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b74c540b-cb7f-475b-bc86-d037b2dc6dd4 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:20:42.502831 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-b74c540b-cb7f-475b-bc86-d037b2dc6dd4 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:20:42.515128 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-b74c540b-cb7f-475b-bc86-d037b2dc6dd4 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14" status: 200 len: 1368 microversion: 2.1 time: 0.169905 Dec 16 15:20:42.516112 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 947/1901] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:20:42 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14 => generated 1368 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:20:43.537855 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-886bae99-78e6-43ad-9554-39b0fad927c2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:20:43.538589 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-886bae99-78e6-43ad-9554-39b0fad927c2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:20:43.546385 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-886bae99-78e6-43ad-9554-39b0fad927c2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:20:43.546881 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-886bae99-78e6-43ad-9554-39b0fad927c2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:20:43.547707 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-886bae99-78e6-43ad-9554-39b0fad927c2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:20:43.548190 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-886bae99-78e6-43ad-9554-39b0fad927c2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:20:43.677016 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-886bae99-78e6-43ad-9554-39b0fad927c2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:20:43.687147 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-886bae99-78e6-43ad-9554-39b0fad927c2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14" status: 200 len: 1368 microversion: 2.1 time: 0.156681 Dec 16 15:20:43.687572 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 955/1902] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:20:43 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14 => generated 1368 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:20:44.709490 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-9916f7ae-75c2-4f65-8fde-78ee6e8c4949 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:20:44.710199 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-9916f7ae-75c2-4f65-8fde-78ee6e8c4949 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:20:44.719141 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9916f7ae-75c2-4f65-8fde-78ee6e8c4949 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:20:44.719643 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9916f7ae-75c2-4f65-8fde-78ee6e8c4949 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:20:44.720489 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9916f7ae-75c2-4f65-8fde-78ee6e8c4949 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:20:44.720975 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9916f7ae-75c2-4f65-8fde-78ee6e8c4949 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:20:44.851390 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-9916f7ae-75c2-4f65-8fde-78ee6e8c4949 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:20:44.860719 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-9916f7ae-75c2-4f65-8fde-78ee6e8c4949 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14" status: 200 len: 1368 microversion: 2.1 time: 0.159371 Dec 16 15:20:44.861312 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 948/1903] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:20:44 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14 => generated 1368 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:20:45.881903 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-3330329f-13f9-40f3-abc0-c575ba806f8d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:20:45.882765 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-3330329f-13f9-40f3-abc0-c575ba806f8d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:20:45.891489 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3330329f-13f9-40f3-abc0-c575ba806f8d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:20:45.891997 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3330329f-13f9-40f3-abc0-c575ba806f8d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:20:45.892883 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3330329f-13f9-40f3-abc0-c575ba806f8d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:20:45.893371 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3330329f-13f9-40f3-abc0-c575ba806f8d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:20:46.024161 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-3330329f-13f9-40f3-abc0-c575ba806f8d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:20:46.034609 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-3330329f-13f9-40f3-abc0-c575ba806f8d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14" status: 200 len: 1368 microversion: 2.1 time: 0.160276 Dec 16 15:20:46.035210 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 956/1904] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:20:45 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14 => generated 1368 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:20:47.057088 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-77ad345b-fedc-4aff-bad4-fe375ba9cd5d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:20:47.057808 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-77ad345b-fedc-4aff-bad4-fe375ba9cd5d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:20:47.066278 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-77ad345b-fedc-4aff-bad4-fe375ba9cd5d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:20:47.066787 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-77ad345b-fedc-4aff-bad4-fe375ba9cd5d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:20:47.067629 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-77ad345b-fedc-4aff-bad4-fe375ba9cd5d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:20:47.068118 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-77ad345b-fedc-4aff-bad4-fe375ba9cd5d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:20:47.202364 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-77ad345b-fedc-4aff-bad4-fe375ba9cd5d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:20:47.211831 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-77ad345b-fedc-4aff-bad4-fe375ba9cd5d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14" status: 200 len: 1368 microversion: 2.1 time: 0.163012 Dec 16 15:20:47.212450 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 949/1905] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:20:47 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14 => generated 1368 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:20:48.233513 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-7c85139e-a13c-4b79-acd2-30a2a7657a0e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:20:48.234310 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-7c85139e-a13c-4b79-acd2-30a2a7657a0e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:20:48.243216 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7c85139e-a13c-4b79-acd2-30a2a7657a0e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:20:48.243344 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7c85139e-a13c-4b79-acd2-30a2a7657a0e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:20:48.244080 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7c85139e-a13c-4b79-acd2-30a2a7657a0e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:20:48.244707 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7c85139e-a13c-4b79-acd2-30a2a7657a0e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:20:48.376791 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-7c85139e-a13c-4b79-acd2-30a2a7657a0e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:20:48.387033 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-7c85139e-a13c-4b79-acd2-30a2a7657a0e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14" status: 200 len: 1368 microversion: 2.1 time: 0.160648 Dec 16 15:20:48.387628 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 957/1906] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:20:48 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14 => generated 1368 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:20:49.407862 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-85dd2c17-a2f1-4d89-8f2f-fbae733c656f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:20:49.408545 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-85dd2c17-a2f1-4d89-8f2f-fbae733c656f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:20:49.416625 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-85dd2c17-a2f1-4d89-8f2f-fbae733c656f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:20:49.417133 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-85dd2c17-a2f1-4d89-8f2f-fbae733c656f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:20:49.418596 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-85dd2c17-a2f1-4d89-8f2f-fbae733c656f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:20:49.419093 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-85dd2c17-a2f1-4d89-8f2f-fbae733c656f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:20:49.544913 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-85dd2c17-a2f1-4d89-8f2f-fbae733c656f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:20:49.557065 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-85dd2c17-a2f1-4d89-8f2f-fbae733c656f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14" status: 200 len: 1368 microversion: 2.1 time: 0.157209 Dec 16 15:20:49.557900 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 950/1907] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:20:49 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14 => generated 1368 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:20:50.577942 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-cdadb00d-483e-4ee2-a47a-b86138b243cc tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:20:50.578646 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-cdadb00d-483e-4ee2-a47a-b86138b243cc tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:20:50.587245 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cdadb00d-483e-4ee2-a47a-b86138b243cc tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:20:50.587768 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cdadb00d-483e-4ee2-a47a-b86138b243cc tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:20:50.588734 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cdadb00d-483e-4ee2-a47a-b86138b243cc tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:20:50.589263 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cdadb00d-483e-4ee2-a47a-b86138b243cc tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:20:50.718116 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-cdadb00d-483e-4ee2-a47a-b86138b243cc tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:20:50.727589 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-cdadb00d-483e-4ee2-a47a-b86138b243cc tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14" status: 200 len: 1368 microversion: 2.1 time: 0.157544 Dec 16 15:20:50.728187 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 958/1908] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:20:50 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14 => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:20:51.750360 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-c2f78e6b-7b01-4ca3-9fb1-89f084edd5a0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:20:51.752473 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-c2f78e6b-7b01-4ca3-9fb1-89f084edd5a0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:20:51.760068 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c2f78e6b-7b01-4ca3-9fb1-89f084edd5a0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:20:51.760643 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c2f78e6b-7b01-4ca3-9fb1-89f084edd5a0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:20:51.762684 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c2f78e6b-7b01-4ca3-9fb1-89f084edd5a0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:20:51.764092 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c2f78e6b-7b01-4ca3-9fb1-89f084edd5a0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:20:51.903883 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-c2f78e6b-7b01-4ca3-9fb1-89f084edd5a0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:20:51.913324 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-c2f78e6b-7b01-4ca3-9fb1-89f084edd5a0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14" status: 200 len: 1368 microversion: 2.1 time: 0.171258 Dec 16 15:20:51.913925 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 951/1909] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:20:51 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14 => generated 1368 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:20:52.937822 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-edcb2bec-91a2-49e8-921f-7be9bdfd045c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:20:52.938455 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-edcb2bec-91a2-49e8-921f-7be9bdfd045c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:20:52.946478 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-edcb2bec-91a2-49e8-921f-7be9bdfd045c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:20:52.946985 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-edcb2bec-91a2-49e8-921f-7be9bdfd045c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:20:52.947825 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-edcb2bec-91a2-49e8-921f-7be9bdfd045c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:20:52.948315 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-edcb2bec-91a2-49e8-921f-7be9bdfd045c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:20:53.084405 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-edcb2bec-91a2-49e8-921f-7be9bdfd045c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:20:53.097996 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-edcb2bec-91a2-49e8-921f-7be9bdfd045c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14" status: 200 len: 1368 microversion: 2.1 time: 0.168236 Dec 16 15:20:53.098994 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 959/1910] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:20:52 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14 => generated 1368 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:20:54.125826 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-50ed9836-28c0-4571-bee6-77a6fb8ff149 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:20:54.126507 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-50ed9836-28c0-4571-bee6-77a6fb8ff149 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:20:54.135018 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-50ed9836-28c0-4571-bee6-77a6fb8ff149 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:20:54.135532 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-50ed9836-28c0-4571-bee6-77a6fb8ff149 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:20:54.136414 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-50ed9836-28c0-4571-bee6-77a6fb8ff149 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:20:54.136917 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-50ed9836-28c0-4571-bee6-77a6fb8ff149 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:20:54.271655 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-50ed9836-28c0-4571-bee6-77a6fb8ff149 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:20:54.282564 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-50ed9836-28c0-4571-bee6-77a6fb8ff149 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14" status: 200 len: 1368 microversion: 2.1 time: 0.165496 Dec 16 15:20:54.283184 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 952/1911] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:20:54 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14 => generated 1368 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:20:55.306831 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-ebd741ee-72b8-43ba-a5a1-de6f9b288093 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:20:55.307486 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-ebd741ee-72b8-43ba-a5a1-de6f9b288093 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:20:55.315184 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ebd741ee-72b8-43ba-a5a1-de6f9b288093 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:20:55.315688 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ebd741ee-72b8-43ba-a5a1-de6f9b288093 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:20:55.316525 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ebd741ee-72b8-43ba-a5a1-de6f9b288093 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:20:55.317012 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ebd741ee-72b8-43ba-a5a1-de6f9b288093 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:20:55.449897 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-ebd741ee-72b8-43ba-a5a1-de6f9b288093 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:20:55.459260 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-ebd741ee-72b8-43ba-a5a1-de6f9b288093 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14" status: 200 len: 1368 microversion: 2.1 time: 0.160346 Dec 16 15:20:55.459851 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 960/1912] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:20:55 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14 => generated 1368 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:20:56.481881 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-2b7a3361-1cb5-4dbb-9607-5e0ff4abd64d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:20:56.482527 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-2b7a3361-1cb5-4dbb-9607-5e0ff4abd64d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:20:56.490310 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2b7a3361-1cb5-4dbb-9607-5e0ff4abd64d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:20:56.490818 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2b7a3361-1cb5-4dbb-9607-5e0ff4abd64d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:20:56.491668 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2b7a3361-1cb5-4dbb-9607-5e0ff4abd64d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:20:56.492160 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2b7a3361-1cb5-4dbb-9607-5e0ff4abd64d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:20:56.617609 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-2b7a3361-1cb5-4dbb-9607-5e0ff4abd64d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:20:56.626988 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-2b7a3361-1cb5-4dbb-9607-5e0ff4abd64d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14" status: 200 len: 1368 microversion: 2.1 time: 0.153363 Dec 16 15:20:56.627572 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 953/1913] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:20:56 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14 => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:20:57.648991 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-30ae8aca-db42-4782-9296-3851b2f0729f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:20:57.649710 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-30ae8aca-db42-4782-9296-3851b2f0729f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:20:57.658196 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-30ae8aca-db42-4782-9296-3851b2f0729f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:20:57.658712 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-30ae8aca-db42-4782-9296-3851b2f0729f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:20:57.659549 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-30ae8aca-db42-4782-9296-3851b2f0729f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:20:57.660044 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-30ae8aca-db42-4782-9296-3851b2f0729f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:20:57.785341 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-30ae8aca-db42-4782-9296-3851b2f0729f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:20:57.794596 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-30ae8aca-db42-4782-9296-3851b2f0729f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14" status: 200 len: 1368 microversion: 2.1 time: 0.153243 Dec 16 15:20:57.795759 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 961/1914] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:20:57 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14 => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:20:58.817495 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-cdda1715-19ae-47ff-8f94-2f29f2040f0c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:20:58.818130 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-cdda1715-19ae-47ff-8f94-2f29f2040f0c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:20:58.826537 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cdda1715-19ae-47ff-8f94-2f29f2040f0c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:20:58.827042 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cdda1715-19ae-47ff-8f94-2f29f2040f0c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:20:58.827884 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cdda1715-19ae-47ff-8f94-2f29f2040f0c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:20:58.828385 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cdda1715-19ae-47ff-8f94-2f29f2040f0c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:20:58.958074 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-cdda1715-19ae-47ff-8f94-2f29f2040f0c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:20:58.967365 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-cdda1715-19ae-47ff-8f94-2f29f2040f0c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14" status: 200 len: 1368 microversion: 2.1 time: 0.157685 Dec 16 15:20:58.967957 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 954/1915] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:20:58 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14 => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:20:59.988725 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-8fc2325e-4ca3-4040-ad93-f5e4e9596f4c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:20:59.989321 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-8fc2325e-4ca3-4040-ad93-f5e4e9596f4c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:20:59.997164 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8fc2325e-4ca3-4040-ad93-f5e4e9596f4c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:20:59.997666 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8fc2325e-4ca3-4040-ad93-f5e4e9596f4c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:20:59.999052 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8fc2325e-4ca3-4040-ad93-f5e4e9596f4c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:20:59.999538 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8fc2325e-4ca3-4040-ad93-f5e4e9596f4c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:21:00.131002 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-8fc2325e-4ca3-4040-ad93-f5e4e9596f4c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:21:00.140591 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-8fc2325e-4ca3-4040-ad93-f5e4e9596f4c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14" status: 200 len: 1368 microversion: 2.1 time: 0.159522 Dec 16 15:21:00.141186 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 962/1916] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:20:59 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14 => generated 1368 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:21:01.162488 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-55448279-259b-46a7-92b4-8ea24060dfa3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:21:01.163187 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-55448279-259b-46a7-92b4-8ea24060dfa3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:21:01.171062 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-55448279-259b-46a7-92b4-8ea24060dfa3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:21:01.171665 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-55448279-259b-46a7-92b4-8ea24060dfa3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:21:01.172451 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-55448279-259b-46a7-92b4-8ea24060dfa3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:21:01.172940 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-55448279-259b-46a7-92b4-8ea24060dfa3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:21:01.316951 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-55448279-259b-46a7-92b4-8ea24060dfa3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:21:01.327387 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-55448279-259b-46a7-92b4-8ea24060dfa3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14" status: 200 len: 1368 microversion: 2.1 time: 0.173129 Dec 16 15:21:01.327998 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 955/1917] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:21:01 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14 => generated 1368 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:21:02.350891 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-3144a125-fed2-4317-bc4b-1588b00d962d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:21:02.351603 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-3144a125-fed2-4317-bc4b-1588b00d962d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:21:02.359458 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3144a125-fed2-4317-bc4b-1588b00d962d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:21:02.359968 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3144a125-fed2-4317-bc4b-1588b00d962d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:21:02.360804 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3144a125-fed2-4317-bc4b-1588b00d962d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:21:02.361296 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3144a125-fed2-4317-bc4b-1588b00d962d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:21:02.489551 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-3144a125-fed2-4317-bc4b-1588b00d962d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:21:02.498993 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-3144a125-fed2-4317-bc4b-1588b00d962d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14" status: 200 len: 1368 microversion: 2.1 time: 0.156616 Dec 16 15:21:02.499590 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 963/1918] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:21:02 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14 => generated 1368 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:21:03.520151 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-51b18532-cf60-4e31-bda2-88146535ad1e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:21:03.520823 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-51b18532-cf60-4e31-bda2-88146535ad1e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:21:03.528777 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-51b18532-cf60-4e31-bda2-88146535ad1e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:21:03.529293 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-51b18532-cf60-4e31-bda2-88146535ad1e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:21:03.530186 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-51b18532-cf60-4e31-bda2-88146535ad1e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:21:03.530683 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-51b18532-cf60-4e31-bda2-88146535ad1e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:21:03.655433 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-51b18532-cf60-4e31-bda2-88146535ad1e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:21:03.664803 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-51b18532-cf60-4e31-bda2-88146535ad1e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14" status: 200 len: 1368 microversion: 2.1 time: 0.152794 Dec 16 15:21:03.665395 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 956/1919] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:21:03 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14 => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:21:04.687137 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-871c6338-7771-4485-8929-2ce9922a1a8c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:21:04.687745 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-871c6338-7771-4485-8929-2ce9922a1a8c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:21:04.696522 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-871c6338-7771-4485-8929-2ce9922a1a8c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:21:04.697029 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-871c6338-7771-4485-8929-2ce9922a1a8c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:21:04.697864 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-871c6338-7771-4485-8929-2ce9922a1a8c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:21:04.698389 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-871c6338-7771-4485-8929-2ce9922a1a8c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:21:04.823492 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-871c6338-7771-4485-8929-2ce9922a1a8c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:21:04.833276 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-871c6338-7771-4485-8929-2ce9922a1a8c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14" status: 200 len: 1368 microversion: 2.1 time: 0.154010 Dec 16 15:21:04.833869 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 964/1920] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:21:04 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14 => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:21:05.856046 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-6c352ef0-eb13-492d-9b92-403e1071b3f7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:21:05.856723 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-6c352ef0-eb13-492d-9b92-403e1071b3f7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:21:05.864904 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6c352ef0-eb13-492d-9b92-403e1071b3f7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:21:05.865411 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6c352ef0-eb13-492d-9b92-403e1071b3f7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:21:05.866290 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6c352ef0-eb13-492d-9b92-403e1071b3f7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:21:05.866786 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6c352ef0-eb13-492d-9b92-403e1071b3f7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:21:05.995541 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-6c352ef0-eb13-492d-9b92-403e1071b3f7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:21:06.005289 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-6c352ef0-eb13-492d-9b92-403e1071b3f7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14" status: 200 len: 1368 microversion: 2.1 time: 0.157109 Dec 16 15:21:06.005882 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 957/1921] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:21:05 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14 => generated 1368 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:21:07.028046 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-a17141e7-53d8-438b-92ed-44db1429e090 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:21:07.028608 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-a17141e7-53d8-438b-92ed-44db1429e090 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:21:07.037037 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a17141e7-53d8-438b-92ed-44db1429e090 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:21:07.037535 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a17141e7-53d8-438b-92ed-44db1429e090 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:21:07.038390 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a17141e7-53d8-438b-92ed-44db1429e090 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:21:07.038872 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a17141e7-53d8-438b-92ed-44db1429e090 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:21:07.166352 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-a17141e7-53d8-438b-92ed-44db1429e090 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:21:07.175515 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-a17141e7-53d8-438b-92ed-44db1429e090 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14" status: 200 len: 1368 microversion: 2.1 time: 0.155407 Dec 16 15:21:07.176107 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 965/1922] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:21:07 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14 => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:21:08.198317 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-b499a2e9-7860-4f88-9824-cd2e38ac6c4a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:21:08.198986 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-b499a2e9-7860-4f88-9824-cd2e38ac6c4a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:21:08.208464 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b499a2e9-7860-4f88-9824-cd2e38ac6c4a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:21:08.208974 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b499a2e9-7860-4f88-9824-cd2e38ac6c4a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:21:08.209812 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b499a2e9-7860-4f88-9824-cd2e38ac6c4a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:21:08.210328 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b499a2e9-7860-4f88-9824-cd2e38ac6c4a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:21:08.338192 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-b499a2e9-7860-4f88-9824-cd2e38ac6c4a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:21:08.348253 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-b499a2e9-7860-4f88-9824-cd2e38ac6c4a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14" status: 200 len: 1368 microversion: 2.1 time: 0.157520 Dec 16 15:21:08.355357 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 958/1923] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:21:08 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14 => generated 1368 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:21:09.370117 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-e7d710d0-55f7-437c-b227-81472027f5bf tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:21:09.370804 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-e7d710d0-55f7-437c-b227-81472027f5bf tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:21:09.379172 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e7d710d0-55f7-437c-b227-81472027f5bf tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:21:09.379673 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e7d710d0-55f7-437c-b227-81472027f5bf tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:21:09.380498 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e7d710d0-55f7-437c-b227-81472027f5bf tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:21:09.380982 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e7d710d0-55f7-437c-b227-81472027f5bf tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:21:09.511960 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-e7d710d0-55f7-437c-b227-81472027f5bf tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:21:09.521152 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-e7d710d0-55f7-437c-b227-81472027f5bf tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14" status: 200 len: 1368 microversion: 2.1 time: 0.158735 Dec 16 15:21:09.521738 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 966/1924] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:21:09 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14 => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:21:10.543914 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-65e8ffe8-0801-4c09-928e-c12f759a1ee8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:21:10.545068 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-65e8ffe8-0801-4c09-928e-c12f759a1ee8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:21:10.553133 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-65e8ffe8-0801-4c09-928e-c12f759a1ee8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:21:10.553646 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-65e8ffe8-0801-4c09-928e-c12f759a1ee8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:21:10.554510 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-65e8ffe8-0801-4c09-928e-c12f759a1ee8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:21:10.555004 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-65e8ffe8-0801-4c09-928e-c12f759a1ee8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:21:10.683614 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-65e8ffe8-0801-4c09-928e-c12f759a1ee8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:21:10.697047 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-65e8ffe8-0801-4c09-928e-c12f759a1ee8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14" status: 200 len: 1368 microversion: 2.1 time: 0.161003 Dec 16 15:21:10.697665 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 959/1925] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:21:10 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14 => generated 1368 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:21:11.718259 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-daa9ca03-4cf1-4122-bf05-fe3a05b742fa tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:21:11.718929 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-daa9ca03-4cf1-4122-bf05-fe3a05b742fa tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:21:11.726820 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-daa9ca03-4cf1-4122-bf05-fe3a05b742fa tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:21:11.727384 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-daa9ca03-4cf1-4122-bf05-fe3a05b742fa tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:21:11.728221 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-daa9ca03-4cf1-4122-bf05-fe3a05b742fa tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:21:11.728706 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-daa9ca03-4cf1-4122-bf05-fe3a05b742fa tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:21:11.857125 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-daa9ca03-4cf1-4122-bf05-fe3a05b742fa tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:21:11.866636 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-daa9ca03-4cf1-4122-bf05-fe3a05b742fa tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14" status: 200 len: 1368 microversion: 2.1 time: 0.156172 Dec 16 15:21:11.867238 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 967/1926] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:21:11 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14 => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:21:12.889508 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-eaeb1203-0f34-4332-8074-91109959f0bc tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:21:12.890199 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-eaeb1203-0f34-4332-8074-91109959f0bc tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:21:12.898314 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-eaeb1203-0f34-4332-8074-91109959f0bc tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:21:12.898817 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-eaeb1203-0f34-4332-8074-91109959f0bc tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:21:12.899664 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-eaeb1203-0f34-4332-8074-91109959f0bc tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:21:12.900153 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-eaeb1203-0f34-4332-8074-91109959f0bc tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:21:13.062589 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-eaeb1203-0f34-4332-8074-91109959f0bc tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:21:13.072046 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-eaeb1203-0f34-4332-8074-91109959f0bc tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14" status: 200 len: 1368 microversion: 2.1 time: 0.190168 Dec 16 15:21:13.072648 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 960/1927] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:21:12 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14 => generated 1368 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:21:14.094243 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-1b11d69f-c623-4e36-a096-e5a63b22bbe4 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:21:14.095159 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-1b11d69f-c623-4e36-a096-e5a63b22bbe4 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:21:14.102791 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1b11d69f-c623-4e36-a096-e5a63b22bbe4 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:21:14.103423 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1b11d69f-c623-4e36-a096-e5a63b22bbe4 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:21:14.104130 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1b11d69f-c623-4e36-a096-e5a63b22bbe4 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:21:14.104629 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1b11d69f-c623-4e36-a096-e5a63b22bbe4 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:21:14.182192 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1b11d69f-c623-4e36-a096-e5a63b22bbe4 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:21:14.182704 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1b11d69f-c623-4e36-a096-e5a63b22bbe4 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:21:14.183249 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.objects.instance [None req-1b11d69f-c623-4e36-a096-e5a63b22bbe4 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lazy-loading 'fault' on Instance uuid 2989cd04-6526-4aca-8f1f-771371323c14 {{(pid=101356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 16 15:21:14.255061 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-1b11d69f-c623-4e36-a096-e5a63b22bbe4 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:21:14.265088 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-1b11d69f-c623-4e36-a096-e5a63b22bbe4 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14" status: 200 len: 1462 microversion: 2.1 time: 0.178930 Dec 16 15:21:14.265687 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 968/1928] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:21:14 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14 => generated 1462 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:21:15.287905 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-6b21221a-0436-4d6a-bbf8-301488c644fe tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:21:15.289201 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-6b21221a-0436-4d6a-bbf8-301488c644fe tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:21:15.298442 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6b21221a-0436-4d6a-bbf8-301488c644fe tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:21:15.298953 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6b21221a-0436-4d6a-bbf8-301488c644fe tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:21:15.299808 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6b21221a-0436-4d6a-bbf8-301488c644fe tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:21:15.300306 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6b21221a-0436-4d6a-bbf8-301488c644fe tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:21:15.354005 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.wsgi [None req-6b21221a-0436-4d6a-bbf8-301488c644fe tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] HTTP exception thrown: Instance 2989cd04-6526-4aca-8f1f-771371323c14 could not be found. Dec 16 15:21:15.354651 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-6b21221a-0436-4d6a-bbf8-301488c644fe tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Returning 404 to user: Instance 2989cd04-6526-4aca-8f1f-771371323c14 could not be found. {{(pid=101355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:941}} Dec 16 15:21:15.355557 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-6b21221a-0436-4d6a-bbf8-301488c644fe tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14" status: 404 len: 111 microversion: 2.1 time: 0.075599 Dec 16 15:21:15.356183 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 961/1929] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:21:15 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 15:21:15.368981 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-fbc286c7-59da-4753-9164-6a6a7488eb0a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '.version_select at 0x7f14f72c1620>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:21:15.431795 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-fbc286c7-59da-4753-9164-6a6a7488eb0a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-193235514" status: 202 len: 0 microversion: 2.1 time: 0.070029 Dec 16 15:21:15.432426 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 969/1930] 10.222.0.45 () {58 vars in 1208 bytes} [Thu Dec 16 15:21:15 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-193235514 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:21:17.278621 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-44a2300b-70bf-454c-b6b8-37641bf82e10 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'create', calling method: .version_select at 0x7f14f720b400>, body: {"keypair": {"name": "tempest-keypair-449774111"}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:21:17.307526 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.quota [None req-44a2300b-70bf-454c-b6b8-37641bf82e10 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Getting quotas for project fe152d649f134d28bec6b87e62973916. Resources: {'key_pairs'} {{(pid=101355) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 16 15:21:17.312435 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.quota [None req-44a2300b-70bf-454c-b6b8-37641bf82e10 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Getting quotas for user 8eb128a53e7f4e1187d0f6e2f4c4978f and project fe152d649f134d28bec6b87e62973916. Resources: {'key_pairs'} {{(pid=101355) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 16 15:21:17.576420 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.quota [None req-44a2300b-70bf-454c-b6b8-37641bf82e10 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Getting quotas for project fe152d649f134d28bec6b87e62973916. Resources: {'key_pairs'} {{(pid=101355) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 16 15:21:17.580454 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.quota [None req-44a2300b-70bf-454c-b6b8-37641bf82e10 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Getting quotas for user 8eb128a53e7f4e1187d0f6e2f4c4978f and project fe152d649f134d28bec6b87e62973916. Resources: {'key_pairs'} {{(pid=101355) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 16 15:21:17.594924 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-44a2300b-70bf-454c-b6b8-37641bf82e10 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.323857 Dec 16 15:21:17.595555 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 962/1931] 10.222.0.45 () {60 vars in 1148 bytes} [Thu Dec 16 15:21:17 2021] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:21:20.097769 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-b305c550-8012-407c-9721-1baa48dc7c57 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-435020503", "imageRef": "9b00ff4e-db72-4324-820b-87a6bd73b055", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "22640b1c-4c47-4c71-9861-b248ec975b5d"}], "security_groups": [{"name": "tempest-securitygroup--478292852"}], "key_name": "tempest-keypair-449774111", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:21:20.222237 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.network.neutron [None req-b305c550-8012-407c-9721-1baa48dc7c57 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] validate_networks() for [('22640b1c-4c47-4c71-9861-b248ec975b5d', None, None, None)] {{(pid=101356) validate_networks /opt/stack/nova/nova/network/neutron.py:2383}} Dec 16 15:21:20.933606 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.virt.hardware [None req-b305c550-8012-407c-9721-1baa48dc7c57 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Flavor limits 0:0:0 {{(pid=101356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:338}} Dec 16 15:21:20.934106 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.virt.hardware [None req-b305c550-8012-407c-9721-1baa48dc7c57 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Image limits 0:0:0 {{(pid=101356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:342}} Dec 16 15:21:20.934654 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.virt.hardware [None req-b305c550-8012-407c-9721-1baa48dc7c57 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Flavor pref 0:0:0 {{(pid=101356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:378}} Dec 16 15:21:20.935089 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.virt.hardware [None req-b305c550-8012-407c-9721-1baa48dc7c57 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Image pref 0:0:0 {{(pid=101356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:382}} Dec 16 15:21:20.936149 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.virt.hardware [None req-b305c550-8012-407c-9721-1baa48dc7c57 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=101356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:422}} Dec 16 15:21:20.945121 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b305c550-8012-407c-9721-1baa48dc7c57 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:21:20.945638 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b305c550-8012-407c-9721-1baa48dc7c57 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:21:20.946562 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b305c550-8012-407c-9721-1baa48dc7c57 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:21:20.947103 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b305c550-8012-407c-9721-1baa48dc7c57 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:21:20.966305 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.quota [None req-b305c550-8012-407c-9721-1baa48dc7c57 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Getting quotas for project fe152d649f134d28bec6b87e62973916. Resources: {'ram', 'instances', 'cores'} {{(pid=101356) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 16 15:21:20.970783 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.quota [None req-b305c550-8012-407c-9721-1baa48dc7c57 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Getting quotas for user 8eb128a53e7f4e1187d0f6e2f4c4978f and project fe152d649f134d28bec6b87e62973916. Resources: {'ram', 'instances', 'cores'} {{(pid=101356) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 16 15:21:20.982286 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-b305c550-8012-407c-9721-1baa48dc7c57 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Going to run 1 instances... {{(pid=101356) _provision_instances /opt/stack/nova/nova/compute/api.py:1224}} Dec 16 15:21:20.985074 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-b305c550-8012-407c-9721-1baa48dc7c57 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 4feaa08e-6919-4701-ab0e-481fe18c9abd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9b00ff4e-db72-4324-820b-87a6bd73b055',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101356) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1616}} Dec 16 15:21:21.075307 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-b305c550-8012-407c-9721-1baa48dc7c57 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.985553 Dec 16 15:21:21.075954 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 970/1932] 10.222.0.45 () {60 vars in 1137 bytes} [Thu Dec 16 15:21:20 2021] POST /compute/v2.1/servers => generated 401 bytes in 987 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 16 15:21:21.091653 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-9986f8c9-9183-405f-84d6-f4d1dbf57fe7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:21:21.093365 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-9986f8c9-9183-405f-84d6-f4d1dbf57fe7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 4feaa08e-6919-4701-ab0e-481fe18c9abd] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:21:21.236195 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-9986f8c9-9183-405f-84d6-f4d1dbf57fe7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:21:21.245150 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-9986f8c9-9183-405f-84d6-f4d1dbf57fe7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd" status: 200 len: 1236 microversion: 2.1 time: 0.162093 Dec 16 15:21:21.245853 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 963/1933] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:21:21 2021] GET /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd => generated 1236 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:21:22.269422 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-61796661-c79d-4e66-b8a4-ca4ae6f4235f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:21:22.270411 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-61796661-c79d-4e66-b8a4-ca4ae6f4235f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 4feaa08e-6919-4701-ab0e-481fe18c9abd] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:21:22.281428 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-61796661-c79d-4e66-b8a4-ca4ae6f4235f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:21:22.281984 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-61796661-c79d-4e66-b8a4-ca4ae6f4235f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:21:22.283134 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-61796661-c79d-4e66-b8a4-ca4ae6f4235f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:21:22.283753 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-61796661-c79d-4e66-b8a4-ca4ae6f4235f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:21:22.434558 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-61796661-c79d-4e66-b8a4-ca4ae6f4235f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:21:22.444693 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-61796661-c79d-4e66-b8a4-ca4ae6f4235f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd" status: 200 len: 1288 microversion: 2.1 time: 0.184605 Dec 16 15:21:22.445323 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 971/1934] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:21:22 2021] GET /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd => generated 1288 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:21:23.467537 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-e4ca769e-02f1-42c3-b26b-ef08f3f1328a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:21:23.468208 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-e4ca769e-02f1-42c3-b26b-ef08f3f1328a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 4feaa08e-6919-4701-ab0e-481fe18c9abd] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:21:23.481277 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e4ca769e-02f1-42c3-b26b-ef08f3f1328a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:21:23.482103 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e4ca769e-02f1-42c3-b26b-ef08f3f1328a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:21:23.482708 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e4ca769e-02f1-42c3-b26b-ef08f3f1328a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:21:23.483209 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e4ca769e-02f1-42c3-b26b-ef08f3f1328a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:21:23.665891 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-e4ca769e-02f1-42c3-b26b-ef08f3f1328a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:21:23.676431 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-e4ca769e-02f1-42c3-b26b-ef08f3f1328a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd" status: 200 len: 1294 microversion: 2.1 time: 0.217299 Dec 16 15:21:23.677050 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 964/1935] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:21:23 2021] GET /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd => generated 1294 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:21:24.699546 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-d9029008-ef0c-4897-846e-848592f90585 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:21:24.700223 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-d9029008-ef0c-4897-846e-848592f90585 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 4feaa08e-6919-4701-ab0e-481fe18c9abd] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:21:24.708783 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d9029008-ef0c-4897-846e-848592f90585 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:21:24.709292 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d9029008-ef0c-4897-846e-848592f90585 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:21:24.710197 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d9029008-ef0c-4897-846e-848592f90585 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:21:24.710694 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d9029008-ef0c-4897-846e-848592f90585 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:21:24.940333 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-d9029008-ef0c-4897-846e-848592f90585 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:21:24.949043 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-d9029008-ef0c-4897-846e-848592f90585 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd" status: 200 len: 1361 microversion: 2.1 time: 0.257380 Dec 16 15:21:24.949641 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 972/1936] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:21:24 2021] GET /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd => generated 1361 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:21:25.727968 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [req-3ad84ab0-3f02-436a-b485-86df7e817b9a req-14cbc223-f9b7-4bcd-a181-5c6b15a81e81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4feaa08e-6919-4701-ab0e-481fe18c9abd", "tag": "84f4680a-3a41-4a40-9524-1dc9ba8f12ec"}]} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:21:25.738217 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:21:25.738217 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: warnings.warn(msg) Dec 16 15:21:25.742629 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-3ad84ab0-3f02-436a-b485-86df7e817b9a req-14cbc223-f9b7-4bcd-a181-5c6b15a81e81 service nova] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:21:25.743377 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-3ad84ab0-3f02-436a-b485-86df7e817b9a req-14cbc223-f9b7-4bcd-a181-5c6b15a81e81 service nova] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:21:25.762018 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.compute.server_external_events [req-3ad84ab0-3f02-436a-b485-86df7e817b9a req-14cbc223-f9b7-4bcd-a181-5c6b15a81e81 service nova] Creating event network-changed:84f4680a-3a41-4a40-9524-1dc9ba8f12ec for instance 4feaa08e-6919-4701-ab0e-481fe18c9abd on hv-cinder-82189 Dec 16 15:21:25.768509 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [req-3ad84ab0-3f02-436a-b485-86df7e817b9a req-14cbc223-f9b7-4bcd-a181-5c6b15a81e81 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054938 Dec 16 15:21:25.769400 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 965/1937] 10.222.0.45 () {64 vars in 1308 bytes} [Thu Dec 16 15:21:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:21:25.972185 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-87cf9864-4a14-4d7c-a42e-3fcb8d228b37 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:21:25.972865 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-87cf9864-4a14-4d7c-a42e-3fcb8d228b37 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 4feaa08e-6919-4701-ab0e-481fe18c9abd] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:21:25.980827 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-87cf9864-4a14-4d7c-a42e-3fcb8d228b37 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:21:25.981329 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-87cf9864-4a14-4d7c-a42e-3fcb8d228b37 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:21:25.982254 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-87cf9864-4a14-4d7c-a42e-3fcb8d228b37 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:21:25.983428 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-87cf9864-4a14-4d7c-a42e-3fcb8d228b37 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:21:26.208022 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-87cf9864-4a14-4d7c-a42e-3fcb8d228b37 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:21:26.218097 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-87cf9864-4a14-4d7c-a42e-3fcb8d228b37 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd" status: 200 len: 1361 microversion: 2.1 time: 0.254419 Dec 16 15:21:26.218919 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 973/1938] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:21:25 2021] GET /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd => generated 1361 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:21:27.241812 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-5115bd36-ef11-492c-8a6f-6707565ec22b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:21:27.242584 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-5115bd36-ef11-492c-8a6f-6707565ec22b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 4feaa08e-6919-4701-ab0e-481fe18c9abd] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:21:27.250920 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5115bd36-ef11-492c-8a6f-6707565ec22b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:21:27.251435 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5115bd36-ef11-492c-8a6f-6707565ec22b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:21:27.252466 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5115bd36-ef11-492c-8a6f-6707565ec22b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:21:27.252961 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5115bd36-ef11-492c-8a6f-6707565ec22b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:21:27.538690 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-5115bd36-ef11-492c-8a6f-6707565ec22b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:21:27.548886 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-5115bd36-ef11-492c-8a6f-6707565ec22b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd" status: 200 len: 1361 microversion: 2.1 time: 0.315453 Dec 16 15:21:27.549500 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 966/1939] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:21:27 2021] GET /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd => generated 1361 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:21:28.571411 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-85fc185e-0e5c-4804-82f3-97b01ab75526 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:21:28.572487 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-85fc185e-0e5c-4804-82f3-97b01ab75526 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 4feaa08e-6919-4701-ab0e-481fe18c9abd] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:21:28.580868 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-85fc185e-0e5c-4804-82f3-97b01ab75526 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:21:28.581386 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-85fc185e-0e5c-4804-82f3-97b01ab75526 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:21:28.582321 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-85fc185e-0e5c-4804-82f3-97b01ab75526 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:21:28.582826 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-85fc185e-0e5c-4804-82f3-97b01ab75526 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:21:28.803982 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-85fc185e-0e5c-4804-82f3-97b01ab75526 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:21:28.814669 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-85fc185e-0e5c-4804-82f3-97b01ab75526 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd" status: 200 len: 1361 microversion: 2.1 time: 0.250783 Dec 16 15:21:28.826465 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 974/1940] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:21:28 2021] GET /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd => generated 1361 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:21:29.845597 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-d3340a6a-1f29-4f98-8db4-ed24fbeb6183 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:21:29.846424 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-d3340a6a-1f29-4f98-8db4-ed24fbeb6183 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 4feaa08e-6919-4701-ab0e-481fe18c9abd] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:21:29.854321 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d3340a6a-1f29-4f98-8db4-ed24fbeb6183 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:21:29.854823 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d3340a6a-1f29-4f98-8db4-ed24fbeb6183 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:21:29.855652 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d3340a6a-1f29-4f98-8db4-ed24fbeb6183 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:21:29.856138 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d3340a6a-1f29-4f98-8db4-ed24fbeb6183 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:21:30.072417 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-d3340a6a-1f29-4f98-8db4-ed24fbeb6183 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:21:30.081215 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-d3340a6a-1f29-4f98-8db4-ed24fbeb6183 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd" status: 200 len: 1361 microversion: 2.1 time: 0.243384 Dec 16 15:21:30.081812 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 967/1941] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:21:29 2021] GET /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd => generated 1361 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:21:31.102437 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-4e7a913d-5cc2-481f-88a1-f2f46fdf7546 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:21:31.103111 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-4e7a913d-5cc2-481f-88a1-f2f46fdf7546 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 4feaa08e-6919-4701-ab0e-481fe18c9abd] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:21:31.111794 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4e7a913d-5cc2-481f-88a1-f2f46fdf7546 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:21:31.112301 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4e7a913d-5cc2-481f-88a1-f2f46fdf7546 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:21:31.113150 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4e7a913d-5cc2-481f-88a1-f2f46fdf7546 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:21:31.113661 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4e7a913d-5cc2-481f-88a1-f2f46fdf7546 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:21:31.364987 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-4e7a913d-5cc2-481f-88a1-f2f46fdf7546 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:21:31.375912 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-4e7a913d-5cc2-481f-88a1-f2f46fdf7546 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd" status: 200 len: 1361 microversion: 2.1 time: 0.281321 Dec 16 15:21:31.376529 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 975/1942] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:21:31 2021] GET /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd => generated 1361 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:21:32.398980 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-cb62da27-c3b4-471f-ae56-87a947ee74bd tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:21:32.399675 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-cb62da27-c3b4-471f-ae56-87a947ee74bd tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 4feaa08e-6919-4701-ab0e-481fe18c9abd] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:21:32.409361 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cb62da27-c3b4-471f-ae56-87a947ee74bd tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:21:32.409942 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cb62da27-c3b4-471f-ae56-87a947ee74bd tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:21:32.411455 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cb62da27-c3b4-471f-ae56-87a947ee74bd tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:21:32.412037 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cb62da27-c3b4-471f-ae56-87a947ee74bd tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:21:32.635636 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-cb62da27-c3b4-471f-ae56-87a947ee74bd tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:21:32.645542 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-cb62da27-c3b4-471f-ae56-87a947ee74bd tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd" status: 200 len: 1361 microversion: 2.1 time: 0.254134 Dec 16 15:21:32.646190 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 968/1943] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:21:32 2021] GET /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd => generated 1361 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:21:32.811335 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [req-2c139ca1-067a-4d18-a0fc-17fcbead8174 req-05fc308a-e29b-42f2-a6f9-baafc30bcbab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4feaa08e-6919-4701-ab0e-481fe18c9abd", "name": "network-vif-plugged", "status": "completed", "tag": "84f4680a-3a41-4a40-9524-1dc9ba8f12ec"}]} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:21:32.816164 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:21:32.816164 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: warnings.warn(msg) Dec 16 15:21:32.825288 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-2c139ca1-067a-4d18-a0fc-17fcbead8174 req-05fc308a-e29b-42f2-a6f9-baafc30bcbab service nova] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:21:32.825886 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-2c139ca1-067a-4d18-a0fc-17fcbead8174 req-05fc308a-e29b-42f2-a6f9-baafc30bcbab service nova] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:21:32.843588 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.compute.server_external_events [req-2c139ca1-067a-4d18-a0fc-17fcbead8174 req-05fc308a-e29b-42f2-a6f9-baafc30bcbab service nova] Creating event network-vif-plugged:84f4680a-3a41-4a40-9524-1dc9ba8f12ec for instance 4feaa08e-6919-4701-ab0e-481fe18c9abd on hv-cinder-82189 Dec 16 15:21:32.848908 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [req-2c139ca1-067a-4d18-a0fc-17fcbead8174 req-05fc308a-e29b-42f2-a6f9-baafc30bcbab service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.180699 Dec 16 15:21:32.849641 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 976/1944] 10.222.0.45 () {64 vars in 1308 bytes} [Thu Dec 16 15:21:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:21:33.668139 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-91976f40-c304-4bce-bde2-860ef81aba5c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:21:33.668811 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-91976f40-c304-4bce-bde2-860ef81aba5c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 4feaa08e-6919-4701-ab0e-481fe18c9abd] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:21:33.676998 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-91976f40-c304-4bce-bde2-860ef81aba5c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:21:33.677780 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-91976f40-c304-4bce-bde2-860ef81aba5c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:21:33.678674 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-91976f40-c304-4bce-bde2-860ef81aba5c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:21:33.679167 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-91976f40-c304-4bce-bde2-860ef81aba5c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:21:33.912329 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-91976f40-c304-4bce-bde2-860ef81aba5c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:21:33.921937 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-91976f40-c304-4bce-bde2-860ef81aba5c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd" status: 200 len: 1361 microversion: 2.1 time: 0.261298 Dec 16 15:21:33.922507 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 969/1945] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:21:33 2021] GET /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd => generated 1361 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:21:34.944711 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-4c977921-da78-4a79-8f63-276881c7f809 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:21:34.945525 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-4c977921-da78-4a79-8f63-276881c7f809 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 4feaa08e-6919-4701-ab0e-481fe18c9abd] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:21:34.954075 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4c977921-da78-4a79-8f63-276881c7f809 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:21:34.954607 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4c977921-da78-4a79-8f63-276881c7f809 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:21:34.955466 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4c977921-da78-4a79-8f63-276881c7f809 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:21:34.955961 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4c977921-da78-4a79-8f63-276881c7f809 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:21:35.194336 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-4c977921-da78-4a79-8f63-276881c7f809 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:21:35.204449 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-4c977921-da78-4a79-8f63-276881c7f809 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd" status: 200 len: 1546 microversion: 2.1 time: 0.268040 Dec 16 15:21:35.205132 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 977/1946] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:21:34 2021] GET /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd => generated 1546 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:21:35.225603 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-3b13298e-44a5-49d7-b291-caad0a643e64 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:21:35.226194 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-3b13298e-44a5-49d7-b291-caad0a643e64 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 4feaa08e-6919-4701-ab0e-481fe18c9abd] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:21:35.234362 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3b13298e-44a5-49d7-b291-caad0a643e64 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:21:35.234876 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3b13298e-44a5-49d7-b291-caad0a643e64 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:21:35.235731 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3b13298e-44a5-49d7-b291-caad0a643e64 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:21:35.236228 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3b13298e-44a5-49d7-b291-caad0a643e64 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:21:35.400883 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-3b13298e-44a5-49d7-b291-caad0a643e64 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.182946 Dec 16 15:21:35.401532 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 970/1947] 10.222.0.45 () {58 vars in 1265 bytes} [Thu Dec 16 15:21:35 2021] GET /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/os-interface => generated 284 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:21:37.354634 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-44a03660-62bb-4e17-a63d-d855ff5668b4 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:21:37.355189 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [req-9fbfa282-9475-473a-8bd7-7c3e4b1ce13c req-231b4da5-cc32-42b0-a126-a087b3ac8ae6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4feaa08e-6919-4701-ab0e-481fe18c9abd", "tag": "84f4680a-3a41-4a40-9524-1dc9ba8f12ec"}]} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:21:37.360864 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:21:37.360864 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: warnings.warn(msg) Dec 16 15:21:37.365249 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-44a03660-62bb-4e17-a63d-d855ff5668b4 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 4feaa08e-6919-4701-ab0e-481fe18c9abd] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:21:37.374930 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-44a03660-62bb-4e17-a63d-d855ff5668b4 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:21:37.375439 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-44a03660-62bb-4e17-a63d-d855ff5668b4 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:21:37.376295 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-44a03660-62bb-4e17-a63d-d855ff5668b4 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:21:37.376795 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-44a03660-62bb-4e17-a63d-d855ff5668b4 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:21:37.390539 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-9fbfa282-9475-473a-8bd7-7c3e4b1ce13c req-231b4da5-cc32-42b0-a126-a087b3ac8ae6 service nova] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:21:37.391463 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-9fbfa282-9475-473a-8bd7-7c3e4b1ce13c req-231b4da5-cc32-42b0-a126-a087b3ac8ae6 service nova] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:21:37.412833 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.compute.server_external_events [req-9fbfa282-9475-473a-8bd7-7c3e4b1ce13c req-231b4da5-cc32-42b0-a126-a087b3ac8ae6 service nova] Creating event network-changed:84f4680a-3a41-4a40-9524-1dc9ba8f12ec for instance 4feaa08e-6919-4701-ab0e-481fe18c9abd on hv-cinder-82189 Dec 16 15:21:37.417290 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [req-9fbfa282-9475-473a-8bd7-7c3e4b1ce13c req-231b4da5-cc32-42b0-a126-a087b3ac8ae6 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078590 Dec 16 15:21:37.418171 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 971/1948] 10.222.0.45 () {64 vars in 1308 bytes} [Thu Dec 16 15:21:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:21:37.519071 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-44a03660-62bb-4e17-a63d-d855ff5668b4 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action" status: 200 len: 14 microversion: 2.1 time: 0.182520 Dec 16 15:21:37.524497 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 978/1949] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 15:21:37 2021] POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action => generated 14 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 16 15:21:38.536739 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-d13e0fe7-bc2f-4ae3-a70b-a1d630b6026d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:21:38.539332 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-d13e0fe7-bc2f-4ae3-a70b-a1d630b6026d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 4feaa08e-6919-4701-ab0e-481fe18c9abd] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:21:38.548714 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d13e0fe7-bc2f-4ae3-a70b-a1d630b6026d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:21:38.549335 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d13e0fe7-bc2f-4ae3-a70b-a1d630b6026d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:21:38.550293 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d13e0fe7-bc2f-4ae3-a70b-a1d630b6026d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:21:38.550865 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d13e0fe7-bc2f-4ae3-a70b-a1d630b6026d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:21:38.679186 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-d13e0fe7-bc2f-4ae3-a70b-a1d630b6026d tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action" status: 200 len: 14 microversion: 2.1 time: 0.150446 Dec 16 15:21:38.683519 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 972/1950] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 15:21:38 2021] POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action => generated 14 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 15:21:39.697748 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-3e2e4b9d-8b87-4d72-83a0-4c37ce90cb52 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:21:39.698892 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-3e2e4b9d-8b87-4d72-83a0-4c37ce90cb52 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 4feaa08e-6919-4701-ab0e-481fe18c9abd] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:21:39.708295 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3e2e4b9d-8b87-4d72-83a0-4c37ce90cb52 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:21:39.708803 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3e2e4b9d-8b87-4d72-83a0-4c37ce90cb52 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:21:39.709662 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3e2e4b9d-8b87-4d72-83a0-4c37ce90cb52 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:21:39.710187 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3e2e4b9d-8b87-4d72-83a0-4c37ce90cb52 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:21:39.830889 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-3e2e4b9d-8b87-4d72-83a0-4c37ce90cb52 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action" status: 200 len: 14 microversion: 2.1 time: 0.141400 Dec 16 15:21:39.831619 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 979/1951] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 15:21:39 2021] POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action => generated 14 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 15:21:40.846948 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-a0ecfc42-049f-4ef5-ad06-9356f6714b27 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:21:40.848075 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-a0ecfc42-049f-4ef5-ad06-9356f6714b27 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 4feaa08e-6919-4701-ab0e-481fe18c9abd] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:21:40.856594 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a0ecfc42-049f-4ef5-ad06-9356f6714b27 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:21:40.857618 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a0ecfc42-049f-4ef5-ad06-9356f6714b27 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:21:40.858473 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a0ecfc42-049f-4ef5-ad06-9356f6714b27 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:21:40.858964 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a0ecfc42-049f-4ef5-ad06-9356f6714b27 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:21:40.980307 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-a0ecfc42-049f-4ef5-ad06-9356f6714b27 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action" status: 200 len: 14 microversion: 2.1 time: 0.141064 Dec 16 15:21:40.981402 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 973/1952] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 15:21:40 2021] POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action => generated 14 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 15:21:41.997883 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-40e1093a-dc0e-4047-8647-dc161b96c769 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:21:41.999155 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-40e1093a-dc0e-4047-8647-dc161b96c769 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 4feaa08e-6919-4701-ab0e-481fe18c9abd] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:21:42.010086 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-40e1093a-dc0e-4047-8647-dc161b96c769 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:21:42.010606 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-40e1093a-dc0e-4047-8647-dc161b96c769 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:21:42.011450 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-40e1093a-dc0e-4047-8647-dc161b96c769 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:21:42.011942 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-40e1093a-dc0e-4047-8647-dc161b96c769 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:21:42.136402 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-40e1093a-dc0e-4047-8647-dc161b96c769 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action" status: 200 len: 14 microversion: 2.1 time: 0.147069 Dec 16 15:21:42.137088 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 980/1953] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 15:21:41 2021] POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action => generated 14 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 15:21:43.152902 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-72df2c63-5f90-49bf-b177-64e96033afb1 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:21:43.154635 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-72df2c63-5f90-49bf-b177-64e96033afb1 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 4feaa08e-6919-4701-ab0e-481fe18c9abd] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:21:43.163454 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-72df2c63-5f90-49bf-b177-64e96033afb1 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:21:43.163969 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-72df2c63-5f90-49bf-b177-64e96033afb1 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:21:43.164870 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-72df2c63-5f90-49bf-b177-64e96033afb1 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:21:43.165370 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-72df2c63-5f90-49bf-b177-64e96033afb1 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:21:43.288210 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-72df2c63-5f90-49bf-b177-64e96033afb1 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action" status: 200 len: 14 microversion: 2.1 time: 0.143391 Dec 16 15:21:43.288837 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 974/1954] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 15:21:43 2021] POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action => generated 14 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 15:21:44.304010 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-936fcea1-6908-4500-b528-caab70897376 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:21:44.305209 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-936fcea1-6908-4500-b528-caab70897376 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 4feaa08e-6919-4701-ab0e-481fe18c9abd] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:21:44.314416 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-936fcea1-6908-4500-b528-caab70897376 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:21:44.314922 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-936fcea1-6908-4500-b528-caab70897376 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:21:44.315791 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-936fcea1-6908-4500-b528-caab70897376 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:21:44.316271 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-936fcea1-6908-4500-b528-caab70897376 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:21:44.440452 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-936fcea1-6908-4500-b528-caab70897376 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action" status: 200 len: 14 microversion: 2.1 time: 0.144423 Dec 16 15:21:44.441335 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 981/1955] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 15:21:44 2021] POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action => generated 14 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 15:21:45.456166 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-4654b4d1-4f70-4268-9649-a6087ba12d78 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:21:45.457300 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-4654b4d1-4f70-4268-9649-a6087ba12d78 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 4feaa08e-6919-4701-ab0e-481fe18c9abd] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:21:45.466404 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4654b4d1-4f70-4268-9649-a6087ba12d78 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:21:45.466952 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4654b4d1-4f70-4268-9649-a6087ba12d78 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:21:45.467793 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4654b4d1-4f70-4268-9649-a6087ba12d78 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:21:45.468286 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4654b4d1-4f70-4268-9649-a6087ba12d78 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:21:45.603100 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-4654b4d1-4f70-4268-9649-a6087ba12d78 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action" status: 200 len: 14 microversion: 2.1 time: 0.155026 Dec 16 15:21:45.603992 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 975/1956] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 15:21:45 2021] POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action => generated 14 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 15:21:46.619411 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-7e46c93d-cfa1-476a-8765-bd119a9e6df3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:21:46.620563 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-7e46c93d-cfa1-476a-8765-bd119a9e6df3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 4feaa08e-6919-4701-ab0e-481fe18c9abd] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:21:46.629126 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7e46c93d-cfa1-476a-8765-bd119a9e6df3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:21:46.629626 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7e46c93d-cfa1-476a-8765-bd119a9e6df3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:21:46.630485 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7e46c93d-cfa1-476a-8765-bd119a9e6df3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:21:46.630973 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7e46c93d-cfa1-476a-8765-bd119a9e6df3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:21:46.772177 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-7e46c93d-cfa1-476a-8765-bd119a9e6df3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action" status: 200 len: 14 microversion: 2.1 time: 0.160763 Dec 16 15:21:46.772983 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 982/1957] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 15:21:46 2021] POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action => generated 14 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 15:21:47.787692 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-e63fc41b-c0b2-4c68-9cd5-b705578008a3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:21:47.788826 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-e63fc41b-c0b2-4c68-9cd5-b705578008a3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 4feaa08e-6919-4701-ab0e-481fe18c9abd] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:21:47.797552 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e63fc41b-c0b2-4c68-9cd5-b705578008a3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:21:47.798083 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e63fc41b-c0b2-4c68-9cd5-b705578008a3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:21:47.798944 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e63fc41b-c0b2-4c68-9cd5-b705578008a3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:21:47.799438 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e63fc41b-c0b2-4c68-9cd5-b705578008a3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:21:47.939477 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-e63fc41b-c0b2-4c68-9cd5-b705578008a3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action" status: 200 len: 12971 microversion: 2.1 time: 0.159774 Dec 16 15:21:47.940117 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 976/1958] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 15:21:47 2021] POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action => generated 12971 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:21:48.956253 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-74b08b9a-9e40-4fa4-b9f9-991759c20de3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:21:48.957539 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-74b08b9a-9e40-4fa4-b9f9-991759c20de3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 4feaa08e-6919-4701-ab0e-481fe18c9abd] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:21:48.966376 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-74b08b9a-9e40-4fa4-b9f9-991759c20de3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:21:48.966897 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-74b08b9a-9e40-4fa4-b9f9-991759c20de3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:21:48.967744 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-74b08b9a-9e40-4fa4-b9f9-991759c20de3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:21:48.968240 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-74b08b9a-9e40-4fa4-b9f9-991759c20de3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:21:49.117743 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-74b08b9a-9e40-4fa4-b9f9-991759c20de3 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action" status: 200 len: 18449 microversion: 2.1 time: 0.169120 Dec 16 15:21:49.119066 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 983/1959] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 15:21:48 2021] POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action => generated 18449 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:21:50.135893 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-b886b19b-6edb-42c0-b416-7cbe9215fd3e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:21:50.137031 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-b886b19b-6edb-42c0-b416-7cbe9215fd3e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 4feaa08e-6919-4701-ab0e-481fe18c9abd] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:21:50.146206 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b886b19b-6edb-42c0-b416-7cbe9215fd3e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:21:50.146730 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b886b19b-6edb-42c0-b416-7cbe9215fd3e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:21:50.147547 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b886b19b-6edb-42c0-b416-7cbe9215fd3e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:21:50.148035 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b886b19b-6edb-42c0-b416-7cbe9215fd3e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:21:50.283032 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-b886b19b-6edb-42c0-b416-7cbe9215fd3e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action" status: 200 len: 19342 microversion: 2.1 time: 0.154995 Dec 16 15:21:50.283673 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 977/1960] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 15:21:50 2021] POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action => generated 19342 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:21:51.302698 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-1ee8c687-b9e0-4fc9-8ae8-2e135b7fe9ad tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:21:51.304663 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-1ee8c687-b9e0-4fc9-8ae8-2e135b7fe9ad tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 4feaa08e-6919-4701-ab0e-481fe18c9abd] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:21:51.319411 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1ee8c687-b9e0-4fc9-8ae8-2e135b7fe9ad tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:21:51.320328 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1ee8c687-b9e0-4fc9-8ae8-2e135b7fe9ad tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:21:51.321801 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1ee8c687-b9e0-4fc9-8ae8-2e135b7fe9ad tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:21:51.322719 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1ee8c687-b9e0-4fc9-8ae8-2e135b7fe9ad tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:21:51.468823 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-1ee8c687-b9e0-4fc9-8ae8-2e135b7fe9ad tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action" status: 200 len: 22217 microversion: 2.1 time: 0.176218 Dec 16 15:21:51.470106 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 984/1961] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 15:21:51 2021] POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action => generated 22217 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:21:52.485713 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-9c90d620-45df-4338-a292-89fa8e762d88 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:21:52.486909 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-9c90d620-45df-4338-a292-89fa8e762d88 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 4feaa08e-6919-4701-ab0e-481fe18c9abd] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:21:52.495896 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9c90d620-45df-4338-a292-89fa8e762d88 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:21:52.496419 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9c90d620-45df-4338-a292-89fa8e762d88 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:21:52.497880 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9c90d620-45df-4338-a292-89fa8e762d88 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:21:52.498422 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9c90d620-45df-4338-a292-89fa8e762d88 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:21:52.638094 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-9c90d620-45df-4338-a292-89fa8e762d88 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action" status: 200 len: 23804 microversion: 2.1 time: 0.159900 Dec 16 15:21:52.638800 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 978/1962] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 15:21:52 2021] POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action => generated 23804 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:21:53.655471 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-26cd7f12-33cd-44a9-a456-79f730b602c1 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:21:53.656555 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-26cd7f12-33cd-44a9-a456-79f730b602c1 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 4feaa08e-6919-4701-ab0e-481fe18c9abd] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:21:53.665694 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-26cd7f12-33cd-44a9-a456-79f730b602c1 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:21:53.666242 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-26cd7f12-33cd-44a9-a456-79f730b602c1 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:21:53.667221 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-26cd7f12-33cd-44a9-a456-79f730b602c1 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:21:53.667721 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-26cd7f12-33cd-44a9-a456-79f730b602c1 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:21:53.830287 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-26cd7f12-33cd-44a9-a456-79f730b602c1 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action" status: 200 len: 25413 microversion: 2.1 time: 0.183499 Dec 16 15:21:53.836765 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 985/1963] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 15:21:53 2021] POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action => generated 25413 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:21:54.850162 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-2d3efb49-77c8-4900-8f40-0463a6d83db8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:21:54.851339 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-2d3efb49-77c8-4900-8f40-0463a6d83db8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 4feaa08e-6919-4701-ab0e-481fe18c9abd] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:21:54.860182 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2d3efb49-77c8-4900-8f40-0463a6d83db8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:21:54.860700 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2d3efb49-77c8-4900-8f40-0463a6d83db8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:21:54.861560 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2d3efb49-77c8-4900-8f40-0463a6d83db8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:21:54.862077 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2d3efb49-77c8-4900-8f40-0463a6d83db8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:21:55.026656 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-2d3efb49-77c8-4900-8f40-0463a6d83db8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action" status: 200 len: 26877 microversion: 2.1 time: 0.184376 Dec 16 15:21:55.027394 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 979/1964] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 15:21:54 2021] POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action => generated 26877 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:21:56.045031 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-c452d6fe-48a4-4928-a22e-4f20ff899283 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:21:56.046243 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-c452d6fe-48a4-4928-a22e-4f20ff899283 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 4feaa08e-6919-4701-ab0e-481fe18c9abd] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:21:56.055581 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c452d6fe-48a4-4928-a22e-4f20ff899283 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:21:56.056098 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c452d6fe-48a4-4928-a22e-4f20ff899283 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:21:56.056959 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c452d6fe-48a4-4928-a22e-4f20ff899283 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:21:56.057456 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c452d6fe-48a4-4928-a22e-4f20ff899283 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:21:56.201763 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-c452d6fe-48a4-4928-a22e-4f20ff899283 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action" status: 200 len: 27653 microversion: 2.1 time: 0.165356 Dec 16 15:21:56.206223 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 986/1965] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 15:21:56 2021] POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action => generated 27653 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:21:57.219324 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-9bdc1d4c-de01-4bcd-bd37-55a061a2c45a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:21:57.220671 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-9bdc1d4c-de01-4bcd-bd37-55a061a2c45a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 4feaa08e-6919-4701-ab0e-481fe18c9abd] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:21:57.229294 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9bdc1d4c-de01-4bcd-bd37-55a061a2c45a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:21:57.229796 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9bdc1d4c-de01-4bcd-bd37-55a061a2c45a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:21:57.230670 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9bdc1d4c-de01-4bcd-bd37-55a061a2c45a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:21:57.231657 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9bdc1d4c-de01-4bcd-bd37-55a061a2c45a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:21:57.382761 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-9bdc1d4c-de01-4bcd-bd37-55a061a2c45a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action" status: 200 len: 27964 microversion: 2.1 time: 0.171854 Dec 16 15:21:57.383537 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 980/1966] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 15:21:57 2021] POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action => generated 27964 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:21:58.399913 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-1da70f77-6355-428e-a5b2-c31e969c0136 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:21:58.401053 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-1da70f77-6355-428e-a5b2-c31e969c0136 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 4feaa08e-6919-4701-ab0e-481fe18c9abd] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:21:58.410203 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1da70f77-6355-428e-a5b2-c31e969c0136 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:21:58.410704 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1da70f77-6355-428e-a5b2-c31e969c0136 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:21:58.411559 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1da70f77-6355-428e-a5b2-c31e969c0136 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:21:58.412049 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1da70f77-6355-428e-a5b2-c31e969c0136 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:21:58.554559 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-1da70f77-6355-428e-a5b2-c31e969c0136 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action" status: 200 len: 28116 microversion: 2.1 time: 0.162734 Dec 16 15:21:58.558816 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 987/1967] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 15:21:58 2021] POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action => generated 28116 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:21:59.571639 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-fc08011e-f2e1-4694-a0a1-b3ae1759103b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:21:59.572827 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-fc08011e-f2e1-4694-a0a1-b3ae1759103b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 4feaa08e-6919-4701-ab0e-481fe18c9abd] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:21:59.582126 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fc08011e-f2e1-4694-a0a1-b3ae1759103b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:21:59.582653 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fc08011e-f2e1-4694-a0a1-b3ae1759103b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:21:59.583525 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fc08011e-f2e1-4694-a0a1-b3ae1759103b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:21:59.584059 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fc08011e-f2e1-4694-a0a1-b3ae1759103b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:21:59.720890 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-fc08011e-f2e1-4694-a0a1-b3ae1759103b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action" status: 200 len: 28199 microversion: 2.1 time: 0.157352 Dec 16 15:21:59.725151 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 981/1968] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 15:21:59 2021] POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action => generated 28199 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:22:00.739027 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-878f355f-b762-4d8e-aab4-5c061c4ba199 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:22:00.739993 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-878f355f-b762-4d8e-aab4-5c061c4ba199 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 4feaa08e-6919-4701-ab0e-481fe18c9abd] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:22:00.748856 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-878f355f-b762-4d8e-aab4-5c061c4ba199 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:22:00.749365 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-878f355f-b762-4d8e-aab4-5c061c4ba199 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:22:00.750250 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-878f355f-b762-4d8e-aab4-5c061c4ba199 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:22:00.750741 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-878f355f-b762-4d8e-aab4-5c061c4ba199 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:22:00.889608 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-878f355f-b762-4d8e-aab4-5c061c4ba199 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action" status: 200 len: 28199 microversion: 2.1 time: 0.159587 Dec 16 15:22:00.890547 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 988/1969] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 15:22:00 2021] POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action => generated 28199 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:22:01.907007 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-fdf221ff-feb7-4699-a28d-bd119f467e74 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:22:01.908159 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-fdf221ff-feb7-4699-a28d-bd119f467e74 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 4feaa08e-6919-4701-ab0e-481fe18c9abd] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:22:01.916933 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fdf221ff-feb7-4699-a28d-bd119f467e74 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:22:01.917445 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fdf221ff-feb7-4699-a28d-bd119f467e74 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:22:01.918382 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fdf221ff-feb7-4699-a28d-bd119f467e74 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:22:01.919514 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fdf221ff-feb7-4699-a28d-bd119f467e74 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:22:02.045599 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-fdf221ff-feb7-4699-a28d-bd119f467e74 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action" status: 200 len: 28199 microversion: 2.1 time: 0.147174 Dec 16 15:22:02.046599 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 982/1970] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 15:22:01 2021] POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action => generated 28199 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:22:03.063229 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-121f9ce4-d0e2-4839-8d17-ac9c427846f5 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:22:03.064363 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-121f9ce4-d0e2-4839-8d17-ac9c427846f5 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 4feaa08e-6919-4701-ab0e-481fe18c9abd] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:22:03.073108 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-121f9ce4-d0e2-4839-8d17-ac9c427846f5 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:22:03.073625 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-121f9ce4-d0e2-4839-8d17-ac9c427846f5 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:22:03.074503 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-121f9ce4-d0e2-4839-8d17-ac9c427846f5 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:22:03.075002 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-121f9ce4-d0e2-4839-8d17-ac9c427846f5 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:22:03.360616 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-121f9ce4-d0e2-4839-8d17-ac9c427846f5 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action" status: 200 len: 28199 microversion: 2.1 time: 0.306010 Dec 16 15:22:03.361562 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 989/1971] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 15:22:03 2021] POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action => generated 28199 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:22:04.377833 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-0bba7454-95a6-4701-8e1f-821728b30aa5 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:22:04.379023 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-0bba7454-95a6-4701-8e1f-821728b30aa5 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 4feaa08e-6919-4701-ab0e-481fe18c9abd] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:22:04.387841 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0bba7454-95a6-4701-8e1f-821728b30aa5 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:22:04.388356 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0bba7454-95a6-4701-8e1f-821728b30aa5 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:22:04.389218 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0bba7454-95a6-4701-8e1f-821728b30aa5 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:22:04.389720 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0bba7454-95a6-4701-8e1f-821728b30aa5 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:22:04.519502 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-0bba7454-95a6-4701-8e1f-821728b30aa5 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action" status: 200 len: 28199 microversion: 2.1 time: 0.149960 Dec 16 15:22:04.520138 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 983/1972] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 15:22:04 2021] POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action => generated 28199 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:22:05.536758 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-9351f5a1-d262-4554-845b-599d1342f895 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:22:05.537897 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-9351f5a1-d262-4554-845b-599d1342f895 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 4feaa08e-6919-4701-ab0e-481fe18c9abd] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:22:05.547495 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9351f5a1-d262-4554-845b-599d1342f895 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:22:05.548004 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9351f5a1-d262-4554-845b-599d1342f895 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:22:05.548860 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9351f5a1-d262-4554-845b-599d1342f895 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:22:05.549355 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9351f5a1-d262-4554-845b-599d1342f895 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:22:05.678381 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-9351f5a1-d262-4554-845b-599d1342f895 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action" status: 200 len: 28199 microversion: 2.1 time: 0.149889 Dec 16 15:22:05.679097 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 990/1973] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 15:22:05 2021] POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action => generated 28199 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:22:06.695589 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-156d7f76-0323-4c2b-ae3b-b1a91a67c0ae tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:22:06.696712 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-156d7f76-0323-4c2b-ae3b-b1a91a67c0ae tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 4feaa08e-6919-4701-ab0e-481fe18c9abd] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:22:06.705202 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-156d7f76-0323-4c2b-ae3b-b1a91a67c0ae tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:22:06.705703 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-156d7f76-0323-4c2b-ae3b-b1a91a67c0ae tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:22:06.706564 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-156d7f76-0323-4c2b-ae3b-b1a91a67c0ae tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:22:06.707056 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-156d7f76-0323-4c2b-ae3b-b1a91a67c0ae tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:22:06.848593 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-156d7f76-0323-4c2b-ae3b-b1a91a67c0ae tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action" status: 200 len: 28199 microversion: 2.1 time: 0.161088 Dec 16 15:22:06.849375 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 984/1974] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 15:22:06 2021] POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action => generated 28199 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:22:07.867062 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-3982213c-7b69-4709-bd27-87597581dbe2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:22:07.868257 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-3982213c-7b69-4709-bd27-87597581dbe2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 4feaa08e-6919-4701-ab0e-481fe18c9abd] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:22:07.876916 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3982213c-7b69-4709-bd27-87597581dbe2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:22:07.877423 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3982213c-7b69-4709-bd27-87597581dbe2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:22:07.878287 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3982213c-7b69-4709-bd27-87597581dbe2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:22:07.878777 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3982213c-7b69-4709-bd27-87597581dbe2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:22:08.004745 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-3982213c-7b69-4709-bd27-87597581dbe2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action" status: 200 len: 28199 microversion: 2.1 time: 0.147217 Dec 16 15:22:08.005440 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 991/1975] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 15:22:07 2021] POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action => generated 28199 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:22:09.025314 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-8234ab92-b6d2-4d55-8485-391c6e778a8c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:22:09.026386 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-8234ab92-b6d2-4d55-8485-391c6e778a8c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 4feaa08e-6919-4701-ab0e-481fe18c9abd] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:22:09.035909 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8234ab92-b6d2-4d55-8485-391c6e778a8c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:22:09.036418 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8234ab92-b6d2-4d55-8485-391c6e778a8c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:22:09.037270 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8234ab92-b6d2-4d55-8485-391c6e778a8c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:22:09.037781 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8234ab92-b6d2-4d55-8485-391c6e778a8c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:22:09.162269 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-8234ab92-b6d2-4d55-8485-391c6e778a8c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action" status: 200 len: 28199 microversion: 2.1 time: 0.148356 Dec 16 15:22:09.163022 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 985/1976] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 15:22:09 2021] POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action => generated 28199 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:22:10.179872 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-ae010d1f-6e9e-48db-ab4d-1e825ed0c838 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:22:10.180998 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-ae010d1f-6e9e-48db-ab4d-1e825ed0c838 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 4feaa08e-6919-4701-ab0e-481fe18c9abd] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:22:10.190218 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ae010d1f-6e9e-48db-ab4d-1e825ed0c838 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:22:10.190737 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ae010d1f-6e9e-48db-ab4d-1e825ed0c838 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:22:10.191590 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ae010d1f-6e9e-48db-ab4d-1e825ed0c838 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:22:10.192087 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ae010d1f-6e9e-48db-ab4d-1e825ed0c838 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:22:10.317177 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-ae010d1f-6e9e-48db-ab4d-1e825ed0c838 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action" status: 200 len: 28199 microversion: 2.1 time: 0.145584 Dec 16 15:22:10.317932 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 992/1977] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 15:22:10 2021] POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action => generated 28199 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:22:11.335745 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-dae07785-f1d1-43ce-8b3c-11199b7f1df0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:22:11.336946 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-dae07785-f1d1-43ce-8b3c-11199b7f1df0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 4feaa08e-6919-4701-ab0e-481fe18c9abd] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:22:11.346838 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-dae07785-f1d1-43ce-8b3c-11199b7f1df0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:22:11.347556 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-dae07785-f1d1-43ce-8b3c-11199b7f1df0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:22:11.348665 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-dae07785-f1d1-43ce-8b3c-11199b7f1df0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:22:11.349532 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-dae07785-f1d1-43ce-8b3c-11199b7f1df0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:22:11.479572 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-dae07785-f1d1-43ce-8b3c-11199b7f1df0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action" status: 200 len: 28199 microversion: 2.1 time: 0.153514 Dec 16 15:22:11.480280 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 986/1978] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 15:22:11 2021] POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action => generated 28199 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 15:22:12.496167 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-6cde8945-2a51-4d1d-936f-632c50f7b120 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:22:12.497339 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-6cde8945-2a51-4d1d-936f-632c50f7b120 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 4feaa08e-6919-4701-ab0e-481fe18c9abd] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:22:12.506719 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6cde8945-2a51-4d1d-936f-632c50f7b120 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:22:12.507224 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6cde8945-2a51-4d1d-936f-632c50f7b120 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:22:12.508078 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6cde8945-2a51-4d1d-936f-632c50f7b120 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:22:12.508585 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6cde8945-2a51-4d1d-936f-632c50f7b120 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:22:12.639396 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-6cde8945-2a51-4d1d-936f-632c50f7b120 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action" status: 200 len: 28199 microversion: 2.1 time: 0.150339 Dec 16 15:22:12.640041 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 993/1979] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 15:22:12 2021] POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action => generated 28199 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:22:13.657014 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-d417a297-f8f9-4721-bc3b-709cf44b3a00 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:22:13.658178 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-d417a297-f8f9-4721-bc3b-709cf44b3a00 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 4feaa08e-6919-4701-ab0e-481fe18c9abd] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:22:13.666737 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d417a297-f8f9-4721-bc3b-709cf44b3a00 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:22:13.667243 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d417a297-f8f9-4721-bc3b-709cf44b3a00 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:22:13.668091 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d417a297-f8f9-4721-bc3b-709cf44b3a00 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:22:13.668597 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d417a297-f8f9-4721-bc3b-709cf44b3a00 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:22:13.812647 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-d417a297-f8f9-4721-bc3b-709cf44b3a00 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action" status: 200 len: 28199 microversion: 2.1 time: 0.164194 Dec 16 15:22:13.814386 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 987/1980] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 15:22:13 2021] POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action => generated 28199 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:22:14.829211 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-7c5837f4-77bf-4242-81c6-8b0835a8a607 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:22:14.830364 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-7c5837f4-77bf-4242-81c6-8b0835a8a607 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 4feaa08e-6919-4701-ab0e-481fe18c9abd] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:22:14.839122 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7c5837f4-77bf-4242-81c6-8b0835a8a607 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:22:14.839633 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7c5837f4-77bf-4242-81c6-8b0835a8a607 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:22:14.840477 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7c5837f4-77bf-4242-81c6-8b0835a8a607 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:22:14.840990 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7c5837f4-77bf-4242-81c6-8b0835a8a607 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:22:14.995176 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-7c5837f4-77bf-4242-81c6-8b0835a8a607 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action" status: 200 len: 28490 microversion: 2.1 time: 0.173961 Dec 16 15:22:14.996091 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 994/1981] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 15:22:14 2021] POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action => generated 28490 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 15:22:16.011144 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-c17e2de7-2c19-4ff4-aae8-b530c5c22677 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:22:16.012270 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-c17e2de7-2c19-4ff4-aae8-b530c5c22677 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 4feaa08e-6919-4701-ab0e-481fe18c9abd] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:22:16.020782 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c17e2de7-2c19-4ff4-aae8-b530c5c22677 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:22:16.021227 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c17e2de7-2c19-4ff4-aae8-b530c5c22677 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:22:16.022099 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c17e2de7-2c19-4ff4-aae8-b530c5c22677 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:22:16.022582 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c17e2de7-2c19-4ff4-aae8-b530c5c22677 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:22:16.145983 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-c17e2de7-2c19-4ff4-aae8-b530c5c22677 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action" status: 200 len: 28490 microversion: 2.1 time: 0.142627 Dec 16 15:22:16.146752 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 988/1982] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 15:22:16 2021] POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action => generated 28490 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:22:17.163479 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-a768761a-aa34-483d-92d3-7b33748d2b8f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:22:17.164587 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-a768761a-aa34-483d-92d3-7b33748d2b8f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 4feaa08e-6919-4701-ab0e-481fe18c9abd] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:22:17.173812 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a768761a-aa34-483d-92d3-7b33748d2b8f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:22:17.174280 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a768761a-aa34-483d-92d3-7b33748d2b8f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:22:17.175120 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a768761a-aa34-483d-92d3-7b33748d2b8f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:22:17.175608 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a768761a-aa34-483d-92d3-7b33748d2b8f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:22:17.306873 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-a768761a-aa34-483d-92d3-7b33748d2b8f tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action" status: 200 len: 28658 microversion: 2.1 time: 0.151392 Dec 16 15:22:17.307610 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 995/1983] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 15:22:17 2021] POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action => generated 28658 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:22:18.324364 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-3b8d28a8-9991-4dae-8b22-7fc9479bbded tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:22:18.325513 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-3b8d28a8-9991-4dae-8b22-7fc9479bbded tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 4feaa08e-6919-4701-ab0e-481fe18c9abd] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:22:18.335086 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3b8d28a8-9991-4dae-8b22-7fc9479bbded tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:22:18.335653 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3b8d28a8-9991-4dae-8b22-7fc9479bbded tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:22:18.336570 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3b8d28a8-9991-4dae-8b22-7fc9479bbded tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:22:18.337072 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3b8d28a8-9991-4dae-8b22-7fc9479bbded tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:22:18.464220 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-3b8d28a8-9991-4dae-8b22-7fc9479bbded tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action" status: 200 len: 28658 microversion: 2.1 time: 0.147901 Dec 16 15:22:18.468495 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 989/1984] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 15:22:18 2021] POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action => generated 28658 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:22:19.480557 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-f6f176de-b765-4467-b547-a817092d2055 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:22:19.481689 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-f6f176de-b765-4467-b547-a817092d2055 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 4feaa08e-6919-4701-ab0e-481fe18c9abd] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:22:19.490267 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f6f176de-b765-4467-b547-a817092d2055 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:22:19.490770 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f6f176de-b765-4467-b547-a817092d2055 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:22:19.491602 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f6f176de-b765-4467-b547-a817092d2055 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:22:19.492089 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f6f176de-b765-4467-b547-a817092d2055 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:22:19.616329 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-f6f176de-b765-4467-b547-a817092d2055 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action" status: 200 len: 28658 microversion: 2.1 time: 0.143470 Dec 16 15:22:19.616948 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 996/1985] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 15:22:19 2021] POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action => generated 28658 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 15:22:20.632449 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-ad8203a9-6665-4dbc-a732-953a285241fc tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:22:20.633587 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-ad8203a9-6665-4dbc-a732-953a285241fc tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 4feaa08e-6919-4701-ab0e-481fe18c9abd] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:22:20.642218 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ad8203a9-6665-4dbc-a732-953a285241fc tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:22:20.642730 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ad8203a9-6665-4dbc-a732-953a285241fc tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:22:20.643577 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ad8203a9-6665-4dbc-a732-953a285241fc tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:22:20.644082 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ad8203a9-6665-4dbc-a732-953a285241fc tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:22:20.787702 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-ad8203a9-6665-4dbc-a732-953a285241fc tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action" status: 200 len: 28658 microversion: 2.1 time: 0.163189 Dec 16 15:22:20.788637 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 990/1986] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 15:22:20 2021] POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action => generated 28658 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:22:21.805638 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-fb57e5cb-dd6b-4f08-9576-d3742a489953 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:22:21.806870 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-fb57e5cb-dd6b-4f08-9576-d3742a489953 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 4feaa08e-6919-4701-ab0e-481fe18c9abd] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:22:21.816982 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fb57e5cb-dd6b-4f08-9576-d3742a489953 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:22:21.817480 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fb57e5cb-dd6b-4f08-9576-d3742a489953 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:22:21.818354 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fb57e5cb-dd6b-4f08-9576-d3742a489953 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:22:21.818838 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fb57e5cb-dd6b-4f08-9576-d3742a489953 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:22:21.948303 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-fb57e5cb-dd6b-4f08-9576-d3742a489953 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action" status: 200 len: 28658 microversion: 2.1 time: 0.151469 Dec 16 15:22:21.949508 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 997/1987] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 15:22:21 2021] POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action => generated 28658 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:22:22.966591 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-f415a65c-edc2-4590-8efe-844d5f8fd35a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:22:22.967655 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-f415a65c-edc2-4590-8efe-844d5f8fd35a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 4feaa08e-6919-4701-ab0e-481fe18c9abd] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:22:22.977153 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f415a65c-edc2-4590-8efe-844d5f8fd35a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:22:22.977680 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f415a65c-edc2-4590-8efe-844d5f8fd35a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:22:22.978561 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f415a65c-edc2-4590-8efe-844d5f8fd35a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:22:22.979071 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f415a65c-edc2-4590-8efe-844d5f8fd35a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:22:23.109420 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-f415a65c-edc2-4590-8efe-844d5f8fd35a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action" status: 200 len: 28658 microversion: 2.1 time: 0.151017 Dec 16 15:22:23.110137 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 991/1988] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 15:22:22 2021] POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action => generated 28658 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:22:24.126467 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-ab10d54f-bb1c-41d2-a565-ad4b6dfd2d27 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:22:24.128215 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-ab10d54f-bb1c-41d2-a565-ad4b6dfd2d27 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 4feaa08e-6919-4701-ab0e-481fe18c9abd] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:22:24.136864 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ab10d54f-bb1c-41d2-a565-ad4b6dfd2d27 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:22:24.137364 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ab10d54f-bb1c-41d2-a565-ad4b6dfd2d27 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:22:24.138225 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ab10d54f-bb1c-41d2-a565-ad4b6dfd2d27 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:22:24.138765 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ab10d54f-bb1c-41d2-a565-ad4b6dfd2d27 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:22:24.285624 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-ab10d54f-bb1c-41d2-a565-ad4b6dfd2d27 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action" status: 200 len: 28658 microversion: 2.1 time: 0.167155 Dec 16 15:22:24.286351 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 998/1989] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 15:22:24 2021] POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action => generated 28658 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:22:25.302885 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-e0ed65a4-f318-4d75-afe9-6c0e33feafd6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:22:25.303938 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-e0ed65a4-f318-4d75-afe9-6c0e33feafd6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 4feaa08e-6919-4701-ab0e-481fe18c9abd] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:22:25.312521 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e0ed65a4-f318-4d75-afe9-6c0e33feafd6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:22:25.313031 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e0ed65a4-f318-4d75-afe9-6c0e33feafd6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:22:25.313871 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e0ed65a4-f318-4d75-afe9-6c0e33feafd6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:22:25.314390 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e0ed65a4-f318-4d75-afe9-6c0e33feafd6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:22:25.486230 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-e0ed65a4-f318-4d75-afe9-6c0e33feafd6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action" status: 200 len: 28658 microversion: 2.1 time: 0.192324 Dec 16 15:22:25.486990 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 992/1990] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 15:22:25 2021] POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action => generated 28658 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:22:26.502979 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-08efd3f9-618d-4751-99d0-4b4ad530a7ee tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:22:26.504119 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-08efd3f9-618d-4751-99d0-4b4ad530a7ee tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 4feaa08e-6919-4701-ab0e-481fe18c9abd] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:22:26.512715 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-08efd3f9-618d-4751-99d0-4b4ad530a7ee tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:22:26.513223 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-08efd3f9-618d-4751-99d0-4b4ad530a7ee tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:22:26.514078 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-08efd3f9-618d-4751-99d0-4b4ad530a7ee tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:22:26.514578 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-08efd3f9-618d-4751-99d0-4b4ad530a7ee tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:22:26.638054 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-08efd3f9-618d-4751-99d0-4b4ad530a7ee tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action" status: 200 len: 28658 microversion: 2.1 time: 0.143487 Dec 16 15:22:26.638856 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 999/1991] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 15:22:26 2021] POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action => generated 28658 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:22:27.655358 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-9aa386e2-f1e1-4577-abb6-bab51a7de3a0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:22:27.656410 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-9aa386e2-f1e1-4577-abb6-bab51a7de3a0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 4feaa08e-6919-4701-ab0e-481fe18c9abd] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:22:27.665564 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9aa386e2-f1e1-4577-abb6-bab51a7de3a0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:22:27.666096 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9aa386e2-f1e1-4577-abb6-bab51a7de3a0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:22:27.666925 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9aa386e2-f1e1-4577-abb6-bab51a7de3a0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:22:27.667415 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9aa386e2-f1e1-4577-abb6-bab51a7de3a0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:22:27.810145 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-9aa386e2-f1e1-4577-abb6-bab51a7de3a0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action" status: 200 len: 28658 microversion: 2.1 time: 0.162995 Dec 16 15:22:27.810861 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 993/1992] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 15:22:27 2021] POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action => generated 28658 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:22:28.826984 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-3683ebfb-319a-4f2b-acc3-03d356d6ab47 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:22:28.828118 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-3683ebfb-319a-4f2b-acc3-03d356d6ab47 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 4feaa08e-6919-4701-ab0e-481fe18c9abd] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:22:28.836691 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3683ebfb-319a-4f2b-acc3-03d356d6ab47 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:22:28.837197 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3683ebfb-319a-4f2b-acc3-03d356d6ab47 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:22:28.838027 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3683ebfb-319a-4f2b-acc3-03d356d6ab47 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:22:28.838558 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3683ebfb-319a-4f2b-acc3-03d356d6ab47 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:22:28.962208 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-3683ebfb-319a-4f2b-acc3-03d356d6ab47 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action" status: 200 len: 28658 microversion: 2.1 time: 0.143184 Dec 16 15:22:28.963595 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1000/1993] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 15:22:28 2021] POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action => generated 28658 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:22:29.979053 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-90115f60-5c31-4f50-b1e8-9dd528b41394 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:22:29.980107 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-90115f60-5c31-4f50-b1e8-9dd528b41394 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 4feaa08e-6919-4701-ab0e-481fe18c9abd] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:22:29.988727 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-90115f60-5c31-4f50-b1e8-9dd528b41394 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:22:29.989235 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-90115f60-5c31-4f50-b1e8-9dd528b41394 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:22:29.990090 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-90115f60-5c31-4f50-b1e8-9dd528b41394 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:22:29.990591 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-90115f60-5c31-4f50-b1e8-9dd528b41394 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:22:30.259404 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-90115f60-5c31-4f50-b1e8-9dd528b41394 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action" status: 200 len: 28658 microversion: 2.1 time: 0.288507 Dec 16 15:22:30.260049 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 994/1994] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 15:22:29 2021] POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action => generated 28658 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:22:31.277546 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-0b1de3e1-53fb-459b-bb62-37569e4c22ff tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:22:31.278808 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-0b1de3e1-53fb-459b-bb62-37569e4c22ff tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 4feaa08e-6919-4701-ab0e-481fe18c9abd] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:22:31.288223 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0b1de3e1-53fb-459b-bb62-37569e4c22ff tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:22:31.289050 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0b1de3e1-53fb-459b-bb62-37569e4c22ff tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:22:31.289951 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0b1de3e1-53fb-459b-bb62-37569e4c22ff tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:22:31.290655 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0b1de3e1-53fb-459b-bb62-37569e4c22ff tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:22:31.424798 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-0b1de3e1-53fb-459b-bb62-37569e4c22ff tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action" status: 200 len: 28658 microversion: 2.1 time: 0.155452 Dec 16 15:22:31.429393 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1001/1995] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 15:22:31 2021] POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action => generated 28658 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:22:32.442073 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-6d9fb2ce-e019-4eb1-b8ea-74d39ad55062 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:22:32.444120 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-6d9fb2ce-e019-4eb1-b8ea-74d39ad55062 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 4feaa08e-6919-4701-ab0e-481fe18c9abd] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:22:32.452939 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6d9fb2ce-e019-4eb1-b8ea-74d39ad55062 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:22:32.453446 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6d9fb2ce-e019-4eb1-b8ea-74d39ad55062 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:22:32.454324 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6d9fb2ce-e019-4eb1-b8ea-74d39ad55062 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:22:32.454819 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6d9fb2ce-e019-4eb1-b8ea-74d39ad55062 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:22:32.581972 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-6d9fb2ce-e019-4eb1-b8ea-74d39ad55062 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action" status: 200 len: 28658 microversion: 2.1 time: 0.148401 Dec 16 15:22:32.582696 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 995/1996] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 15:22:32 2021] POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action => generated 28658 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:22:33.598396 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-734d7bba-98ec-4d8a-aebd-b8d7deda68dc tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:22:33.599537 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-734d7bba-98ec-4d8a-aebd-b8d7deda68dc tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 4feaa08e-6919-4701-ab0e-481fe18c9abd] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:22:33.608520 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-734d7bba-98ec-4d8a-aebd-b8d7deda68dc tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:22:33.609032 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-734d7bba-98ec-4d8a-aebd-b8d7deda68dc tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:22:33.609883 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-734d7bba-98ec-4d8a-aebd-b8d7deda68dc tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:22:33.610444 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-734d7bba-98ec-4d8a-aebd-b8d7deda68dc tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:22:33.734459 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-734d7bba-98ec-4d8a-aebd-b8d7deda68dc tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action" status: 200 len: 28658 microversion: 2.1 time: 0.144557 Dec 16 15:22:33.735155 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1002/1997] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 15:22:33 2021] POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action => generated 28658 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:22:34.751334 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-4a52488f-c2a8-40e2-8ecc-3f117bfe153c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:22:34.752986 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-4a52488f-c2a8-40e2-8ecc-3f117bfe153c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 4feaa08e-6919-4701-ab0e-481fe18c9abd] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:22:34.761534 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4a52488f-c2a8-40e2-8ecc-3f117bfe153c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:22:34.762009 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4a52488f-c2a8-40e2-8ecc-3f117bfe153c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:22:34.762860 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4a52488f-c2a8-40e2-8ecc-3f117bfe153c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:22:34.763358 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4a52488f-c2a8-40e2-8ecc-3f117bfe153c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:22:34.891042 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-4a52488f-c2a8-40e2-8ecc-3f117bfe153c tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action" status: 200 len: 28658 microversion: 2.1 time: 0.147713 Dec 16 15:22:34.891789 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 996/1998] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 15:22:34 2021] POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action => generated 28658 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:22:35.907886 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-8ba92fe1-5a69-4024-97f7-efc05bfcba0b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:22:35.908962 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-8ba92fe1-5a69-4024-97f7-efc05bfcba0b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 4feaa08e-6919-4701-ab0e-481fe18c9abd] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:22:35.917521 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8ba92fe1-5a69-4024-97f7-efc05bfcba0b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:22:35.918026 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8ba92fe1-5a69-4024-97f7-efc05bfcba0b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:22:35.918900 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8ba92fe1-5a69-4024-97f7-efc05bfcba0b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:22:35.919394 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8ba92fe1-5a69-4024-97f7-efc05bfcba0b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:22:36.044544 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-8ba92fe1-5a69-4024-97f7-efc05bfcba0b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action" status: 200 len: 28658 microversion: 2.1 time: 0.144817 Dec 16 15:22:36.045216 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1003/1999] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 15:22:35 2021] POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action => generated 28658 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:22:37.062733 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-3a3bae66-253b-406f-bd97-f641ace9262a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:22:37.063887 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-3a3bae66-253b-406f-bd97-f641ace9262a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 4feaa08e-6919-4701-ab0e-481fe18c9abd] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:22:37.073629 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3a3bae66-253b-406f-bd97-f641ace9262a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:22:37.074163 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3a3bae66-253b-406f-bd97-f641ace9262a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:22:37.075048 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3a3bae66-253b-406f-bd97-f641ace9262a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:22:37.075538 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3a3bae66-253b-406f-bd97-f641ace9262a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:22:37.216696 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-3a3bae66-253b-406f-bd97-f641ace9262a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action" status: 200 len: 28658 microversion: 2.1 time: 0.162556 Dec 16 15:22:37.217397 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 997/2000] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 15:22:37 2021] POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action => generated 28658 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:22:38.233803 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-678b3981-2ea3-4ef1-88cf-cf19be15cc87 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:22:38.234976 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-678b3981-2ea3-4ef1-88cf-cf19be15cc87 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 4feaa08e-6919-4701-ab0e-481fe18c9abd] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:22:38.243666 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-678b3981-2ea3-4ef1-88cf-cf19be15cc87 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:22:38.244177 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-678b3981-2ea3-4ef1-88cf-cf19be15cc87 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:22:38.245022 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-678b3981-2ea3-4ef1-88cf-cf19be15cc87 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:22:38.245526 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-678b3981-2ea3-4ef1-88cf-cf19be15cc87 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:22:38.387733 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-678b3981-2ea3-4ef1-88cf-cf19be15cc87 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action" status: 200 len: 28658 microversion: 2.1 time: 0.161835 Dec 16 15:22:38.388386 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1004/2001] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 15:22:38 2021] POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action => generated 28658 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:22:39.404389 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-d2ad7efb-2f11-4578-a8a3-736aa9329e0b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:22:39.405530 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-d2ad7efb-2f11-4578-a8a3-736aa9329e0b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 4feaa08e-6919-4701-ab0e-481fe18c9abd] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:22:39.414701 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d2ad7efb-2f11-4578-a8a3-736aa9329e0b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:22:39.415266 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d2ad7efb-2f11-4578-a8a3-736aa9329e0b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:22:39.416060 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d2ad7efb-2f11-4578-a8a3-736aa9329e0b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:22:39.416555 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d2ad7efb-2f11-4578-a8a3-736aa9329e0b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:22:39.538124 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-d2ad7efb-2f11-4578-a8a3-736aa9329e0b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action" status: 200 len: 28658 microversion: 2.1 time: 0.141546 Dec 16 15:22:39.538815 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 998/2002] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 15:22:39 2021] POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action => generated 28658 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:22:40.556091 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-fe36ee26-4c5d-4aad-a2b9-ae82236ffed6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:22:40.557119 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-fe36ee26-4c5d-4aad-a2b9-ae82236ffed6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 4feaa08e-6919-4701-ab0e-481fe18c9abd] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:22:40.565685 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fe36ee26-4c5d-4aad-a2b9-ae82236ffed6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:22:40.566213 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fe36ee26-4c5d-4aad-a2b9-ae82236ffed6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:22:40.567043 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fe36ee26-4c5d-4aad-a2b9-ae82236ffed6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:22:40.567527 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fe36ee26-4c5d-4aad-a2b9-ae82236ffed6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:22:40.692155 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-fe36ee26-4c5d-4aad-a2b9-ae82236ffed6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action" status: 200 len: 28658 microversion: 2.1 time: 0.145046 Dec 16 15:22:40.692887 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1005/2003] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 15:22:40 2021] POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action => generated 28658 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:22:41.709515 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-bdee2350-bf22-4a16-bafa-9fcc89ec8b95 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:22:41.710669 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-bdee2350-bf22-4a16-bafa-9fcc89ec8b95 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 4feaa08e-6919-4701-ab0e-481fe18c9abd] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:22:41.719263 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-bdee2350-bf22-4a16-bafa-9fcc89ec8b95 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:22:41.719769 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-bdee2350-bf22-4a16-bafa-9fcc89ec8b95 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:22:41.721260 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-bdee2350-bf22-4a16-bafa-9fcc89ec8b95 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:22:41.721758 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-bdee2350-bf22-4a16-bafa-9fcc89ec8b95 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:22:41.849397 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-bdee2350-bf22-4a16-bafa-9fcc89ec8b95 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action" status: 200 len: 28658 microversion: 2.1 time: 0.148349 Dec 16 15:22:41.850131 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 999/2004] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 15:22:41 2021] POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action => generated 28658 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 15:22:42.866537 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-bc915b09-0ad5-4b76-955d-8e0d92a393a6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:22:42.867666 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-bc915b09-0ad5-4b76-955d-8e0d92a393a6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 4feaa08e-6919-4701-ab0e-481fe18c9abd] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:22:42.876358 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-bc915b09-0ad5-4b76-955d-8e0d92a393a6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:22:42.876864 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-bc915b09-0ad5-4b76-955d-8e0d92a393a6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:22:42.877710 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-bc915b09-0ad5-4b76-955d-8e0d92a393a6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:22:42.878274 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-bc915b09-0ad5-4b76-955d-8e0d92a393a6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:22:43.011819 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-bc915b09-0ad5-4b76-955d-8e0d92a393a6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action" status: 200 len: 28658 microversion: 2.1 time: 0.153738 Dec 16 15:22:43.012655 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1006/2005] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 15:22:42 2021] POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action => generated 28658 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:22:44.028746 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-9df0f861-aa79-44a8-b28c-17860f93d28e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:22:44.029932 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-9df0f861-aa79-44a8-b28c-17860f93d28e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 4feaa08e-6919-4701-ab0e-481fe18c9abd] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:22:44.038549 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9df0f861-aa79-44a8-b28c-17860f93d28e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:22:44.039064 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9df0f861-aa79-44a8-b28c-17860f93d28e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:22:44.039913 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9df0f861-aa79-44a8-b28c-17860f93d28e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:22:44.040413 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9df0f861-aa79-44a8-b28c-17860f93d28e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:22:44.179846 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-9df0f861-aa79-44a8-b28c-17860f93d28e tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action" status: 200 len: 28658 microversion: 2.1 time: 0.158962 Dec 16 15:22:44.180495 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1000/2006] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 15:22:44 2021] POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action => generated 28658 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:22:45.197404 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-7bf6db28-951c-4e51-81a4-3383be5621d2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:22:45.198565 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-7bf6db28-951c-4e51-81a4-3383be5621d2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 4feaa08e-6919-4701-ab0e-481fe18c9abd] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:22:45.208011 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7bf6db28-951c-4e51-81a4-3383be5621d2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:22:45.208573 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7bf6db28-951c-4e51-81a4-3383be5621d2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:22:45.209444 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7bf6db28-951c-4e51-81a4-3383be5621d2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:22:45.209942 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7bf6db28-951c-4e51-81a4-3383be5621d2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:22:45.335263 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-7bf6db28-951c-4e51-81a4-3383be5621d2 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action" status: 200 len: 28658 microversion: 2.1 time: 0.146409 Dec 16 15:22:45.335984 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1007/2007] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 15:22:45 2021] POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action => generated 28658 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:22:46.353462 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-c985d5b0-f7c9-4cfc-8bac-53116d17adbc tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:22:46.354778 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-c985d5b0-f7c9-4cfc-8bac-53116d17adbc tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 4feaa08e-6919-4701-ab0e-481fe18c9abd] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:22:46.364428 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c985d5b0-f7c9-4cfc-8bac-53116d17adbc tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:22:46.364937 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c985d5b0-f7c9-4cfc-8bac-53116d17adbc tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:22:46.365793 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c985d5b0-f7c9-4cfc-8bac-53116d17adbc tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:22:46.366326 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c985d5b0-f7c9-4cfc-8bac-53116d17adbc tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:22:46.494268 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-c985d5b0-f7c9-4cfc-8bac-53116d17adbc tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action" status: 200 len: 28658 microversion: 2.1 time: 0.149590 Dec 16 15:22:46.498068 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1001/2008] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 15:22:46 2021] POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action => generated 28658 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:22:47.512434 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-0fa5caae-cc16-4faa-883f-910a2440d989 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:22:47.513562 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-0fa5caae-cc16-4faa-883f-910a2440d989 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 4feaa08e-6919-4701-ab0e-481fe18c9abd] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:22:47.524865 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0fa5caae-cc16-4faa-883f-910a2440d989 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:22:47.525397 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0fa5caae-cc16-4faa-883f-910a2440d989 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:22:47.526297 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0fa5caae-cc16-4faa-883f-910a2440d989 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:22:47.526737 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0fa5caae-cc16-4faa-883f-910a2440d989 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:22:47.657047 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-0fa5caae-cc16-4faa-883f-910a2440d989 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action" status: 200 len: 28658 microversion: 2.1 time: 0.154121 Dec 16 15:22:47.657698 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1008/2009] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 15:22:47 2021] POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action => generated 28658 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:22:48.679513 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-0bf26b7b-507d-49ad-bc91-f2d644967f93 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:22:48.680687 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-0bf26b7b-507d-49ad-bc91-f2d644967f93 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 4feaa08e-6919-4701-ab0e-481fe18c9abd] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:22:48.689427 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0bf26b7b-507d-49ad-bc91-f2d644967f93 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:22:48.689934 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0bf26b7b-507d-49ad-bc91-f2d644967f93 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:22:48.690810 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0bf26b7b-507d-49ad-bc91-f2d644967f93 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:22:48.691299 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0bf26b7b-507d-49ad-bc91-f2d644967f93 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:22:48.821360 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-0bf26b7b-507d-49ad-bc91-f2d644967f93 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action" status: 200 len: 28658 microversion: 2.1 time: 0.154683 Dec 16 15:22:48.822572 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1002/2010] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 15:22:48 2021] POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action => generated 28658 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:22:49.838431 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-9b611614-05ce-45b0-9f2d-4efe8d4c58f8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:22:49.839468 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-9b611614-05ce-45b0-9f2d-4efe8d4c58f8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 4feaa08e-6919-4701-ab0e-481fe18c9abd] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:22:49.848165 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9b611614-05ce-45b0-9f2d-4efe8d4c58f8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:22:49.848663 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9b611614-05ce-45b0-9f2d-4efe8d4c58f8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:22:49.849498 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9b611614-05ce-45b0-9f2d-4efe8d4c58f8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:22:49.849982 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9b611614-05ce-45b0-9f2d-4efe8d4c58f8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:22:49.999276 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-9b611614-05ce-45b0-9f2d-4efe8d4c58f8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action" status: 200 len: 29996 microversion: 2.1 time: 0.168854 Dec 16 15:22:50.000086 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1009/2011] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 15:22:49 2021] POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action => generated 29996 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:22:51.016697 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-72d9f47b-cf5d-4a90-9853-2bc353631dba tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:22:51.017846 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-72d9f47b-cf5d-4a90-9853-2bc353631dba tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 4feaa08e-6919-4701-ab0e-481fe18c9abd] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:22:51.026639 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-72d9f47b-cf5d-4a90-9853-2bc353631dba tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:22:51.027161 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-72d9f47b-cf5d-4a90-9853-2bc353631dba tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:22:51.028012 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-72d9f47b-cf5d-4a90-9853-2bc353631dba tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:22:51.028602 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-72d9f47b-cf5d-4a90-9853-2bc353631dba tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:22:51.161745 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-72d9f47b-cf5d-4a90-9853-2bc353631dba tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action" status: 200 len: 32104 microversion: 2.1 time: 0.152894 Dec 16 15:22:51.162864 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1003/2012] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 15:22:51 2021] POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action => generated 32104 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:22:52.179662 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-2f2d962c-cccd-4b2a-912a-f8ed345e2b57 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:22:52.180785 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-2f2d962c-cccd-4b2a-912a-f8ed345e2b57 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 4feaa08e-6919-4701-ab0e-481fe18c9abd] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:22:52.189275 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2f2d962c-cccd-4b2a-912a-f8ed345e2b57 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:22:52.189770 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2f2d962c-cccd-4b2a-912a-f8ed345e2b57 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:22:52.191310 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2f2d962c-cccd-4b2a-912a-f8ed345e2b57 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:22:52.191796 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2f2d962c-cccd-4b2a-912a-f8ed345e2b57 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:22:52.353685 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-2f2d962c-cccd-4b2a-912a-f8ed345e2b57 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action" status: 200 len: 33508 microversion: 2.1 time: 0.182011 Dec 16 15:22:52.355346 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1010/2013] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 15:22:52 2021] POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action => generated 33508 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 16 15:22:53.374077 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-c806584b-c1b1-4882-a7b8-b21a48915a60 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:22:53.375343 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-c806584b-c1b1-4882-a7b8-b21a48915a60 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 4feaa08e-6919-4701-ab0e-481fe18c9abd] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:22:53.384938 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c806584b-c1b1-4882-a7b8-b21a48915a60 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:22:53.385409 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c806584b-c1b1-4882-a7b8-b21a48915a60 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:22:53.386285 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c806584b-c1b1-4882-a7b8-b21a48915a60 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:22:53.386991 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c806584b-c1b1-4882-a7b8-b21a48915a60 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:22:53.536000 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-c806584b-c1b1-4882-a7b8-b21a48915a60 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action" status: 200 len: 34590 microversion: 2.1 time: 0.170118 Dec 16 15:22:53.536705 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1004/2014] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 15:22:53 2021] POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action => generated 34590 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:22:54.554940 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-6a3b02f9-bd11-475d-9b28-8018e59b24a8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:22:54.556110 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-6a3b02f9-bd11-475d-9b28-8018e59b24a8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 4feaa08e-6919-4701-ab0e-481fe18c9abd] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:22:54.565681 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6a3b02f9-bd11-475d-9b28-8018e59b24a8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:22:54.566241 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6a3b02f9-bd11-475d-9b28-8018e59b24a8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:22:54.567164 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6a3b02f9-bd11-475d-9b28-8018e59b24a8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:22:54.567666 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6a3b02f9-bd11-475d-9b28-8018e59b24a8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:22:54.712785 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-6a3b02f9-bd11-475d-9b28-8018e59b24a8 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action" status: 200 len: 35831 microversion: 2.1 time: 0.166781 Dec 16 15:22:54.713784 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1011/2015] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 15:22:54 2021] POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action => generated 35831 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:22:55.730158 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-36e81012-9b89-4e73-b8dc-77ac621dd8c7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:22:55.731310 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-36e81012-9b89-4e73-b8dc-77ac621dd8c7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 4feaa08e-6919-4701-ab0e-481fe18c9abd] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:22:55.740347 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-36e81012-9b89-4e73-b8dc-77ac621dd8c7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:22:55.740855 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-36e81012-9b89-4e73-b8dc-77ac621dd8c7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:22:55.741710 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-36e81012-9b89-4e73-b8dc-77ac621dd8c7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:22:55.742239 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-36e81012-9b89-4e73-b8dc-77ac621dd8c7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:22:55.884927 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-36e81012-9b89-4e73-b8dc-77ac621dd8c7 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action" status: 200 len: 37456 microversion: 2.1 time: 0.163190 Dec 16 15:22:55.885795 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1005/2016] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 15:22:55 2021] POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action => generated 37456 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:22:56.904833 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-b96d4c07-c624-4662-a8b6-994682dfdd8a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:22:56.906229 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-b96d4c07-c624-4662-a8b6-994682dfdd8a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 4feaa08e-6919-4701-ab0e-481fe18c9abd] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:22:56.917312 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b96d4c07-c624-4662-a8b6-994682dfdd8a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:22:56.917929 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b96d4c07-c624-4662-a8b6-994682dfdd8a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:22:56.918891 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b96d4c07-c624-4662-a8b6-994682dfdd8a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:22:56.919416 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b96d4c07-c624-4662-a8b6-994682dfdd8a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:22:57.068622 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-b96d4c07-c624-4662-a8b6-994682dfdd8a tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action" status: 200 len: 38188 microversion: 2.1 time: 0.173529 Dec 16 15:22:57.069246 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1012/2017] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 15:22:56 2021] POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action => generated 38188 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:22:58.086325 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-be3eb364-c1c5-44c7-8d3a-6f7ce7b6f087 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:22:58.087454 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-be3eb364-c1c5-44c7-8d3a-6f7ce7b6f087 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 4feaa08e-6919-4701-ab0e-481fe18c9abd] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:22:58.097242 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-be3eb364-c1c5-44c7-8d3a-6f7ce7b6f087 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:22:58.097747 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-be3eb364-c1c5-44c7-8d3a-6f7ce7b6f087 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:22:58.098713 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-be3eb364-c1c5-44c7-8d3a-6f7ce7b6f087 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:22:58.099202 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-be3eb364-c1c5-44c7-8d3a-6f7ce7b6f087 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:22:58.223303 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-be3eb364-c1c5-44c7-8d3a-6f7ce7b6f087 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action" status: 200 len: 38188 microversion: 2.1 time: 0.145584 Dec 16 15:22:58.223913 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1006/2018] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 15:22:58 2021] POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action => generated 38188 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:22:59.241438 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-43b316df-013d-4060-be43-1465787b9634 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:22:59.242552 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-43b316df-013d-4060-be43-1465787b9634 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 4feaa08e-6919-4701-ab0e-481fe18c9abd] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:22:59.251210 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-43b316df-013d-4060-be43-1465787b9634 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:22:59.251718 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-43b316df-013d-4060-be43-1465787b9634 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:22:59.252609 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-43b316df-013d-4060-be43-1465787b9634 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:22:59.253098 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-43b316df-013d-4060-be43-1465787b9634 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:22:59.385907 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-43b316df-013d-4060-be43-1465787b9634 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action" status: 200 len: 38188 microversion: 2.1 time: 0.153148 Dec 16 15:22:59.386957 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1013/2019] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 15:22:59 2021] POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action => generated 38188 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:23:00.403097 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-9f21d2d7-897f-4dbc-8095-5f4e52daecdf tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:23:00.404251 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-9f21d2d7-897f-4dbc-8095-5f4e52daecdf tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 4feaa08e-6919-4701-ab0e-481fe18c9abd] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:23:00.413816 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9f21d2d7-897f-4dbc-8095-5f4e52daecdf tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:23:00.414380 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9f21d2d7-897f-4dbc-8095-5f4e52daecdf tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:23:00.415241 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9f21d2d7-897f-4dbc-8095-5f4e52daecdf tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:23:00.415736 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9f21d2d7-897f-4dbc-8095-5f4e52daecdf tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:23:00.560568 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-9f21d2d7-897f-4dbc-8095-5f4e52daecdf tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action" status: 200 len: 38188 microversion: 2.1 time: 0.165151 Dec 16 15:23:00.561686 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1007/2020] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 15:23:00 2021] POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action => generated 38188 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:23:01.583771 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-9bbce18c-dc74-4374-86e2-a4dd386d03a6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:23:01.585285 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-9bbce18c-dc74-4374-86e2-a4dd386d03a6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 4feaa08e-6919-4701-ab0e-481fe18c9abd] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:23:01.596944 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9bbce18c-dc74-4374-86e2-a4dd386d03a6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:23:01.597608 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9bbce18c-dc74-4374-86e2-a4dd386d03a6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:23:01.598799 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9bbce18c-dc74-4374-86e2-a4dd386d03a6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:23:01.599401 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9bbce18c-dc74-4374-86e2-a4dd386d03a6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:23:01.751843 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-9bbce18c-dc74-4374-86e2-a4dd386d03a6 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action" status: 200 len: 38317 microversion: 2.1 time: 0.179996 Dec 16 15:23:01.753945 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1014/2021] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 15:23:01 2021] POST /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/action => generated 38317 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 16 15:23:01.768811 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-edb58080-e28a-42cf-91b8-e64ff7283b12 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:23:01.769460 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-edb58080-e28a-42cf-91b8-e64ff7283b12 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 4feaa08e-6919-4701-ab0e-481fe18c9abd] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:23:01.778374 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-edb58080-e28a-42cf-91b8-e64ff7283b12 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:23:01.778892 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-edb58080-e28a-42cf-91b8-e64ff7283b12 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:23:01.779762 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-edb58080-e28a-42cf-91b8-e64ff7283b12 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:23:01.780263 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-edb58080-e28a-42cf-91b8-e64ff7283b12 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:23:01.848318 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-edb58080-e28a-42cf-91b8-e64ff7283b12 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/ips" status: 200 len: 145 microversion: 2.1 time: 0.088378 Dec 16 15:23:01.848861 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1008/2022] 10.222.0.45 () {58 vars in 1238 bytes} [Thu Dec 16 15:23:01 2021] GET /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd/ips => generated 145 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:25:57.775219 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-ec7b3b32-7f28-4d71-b19d-fa70dbd9c832 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:25:57.775956 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-ec7b3b32-7f28-4d71-b19d-fa70dbd9c832 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:25:57.779677 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c006f2bf-d7e6-4bb8-aace-c3797b4b538d] AMQP server on 10.222.0.45:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 15:25:57.780260 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 15:25:57.780463 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: Thu Dec 16 15:25:57 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac (ip 10.222.0.45) !!! Dec 16 15:25:57.791674 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Dec 16 15:25:57.791964 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: Thu Dec 16 15:25:57 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac (ip 10.222.0.45) !!! Dec 16 15:25:57.802887 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 15:25:57.803030 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: Thu Dec 16 15:25:57 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac (ip 10.222.0.45) !!! Dec 16 15:25:57.836314 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ec7b3b32-7f28-4d71-b19d-fa70dbd9c832 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:25:57.836314 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ec7b3b32-7f28-4d71-b19d-fa70dbd9c832 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:25:57.836314 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ec7b3b32-7f28-4d71-b19d-fa70dbd9c832 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:25:57.836314 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ec7b3b32-7f28-4d71-b19d-fa70dbd9c832 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:25:57.896910 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.wsgi [None req-ec7b3b32-7f28-4d71-b19d-fa70dbd9c832 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] HTTP exception thrown: Instance cd5ffc87-035a-4e91-8fb5-8e44ed5704ac could not be found. Dec 16 15:25:57.897554 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-ec7b3b32-7f28-4d71-b19d-fa70dbd9c832 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Returning 404 to user: Instance cd5ffc87-035a-4e91-8fb5-8e44ed5704ac could not be found. {{(pid=101356) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:941}} Dec 16 15:25:57.898521 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-ec7b3b32-7f28-4d71-b19d-fa70dbd9c832 tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "DELETE /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 404 len: 111 microversion: 2.20 time: 0.132267 Dec 16 15:25:57.899179 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1015/2023] 10.222.0.45 () {60 vars in 1270 bytes} [Thu Dec 16 15:25:57 2021] DELETE /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 16 15:25:57.921543 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-c28e9680-66cf-457c-9f19-6334ac1e46bf tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:25:57.922176 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-c28e9680-66cf-457c-9f19-6334ac1e46bf tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] [instance: cd5ffc87-035a-4e91-8fb5-8e44ed5704ac] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:25:57.926423 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c89047bd-5046-4dc5-81a4-5f3a093a9e0b] AMQP server on 10.222.0.45:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 15:25:57.927108 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Dec 16 15:25:57.927851 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: Thu Dec 16 15:25:57 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac (ip 10.222.0.45) !!! Dec 16 15:25:57.939192 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 15:25:57.939500 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: Thu Dec 16 15:25:57 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac (ip 10.222.0.45) !!! Dec 16 15:25:57.950687 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 15:25:57.950965 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: Thu Dec 16 15:25:57 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac (ip 10.222.0.45) !!! Dec 16 15:25:57.971324 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c28e9680-66cf-457c-9f19-6334ac1e46bf tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:25:57.971837 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c28e9680-66cf-457c-9f19-6334ac1e46bf tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:25:57.972710 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c28e9680-66cf-457c-9f19-6334ac1e46bf tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:25:57.973212 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c28e9680-66cf-457c-9f19-6334ac1e46bf tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:25:58.029443 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.wsgi [None req-c28e9680-66cf-457c-9f19-6334ac1e46bf tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] HTTP exception thrown: Instance cd5ffc87-035a-4e91-8fb5-8e44ed5704ac could not be found. Dec 16 15:25:58.030145 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-c28e9680-66cf-457c-9f19-6334ac1e46bf tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] Returning 404 to user: Instance cd5ffc87-035a-4e91-8fb5-8e44ed5704ac could not be found. {{(pid=101355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:941}} Dec 16 15:25:58.031068 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-c28e9680-66cf-457c-9f19-6334ac1e46bf tempest-AttachVolumeShelveTestJSON-280683784 tempest-AttachVolumeShelveTestJSON-280683784-project] 10.222.0.45 "GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac" status: 404 len: 111 microversion: 2.20 time: 0.125836 Dec 16 15:25:58.031701 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1009/2024] 10.222.0.45 () {60 vars in 1267 bytes} [Thu Dec 16 15:25:57 2021] GET /compute/v2.1/servers/cd5ffc87-035a-4e91-8fb5-8e44ed5704ac => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 16 15:26:10.606508 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO oslo.messaging._drivers.impl_rabbit [-] [c006f2bf-d7e6-4bb8-aace-c3797b4b538d] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 57076. Dec 16 15:26:10.779429 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-419881b9-5af4-4b42-a851-c7b106edf484 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1415798086", "imageRef": "9b00ff4e-db72-4324-820b-87a6bd73b055", "flavorRef": "452", "networks": [{"uuid": "93ae9bca-879a-41a2-8378-cb0164469bca"}]}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:26:11.034755 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.network.neutron [None req-419881b9-5af4-4b42-a851-c7b106edf484 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] validate_networks() for [('93ae9bca-879a-41a2-8378-cb0164469bca', None, None, None)] {{(pid=101356) validate_networks /opt/stack/nova/nova/network/neutron.py:2383}} Dec 16 15:26:11.678117 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.virt.hardware [None req-419881b9-5af4-4b42-a851-c7b106edf484 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Flavor limits 0:0:0 {{(pid=101356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:338}} Dec 16 15:26:11.678592 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.virt.hardware [None req-419881b9-5af4-4b42-a851-c7b106edf484 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Image limits 0:0:0 {{(pid=101356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:342}} Dec 16 15:26:11.679140 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.virt.hardware [None req-419881b9-5af4-4b42-a851-c7b106edf484 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Flavor pref 0:0:0 {{(pid=101356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:378}} Dec 16 15:26:11.679676 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.virt.hardware [None req-419881b9-5af4-4b42-a851-c7b106edf484 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Image pref 0:0:0 {{(pid=101356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:382}} Dec 16 15:26:11.680254 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.virt.hardware [None req-419881b9-5af4-4b42-a851-c7b106edf484 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=101356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:422}} Dec 16 15:26:11.689919 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-419881b9-5af4-4b42-a851-c7b106edf484 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:26:11.690432 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-419881b9-5af4-4b42-a851-c7b106edf484 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:26:11.691307 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-419881b9-5af4-4b42-a851-c7b106edf484 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:26:11.691795 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-419881b9-5af4-4b42-a851-c7b106edf484 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:26:11.714080 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.quota [None req-419881b9-5af4-4b42-a851-c7b106edf484 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Getting quotas for project 962338c57e5c46ef84460b3dc1a0afea. Resources: {'ram', 'instances', 'cores'} {{(pid=101356) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 16 15:26:11.723590 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.quota [None req-419881b9-5af4-4b42-a851-c7b106edf484 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Getting quotas for user f509993aaae6478b92d6e5caaf2a7dec and project 962338c57e5c46ef84460b3dc1a0afea. Resources: {'ram', 'instances', 'cores'} {{(pid=101356) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 16 15:26:11.740261 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-419881b9-5af4-4b42-a851-c7b106edf484 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Going to run 1 instances... {{(pid=101356) _provision_instances /opt/stack/nova/nova/compute/api.py:1224}} Dec 16 15:26:11.743044 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-419881b9-5af4-4b42-a851-c7b106edf484 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: c47a38ca-4ce3-4387-af13-dc2d25144f8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9b00ff4e-db72-4324-820b-87a6bd73b055',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101356) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1616}} Dec 16 15:26:11.847969 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-419881b9-5af4-4b42-a851-c7b106edf484 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.262849 Dec 16 15:26:11.848676 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1016/2025] 10.222.0.45 () {60 vars in 1137 bytes} [Thu Dec 16 15:26:10 2021] POST /compute/v2.1/servers => generated 380 bytes in 1264 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 16 15:26:11.871532 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-b3649e8e-67e1-4130-a589-7c43e8cc95fe tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:26:11.871532 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-b3649e8e-67e1-4130-a589-7c43e8cc95fe tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: c47a38ca-4ce3-4387-af13-dc2d25144f8c] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:26:11.913692 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO oslo.messaging._drivers.impl_rabbit [-] [c89047bd-5046-4dc5-81a4-5f3a093a9e0b] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 57104. Dec 16 15:26:12.062581 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-b3649e8e-67e1-4130-a589-7c43e8cc95fe tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f509993aaae6478b92d6e5caaf2a7dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962338c57e5c46ef84460b3dc1a0afea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:26:12.072286 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-b3649e8e-67e1-4130-a589-7c43e8cc95fe tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "GET /compute/v2.1/servers/c47a38ca-4ce3-4387-af13-dc2d25144f8c" status: 200 len: 1218 microversion: 2.1 time: 0.210514 Dec 16 15:26:12.072911 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1010/2026] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:26:11 2021] GET /compute/v2.1/servers/c47a38ca-4ce3-4387-af13-dc2d25144f8c => generated 1218 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:26:13.094807 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-58726660-1749-483e-97d0-9ab0f3eee005 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:26:13.095485 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-58726660-1749-483e-97d0-9ab0f3eee005 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: c47a38ca-4ce3-4387-af13-dc2d25144f8c] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:26:13.104565 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-58726660-1749-483e-97d0-9ab0f3eee005 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:26:13.105141 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-58726660-1749-483e-97d0-9ab0f3eee005 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:26:13.106010 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-58726660-1749-483e-97d0-9ab0f3eee005 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:26:13.106540 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-58726660-1749-483e-97d0-9ab0f3eee005 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:26:13.269951 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-58726660-1749-483e-97d0-9ab0f3eee005 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f509993aaae6478b92d6e5caaf2a7dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962338c57e5c46ef84460b3dc1a0afea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:26:13.280631 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-58726660-1749-483e-97d0-9ab0f3eee005 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "GET /compute/v2.1/servers/c47a38ca-4ce3-4387-af13-dc2d25144f8c" status: 200 len: 1214 microversion: 2.1 time: 0.193466 Dec 16 15:26:13.281528 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1017/2027] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:26:13 2021] GET /compute/v2.1/servers/c47a38ca-4ce3-4387-af13-dc2d25144f8c => generated 1214 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:26:14.304597 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-a4c63103-080d-42cd-87c8-eb2712b680e9 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:26:14.305277 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-a4c63103-080d-42cd-87c8-eb2712b680e9 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: c47a38ca-4ce3-4387-af13-dc2d25144f8c] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:26:14.323493 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a4c63103-080d-42cd-87c8-eb2712b680e9 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:26:14.324018 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a4c63103-080d-42cd-87c8-eb2712b680e9 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:26:14.325331 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a4c63103-080d-42cd-87c8-eb2712b680e9 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:26:14.325836 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a4c63103-080d-42cd-87c8-eb2712b680e9 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:26:14.529650 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-a4c63103-080d-42cd-87c8-eb2712b680e9 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f509993aaae6478b92d6e5caaf2a7dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962338c57e5c46ef84460b3dc1a0afea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:26:14.539824 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-a4c63103-080d-42cd-87c8-eb2712b680e9 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "GET /compute/v2.1/servers/c47a38ca-4ce3-4387-af13-dc2d25144f8c" status: 200 len: 1288 microversion: 2.1 time: 0.242770 Dec 16 15:26:14.540430 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1011/2028] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:26:14 2021] GET /compute/v2.1/servers/c47a38ca-4ce3-4387-af13-dc2d25144f8c => generated 1288 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:26:15.568955 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-5c1f490b-50ef-455c-8632-226ceb95a31a tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:26:15.569663 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-5c1f490b-50ef-455c-8632-226ceb95a31a tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: c47a38ca-4ce3-4387-af13-dc2d25144f8c] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:26:15.578136 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5c1f490b-50ef-455c-8632-226ceb95a31a tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:26:15.578660 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5c1f490b-50ef-455c-8632-226ceb95a31a tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:26:15.579512 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5c1f490b-50ef-455c-8632-226ceb95a31a tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:26:15.580008 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5c1f490b-50ef-455c-8632-226ceb95a31a tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:26:15.883769 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-5c1f490b-50ef-455c-8632-226ceb95a31a tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f509993aaae6478b92d6e5caaf2a7dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962338c57e5c46ef84460b3dc1a0afea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:26:15.896500 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-5c1f490b-50ef-455c-8632-226ceb95a31a tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "GET /compute/v2.1/servers/c47a38ca-4ce3-4387-af13-dc2d25144f8c" status: 200 len: 1318 microversion: 2.1 time: 0.342271 Dec 16 15:26:15.897144 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1018/2029] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:26:15 2021] GET /compute/v2.1/servers/c47a38ca-4ce3-4387-af13-dc2d25144f8c => generated 1318 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:26:16.439477 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [req-ea1a68c2-7ab8-4978-a63a-1b5d3a2a8f94 req-15155d51-02d3-4e68-9516-4ce92784d280 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c47a38ca-4ce3-4387-af13-dc2d25144f8c", "tag": "6ff8ff40-8129-456e-a634-61bb3c8a183c"}]} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:26:16.444153 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:26:16.444153 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: warnings.warn(msg) Dec 16 15:26:16.453238 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-ea1a68c2-7ab8-4978-a63a-1b5d3a2a8f94 req-15155d51-02d3-4e68-9516-4ce92784d280 service nova] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:26:16.453742 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-ea1a68c2-7ab8-4978-a63a-1b5d3a2a8f94 req-15155d51-02d3-4e68-9516-4ce92784d280 service nova] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:26:16.471384 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.compute.server_external_events [req-ea1a68c2-7ab8-4978-a63a-1b5d3a2a8f94 req-15155d51-02d3-4e68-9516-4ce92784d280 service nova] Creating event network-changed:6ff8ff40-8129-456e-a634-61bb3c8a183c for instance c47a38ca-4ce3-4387-af13-dc2d25144f8c on hv-cinder-82189 Dec 16 15:26:16.478470 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [req-ea1a68c2-7ab8-4978-a63a-1b5d3a2a8f94 req-15155d51-02d3-4e68-9516-4ce92784d280 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135566 Dec 16 15:26:16.479252 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1012/2030] 10.222.0.45 () {64 vars in 1308 bytes} [Thu Dec 16 15:26:16 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 15:26:16.920246 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-6aab1aad-f9af-4d87-8cb6-45eec9eb1b1b tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:26:16.920925 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-6aab1aad-f9af-4d87-8cb6-45eec9eb1b1b tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: c47a38ca-4ce3-4387-af13-dc2d25144f8c] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:26:16.930942 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6aab1aad-f9af-4d87-8cb6-45eec9eb1b1b tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:26:16.931483 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6aab1aad-f9af-4d87-8cb6-45eec9eb1b1b tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:26:16.932504 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6aab1aad-f9af-4d87-8cb6-45eec9eb1b1b tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:26:16.932997 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6aab1aad-f9af-4d87-8cb6-45eec9eb1b1b tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:26:17.174102 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-6aab1aad-f9af-4d87-8cb6-45eec9eb1b1b tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f509993aaae6478b92d6e5caaf2a7dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962338c57e5c46ef84460b3dc1a0afea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:26:17.184287 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-6aab1aad-f9af-4d87-8cb6-45eec9eb1b1b tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "GET /compute/v2.1/servers/c47a38ca-4ce3-4387-af13-dc2d25144f8c" status: 200 len: 1318 microversion: 2.1 time: 0.271720 Dec 16 15:26:17.184919 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1019/2031] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:26:16 2021] GET /compute/v2.1/servers/c47a38ca-4ce3-4387-af13-dc2d25144f8c => generated 1318 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:26:18.206200 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-ebd0b18a-09e3-4567-bb7d-a4e4e32718b8 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:26:18.207195 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-ebd0b18a-09e3-4567-bb7d-a4e4e32718b8 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: c47a38ca-4ce3-4387-af13-dc2d25144f8c] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:26:18.216876 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ebd0b18a-09e3-4567-bb7d-a4e4e32718b8 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:26:18.217382 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ebd0b18a-09e3-4567-bb7d-a4e4e32718b8 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:26:18.218272 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ebd0b18a-09e3-4567-bb7d-a4e4e32718b8 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:26:18.218766 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ebd0b18a-09e3-4567-bb7d-a4e4e32718b8 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:26:18.514357 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-ebd0b18a-09e3-4567-bb7d-a4e4e32718b8 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f509993aaae6478b92d6e5caaf2a7dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962338c57e5c46ef84460b3dc1a0afea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:26:18.524162 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-ebd0b18a-09e3-4567-bb7d-a4e4e32718b8 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "GET /compute/v2.1/servers/c47a38ca-4ce3-4387-af13-dc2d25144f8c" status: 200 len: 1318 microversion: 2.1 time: 0.325703 Dec 16 15:26:18.524769 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1013/2032] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:26:18 2021] GET /compute/v2.1/servers/c47a38ca-4ce3-4387-af13-dc2d25144f8c => generated 1318 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:26:19.546088 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-3dc5035c-3ea9-4566-891b-b4d17c4c019b tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:26:19.546810 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-3dc5035c-3ea9-4566-891b-b4d17c4c019b tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: c47a38ca-4ce3-4387-af13-dc2d25144f8c] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:26:19.555017 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3dc5035c-3ea9-4566-891b-b4d17c4c019b tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:26:19.555512 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3dc5035c-3ea9-4566-891b-b4d17c4c019b tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:26:19.556343 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3dc5035c-3ea9-4566-891b-b4d17c4c019b tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:26:19.556838 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3dc5035c-3ea9-4566-891b-b4d17c4c019b tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:26:19.796266 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-3dc5035c-3ea9-4566-891b-b4d17c4c019b tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f509993aaae6478b92d6e5caaf2a7dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962338c57e5c46ef84460b3dc1a0afea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:26:19.805998 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-3dc5035c-3ea9-4566-891b-b4d17c4c019b tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "GET /compute/v2.1/servers/c47a38ca-4ce3-4387-af13-dc2d25144f8c" status: 200 len: 1318 microversion: 2.1 time: 0.267811 Dec 16 15:26:19.806654 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1020/2033] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:26:19 2021] GET /compute/v2.1/servers/c47a38ca-4ce3-4387-af13-dc2d25144f8c => generated 1318 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:26:20.827780 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-ee7f60f3-2f9d-486e-a15e-c5b9acd87c49 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:26:20.828443 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-ee7f60f3-2f9d-486e-a15e-c5b9acd87c49 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: c47a38ca-4ce3-4387-af13-dc2d25144f8c] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:26:20.836512 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ee7f60f3-2f9d-486e-a15e-c5b9acd87c49 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:26:20.837013 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ee7f60f3-2f9d-486e-a15e-c5b9acd87c49 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:26:20.837885 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ee7f60f3-2f9d-486e-a15e-c5b9acd87c49 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:26:20.838403 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ee7f60f3-2f9d-486e-a15e-c5b9acd87c49 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:26:21.058934 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-ee7f60f3-2f9d-486e-a15e-c5b9acd87c49 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f509993aaae6478b92d6e5caaf2a7dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962338c57e5c46ef84460b3dc1a0afea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:26:21.067885 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-ee7f60f3-2f9d-486e-a15e-c5b9acd87c49 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "GET /compute/v2.1/servers/c47a38ca-4ce3-4387-af13-dc2d25144f8c" status: 200 len: 1318 microversion: 2.1 time: 0.247818 Dec 16 15:26:21.068502 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1014/2034] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:26:20 2021] GET /compute/v2.1/servers/c47a38ca-4ce3-4387-af13-dc2d25144f8c => generated 1318 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:26:22.091507 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-108d88e7-8d7c-4c7e-94a4-a4b48478b6ff tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:26:22.092189 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-108d88e7-8d7c-4c7e-94a4-a4b48478b6ff tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: c47a38ca-4ce3-4387-af13-dc2d25144f8c] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:26:22.100484 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-108d88e7-8d7c-4c7e-94a4-a4b48478b6ff tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:26:22.100997 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-108d88e7-8d7c-4c7e-94a4-a4b48478b6ff tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:26:22.101843 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-108d88e7-8d7c-4c7e-94a4-a4b48478b6ff tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:26:22.102340 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-108d88e7-8d7c-4c7e-94a4-a4b48478b6ff tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:26:22.327941 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-108d88e7-8d7c-4c7e-94a4-a4b48478b6ff tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f509993aaae6478b92d6e5caaf2a7dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962338c57e5c46ef84460b3dc1a0afea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:26:22.337851 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-108d88e7-8d7c-4c7e-94a4-a4b48478b6ff tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "GET /compute/v2.1/servers/c47a38ca-4ce3-4387-af13-dc2d25144f8c" status: 200 len: 1318 microversion: 2.1 time: 0.254017 Dec 16 15:26:22.338535 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1021/2035] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:26:22 2021] GET /compute/v2.1/servers/c47a38ca-4ce3-4387-af13-dc2d25144f8c => generated 1318 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:26:23.361099 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-70669545-f579-41d0-b7d0-fde8efb4d6db tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:26:23.361817 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-70669545-f579-41d0-b7d0-fde8efb4d6db tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: c47a38ca-4ce3-4387-af13-dc2d25144f8c] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:26:23.371312 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-70669545-f579-41d0-b7d0-fde8efb4d6db tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:26:23.371886 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-70669545-f579-41d0-b7d0-fde8efb4d6db tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:26:23.373312 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-70669545-f579-41d0-b7d0-fde8efb4d6db tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:26:23.373463 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-70669545-f579-41d0-b7d0-fde8efb4d6db tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:26:23.616803 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-70669545-f579-41d0-b7d0-fde8efb4d6db tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f509993aaae6478b92d6e5caaf2a7dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962338c57e5c46ef84460b3dc1a0afea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:26:23.626265 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-70669545-f579-41d0-b7d0-fde8efb4d6db tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "GET /compute/v2.1/servers/c47a38ca-4ce3-4387-af13-dc2d25144f8c" status: 200 len: 1318 microversion: 2.1 time: 0.274311 Dec 16 15:26:23.626888 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1015/2036] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:26:23 2021] GET /compute/v2.1/servers/c47a38ca-4ce3-4387-af13-dc2d25144f8c => generated 1318 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:26:24.080708 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [req-29b94057-e59a-4462-888c-d8d4b61f4f9f req-e6631172-5649-44c4-9b8a-2347b5198f68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c47a38ca-4ce3-4387-af13-dc2d25144f8c", "name": "network-vif-plugged", "status": "completed", "tag": "6ff8ff40-8129-456e-a634-61bb3c8a183c"}]} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:26:24.085666 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:26:24.085666 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: warnings.warn(msg) Dec 16 15:26:24.095502 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-29b94057-e59a-4462-888c-d8d4b61f4f9f req-e6631172-5649-44c4-9b8a-2347b5198f68 service nova] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:26:24.096002 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-29b94057-e59a-4462-888c-d8d4b61f4f9f req-e6631172-5649-44c4-9b8a-2347b5198f68 service nova] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:26:24.115193 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.compute.server_external_events [req-29b94057-e59a-4462-888c-d8d4b61f4f9f req-e6631172-5649-44c4-9b8a-2347b5198f68 service nova] Creating event network-vif-plugged:6ff8ff40-8129-456e-a634-61bb3c8a183c for instance c47a38ca-4ce3-4387-af13-dc2d25144f8c on hv-cinder-82189 Dec 16 15:26:24.121617 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [req-29b94057-e59a-4462-888c-d8d4b61f4f9f req-e6631172-5649-44c4-9b8a-2347b5198f68 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048613 Dec 16 15:26:24.122744 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1022/2037] 10.222.0.45 () {64 vars in 1308 bytes} [Thu Dec 16 15:26:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:26:24.648483 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-e37bbe2d-a802-45d5-9116-35fbfc140f60 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:26:24.649830 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-e37bbe2d-a802-45d5-9116-35fbfc140f60 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: c47a38ca-4ce3-4387-af13-dc2d25144f8c] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:26:24.658638 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e37bbe2d-a802-45d5-9116-35fbfc140f60 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:26:24.659456 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e37bbe2d-a802-45d5-9116-35fbfc140f60 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:26:24.660478 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e37bbe2d-a802-45d5-9116-35fbfc140f60 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:26:24.660971 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e37bbe2d-a802-45d5-9116-35fbfc140f60 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:26:24.894197 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-e37bbe2d-a802-45d5-9116-35fbfc140f60 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f509993aaae6478b92d6e5caaf2a7dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962338c57e5c46ef84460b3dc1a0afea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:26:24.903395 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-e37bbe2d-a802-45d5-9116-35fbfc140f60 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "GET /compute/v2.1/servers/c47a38ca-4ce3-4387-af13-dc2d25144f8c" status: 200 len: 1318 microversion: 2.1 time: 0.262721 Dec 16 15:26:24.904068 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1016/2038] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:26:24 2021] GET /compute/v2.1/servers/c47a38ca-4ce3-4387-af13-dc2d25144f8c => generated 1318 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:26:25.929890 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-c6778171-525f-4e71-aa6d-40c836cd8445 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:26:25.931128 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-c6778171-525f-4e71-aa6d-40c836cd8445 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: c47a38ca-4ce3-4387-af13-dc2d25144f8c] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:26:25.939299 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c6778171-525f-4e71-aa6d-40c836cd8445 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:26:25.939803 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c6778171-525f-4e71-aa6d-40c836cd8445 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:26:25.940630 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c6778171-525f-4e71-aa6d-40c836cd8445 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:26:25.941114 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c6778171-525f-4e71-aa6d-40c836cd8445 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:26:26.166834 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-c6778171-525f-4e71-aa6d-40c836cd8445 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f509993aaae6478b92d6e5caaf2a7dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962338c57e5c46ef84460b3dc1a0afea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:26:26.176119 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-c6778171-525f-4e71-aa6d-40c836cd8445 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "GET /compute/v2.1/servers/c47a38ca-4ce3-4387-af13-dc2d25144f8c" status: 200 len: 1318 microversion: 2.1 time: 0.255988 Dec 16 15:26:26.176718 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1023/2039] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:26:25 2021] GET /compute/v2.1/servers/c47a38ca-4ce3-4387-af13-dc2d25144f8c => generated 1318 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:26:27.197760 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-361e656f-acb1-497f-8e36-501a69f4eaf9 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:26:27.198458 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-361e656f-acb1-497f-8e36-501a69f4eaf9 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: c47a38ca-4ce3-4387-af13-dc2d25144f8c] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:26:27.207004 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-361e656f-acb1-497f-8e36-501a69f4eaf9 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:26:27.207517 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-361e656f-acb1-497f-8e36-501a69f4eaf9 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:26:27.208411 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-361e656f-acb1-497f-8e36-501a69f4eaf9 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:26:27.208905 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-361e656f-acb1-497f-8e36-501a69f4eaf9 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:26:27.437177 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-361e656f-acb1-497f-8e36-501a69f4eaf9 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f509993aaae6478b92d6e5caaf2a7dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962338c57e5c46ef84460b3dc1a0afea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:26:27.446366 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-361e656f-acb1-497f-8e36-501a69f4eaf9 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "GET /compute/v2.1/servers/c47a38ca-4ce3-4387-af13-dc2d25144f8c" status: 200 len: 1508 microversion: 2.1 time: 0.256240 Dec 16 15:26:27.446981 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1017/2040] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:26:27 2021] GET /compute/v2.1/servers/c47a38ca-4ce3-4387-af13-dc2d25144f8c => generated 1508 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:29:02.785482 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-77a3089c-3d16-4c72-b949-a19af5d10132 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:29:02.786131 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-77a3089c-3d16-4c72-b949-a19af5d10132 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 4feaa08e-6919-4701-ab0e-481fe18c9abd] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:29:02.790324 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Dec 16 15:29:02.790535 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: Thu Dec 16 15:29:02 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd (ip 10.222.0.45) !!! Dec 16 15:29:02.801339 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Dec 16 15:29:02.801487 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: Thu Dec 16 15:29:02 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd (ip 10.222.0.45) !!! Dec 16 15:29:02.812540 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Dec 16 15:29:02.812675 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: Thu Dec 16 15:29:02 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd (ip 10.222.0.45) !!! Dec 16 15:29:02.831767 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-77a3089c-3d16-4c72-b949-a19af5d10132 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:29:02.832282 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-77a3089c-3d16-4c72-b949-a19af5d10132 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:29:02.833183 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-77a3089c-3d16-4c72-b949-a19af5d10132 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:29:02.833633 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-77a3089c-3d16-4c72-b949-a19af5d10132 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:29:02.903047 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-77a3089c-3d16-4c72-b949-a19af5d10132 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 4feaa08e-6919-4701-ab0e-481fe18c9abd] Going to try to terminate instance {{(pid=101356) delete /opt/stack/nova/nova/compute/api.py:2496}} Dec 16 15:29:03.129882 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-77a3089c-3d16-4c72-b949-a19af5d10132 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "DELETE /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd" status: 204 len: 0 microversion: 2.1 time: 0.351664 Dec 16 15:29:03.130533 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1024/2041] 10.222.0.45 () {58 vars in 1229 bytes} [Thu Dec 16 15:29:02 2021] DELETE /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 16 15:29:03.143454 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-610cfc95-27c4-4508-a832-71dea532f343 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:29:03.144174 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-610cfc95-27c4-4508-a832-71dea532f343 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 4feaa08e-6919-4701-ab0e-481fe18c9abd] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:29:03.147687 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Dec 16 15:29:03.147855 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: Thu Dec 16 15:29:03 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd (ip 10.222.0.45) !!! Dec 16 15:29:03.160033 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Dec 16 15:29:03.160186 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: Thu Dec 16 15:29:03 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd (ip 10.222.0.45) !!! Dec 16 15:29:03.170889 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Dec 16 15:29:03.171013 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: Thu Dec 16 15:29:03 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd (ip 10.222.0.45) !!! Dec 16 15:29:03.190366 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-610cfc95-27c4-4508-a832-71dea532f343 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:29:03.190887 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-610cfc95-27c4-4508-a832-71dea532f343 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:29:03.191751 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-610cfc95-27c4-4508-a832-71dea532f343 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:29:03.192253 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-610cfc95-27c4-4508-a832-71dea532f343 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:29:03.416893 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-610cfc95-27c4-4508-a832-71dea532f343 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:29:03.426063 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-610cfc95-27c4-4508-a832-71dea532f343 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd" status: 200 len: 1671 microversion: 2.1 time: 0.290117 Dec 16 15:29:03.426938 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1018/2042] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:29:03 2021] GET /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd => generated 1671 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:29:04.448451 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-11fa1fc1-45bb-4c3a-9708-e27a8b43bcd4 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:29:04.449205 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-11fa1fc1-45bb-4c3a-9708-e27a8b43bcd4 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 4feaa08e-6919-4701-ab0e-481fe18c9abd] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:29:04.456888 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-11fa1fc1-45bb-4c3a-9708-e27a8b43bcd4 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:29:04.457365 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-11fa1fc1-45bb-4c3a-9708-e27a8b43bcd4 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:29:04.458238 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-11fa1fc1-45bb-4c3a-9708-e27a8b43bcd4 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:29:04.458721 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-11fa1fc1-45bb-4c3a-9708-e27a8b43bcd4 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:29:04.705613 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-11fa1fc1-45bb-4c3a-9708-e27a8b43bcd4 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:29:04.715366 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-11fa1fc1-45bb-4c3a-9708-e27a8b43bcd4 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd" status: 200 len: 1671 microversion: 2.1 time: 0.275416 Dec 16 15:29:04.716131 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1025/2043] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:29:04 2021] GET /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd => generated 1671 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:29:05.740231 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-930ac7b7-c314-4dcc-9e01-3886f13e9be1 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:29:05.741418 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-930ac7b7-c314-4dcc-9e01-3886f13e9be1 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 4feaa08e-6919-4701-ab0e-481fe18c9abd] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:29:05.750290 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-930ac7b7-c314-4dcc-9e01-3886f13e9be1 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:29:05.751092 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-930ac7b7-c314-4dcc-9e01-3886f13e9be1 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:29:05.752148 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-930ac7b7-c314-4dcc-9e01-3886f13e9be1 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:29:05.752826 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-930ac7b7-c314-4dcc-9e01-3886f13e9be1 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:29:05.936216 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-930ac7b7-c314-4dcc-9e01-3886f13e9be1 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:29:05.955909 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-930ac7b7-c314-4dcc-9e01-3886f13e9be1 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd" status: 200 len: 1604 microversion: 2.1 time: 0.219988 Dec 16 15:29:05.956794 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1019/2044] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:29:05 2021] GET /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd => generated 1604 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:29:06.088589 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [req-07daa0d1-ef4b-4138-b8a6-323342d2629b req-fbd53fc9-8a52-4794-ac92-267345fc3264 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4feaa08e-6919-4701-ab0e-481fe18c9abd", "name": "network-vif-deleted", "tag": "84f4680a-3a41-4a40-9524-1dc9ba8f12ec"}]} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:29:06.093526 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:29:06.093526 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: warnings.warn(msg) Dec 16 15:29:06.103731 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-07daa0d1-ef4b-4138-b8a6-323342d2629b req-fbd53fc9-8a52-4794-ac92-267345fc3264 service nova] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:29:06.104208 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-07daa0d1-ef4b-4138-b8a6-323342d2629b req-fbd53fc9-8a52-4794-ac92-267345fc3264 service nova] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:29:06.123700 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.compute.server_external_events [req-07daa0d1-ef4b-4138-b8a6-323342d2629b req-fbd53fc9-8a52-4794-ac92-267345fc3264 service nova] Creating event network-vif-deleted:84f4680a-3a41-4a40-9524-1dc9ba8f12ec for instance 4feaa08e-6919-4701-ab0e-481fe18c9abd on hv-cinder-82189 Dec 16 15:29:06.129238 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [req-07daa0d1-ef4b-4138-b8a6-323342d2629b req-fbd53fc9-8a52-4794-ac92-267345fc3264 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048793 Dec 16 15:29:06.129906 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1026/2045] 10.222.0.45 () {64 vars in 1308 bytes} [Thu Dec 16 15:29:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:29:06.979742 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-20e65ab9-8379-44d1-99dd-7b93543ea3f1 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:29:06.980403 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-20e65ab9-8379-44d1-99dd-7b93543ea3f1 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 4feaa08e-6919-4701-ab0e-481fe18c9abd] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:29:06.988542 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-20e65ab9-8379-44d1-99dd-7b93543ea3f1 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:29:06.989251 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-20e65ab9-8379-44d1-99dd-7b93543ea3f1 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:29:06.990829 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-20e65ab9-8379-44d1-99dd-7b93543ea3f1 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:29:06.991311 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-20e65ab9-8379-44d1-99dd-7b93543ea3f1 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:29:07.123370 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-20e65ab9-8379-44d1-99dd-7b93543ea3f1 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:29:07.123370 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-20e65ab9-8379-44d1-99dd-7b93543ea3f1 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:29:07.123617 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.objects.instance [None req-20e65ab9-8379-44d1-99dd-7b93543ea3f1 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lazy-loading 'fault' on Instance uuid 4feaa08e-6919-4701-ab0e-481fe18c9abd {{(pid=101355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 16 15:29:07.230245 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-20e65ab9-8379-44d1-99dd-7b93543ea3f1 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb128a53e7f4e1187d0f6e2f4c4978f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe152d649f134d28bec6b87e62973916', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:29:07.239147 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-20e65ab9-8379-44d1-99dd-7b93543ea3f1 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd" status: 200 len: 1326 microversion: 2.1 time: 0.267519 Dec 16 15:29:07.239772 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1020/2046] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:29:06 2021] GET /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd => generated 1326 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:29:08.262229 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-ec26cd1b-ac82-47fa-bfb1-dd34731a9ea5 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:29:08.263014 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-ec26cd1b-ac82-47fa-bfb1-dd34731a9ea5 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 4feaa08e-6919-4701-ab0e-481fe18c9abd] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:29:08.272018 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ec26cd1b-ac82-47fa-bfb1-dd34731a9ea5 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:29:08.272528 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ec26cd1b-ac82-47fa-bfb1-dd34731a9ea5 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:29:08.273388 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ec26cd1b-ac82-47fa-bfb1-dd34731a9ea5 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:29:08.273883 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ec26cd1b-ac82-47fa-bfb1-dd34731a9ea5 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:29:08.328260 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.wsgi [None req-ec26cd1b-ac82-47fa-bfb1-dd34731a9ea5 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] HTTP exception thrown: Instance 4feaa08e-6919-4701-ab0e-481fe18c9abd could not be found. Dec 16 15:29:08.328931 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-ec26cd1b-ac82-47fa-bfb1-dd34731a9ea5 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Returning 404 to user: Instance 4feaa08e-6919-4701-ab0e-481fe18c9abd could not be found. {{(pid=101356) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:941}} Dec 16 15:29:08.329838 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-ec26cd1b-ac82-47fa-bfb1-dd34731a9ea5 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd" status: 404 len: 111 microversion: 2.1 time: 0.076526 Dec 16 15:29:08.330487 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1027/2047] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:29:08 2021] GET /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 15:29:08.343051 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-3598fbeb-a82a-4df9-929a-dd8a21db185b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '.version_select at 0x7f14f736bd90>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:29:08.401976 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-3598fbeb-a82a-4df9-929a-dd8a21db185b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-449774111" status: 202 len: 0 microversion: 2.1 time: 0.066465 Dec 16 15:29:08.402868 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1021/2048] 10.222.0.45 () {58 vars in 1208 bytes} [Thu Dec 16 15:29:08 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-449774111 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:30:52.140140 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-4e379159-8f52-435f-86b7-473ac00f36e8 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2ff5466d-18ac-4a85-a792-a4334f51d2e9"}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:30:52.141325 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-4e379159-8f52-435f-86b7-473ac00f36e8 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: c47a38ca-4ce3-4387-af13-dc2d25144f8c] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:30:52.144951 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c006f2bf-d7e6-4bb8-aace-c3797b4b538d] AMQP server on 10.222.0.45:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 15:30:52.154227 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4e379159-8f52-435f-86b7-473ac00f36e8 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:30:52.154227 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4e379159-8f52-435f-86b7-473ac00f36e8 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:30:52.154227 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4e379159-8f52-435f-86b7-473ac00f36e8 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:30:52.154227 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4e379159-8f52-435f-86b7-473ac00f36e8 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:30:53.163283 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO oslo.messaging._drivers.impl_rabbit [-] [c006f2bf-d7e6-4bb8-aace-c3797b4b538d] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 60302. Dec 16 15:30:53.523735 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-4e379159-8f52-435f-86b7-473ac00f36e8 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "POST /compute/v2.1/servers/c47a38ca-4ce3-4387-af13-dc2d25144f8c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.391589 Dec 16 15:30:53.524398 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1028/2049] 10.222.0.45 () {60 vars in 1313 bytes} [Thu Dec 16 15:30:52 2021] POST /compute/v2.1/servers/c47a38ca-4ce3-4387-af13-dc2d25144f8c/os-volume_attachments => generated 194 bytes in 1393 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:31:19.615693 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c89047bd-5046-4dc5-81a4-5f3a093a9e0b] AMQP server on 10.222.0.45:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 16 15:31:19.622131 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-656ead3c-aa70-43f3-aed7-e4fddc3f95db tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1993197496", "imageRef": "9b00ff4e-db72-4324-820b-87a6bd73b055", "flavorRef": "452", "networks": [{"uuid": "93ae9bca-879a-41a2-8378-cb0164469bca"}]}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:31:19.998496 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.network.neutron [None req-656ead3c-aa70-43f3-aed7-e4fddc3f95db tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] validate_networks() for [('93ae9bca-879a-41a2-8378-cb0164469bca', None, None, None)] {{(pid=101355) validate_networks /opt/stack/nova/nova/network/neutron.py:2383}} Dec 16 15:31:20.651734 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO oslo.messaging._drivers.impl_rabbit [-] [c89047bd-5046-4dc5-81a4-5f3a093a9e0b] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 60790. Dec 16 15:31:21.036384 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.virt.hardware [None req-656ead3c-aa70-43f3-aed7-e4fddc3f95db tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Flavor limits 0:0:0 {{(pid=101355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:338}} Dec 16 15:31:21.036384 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.virt.hardware [None req-656ead3c-aa70-43f3-aed7-e4fddc3f95db tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Image limits 0:0:0 {{(pid=101355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:342}} Dec 16 15:31:21.037461 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.virt.hardware [None req-656ead3c-aa70-43f3-aed7-e4fddc3f95db tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Flavor pref 0:0:0 {{(pid=101355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:378}} Dec 16 15:31:21.037461 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.virt.hardware [None req-656ead3c-aa70-43f3-aed7-e4fddc3f95db tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Image pref 0:0:0 {{(pid=101355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:382}} Dec 16 15:31:21.037739 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.virt.hardware [None req-656ead3c-aa70-43f3-aed7-e4fddc3f95db tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=101355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:422}} Dec 16 15:31:21.059211 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-656ead3c-aa70-43f3-aed7-e4fddc3f95db tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:31:21.059626 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-656ead3c-aa70-43f3-aed7-e4fddc3f95db tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:31:21.061702 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-656ead3c-aa70-43f3-aed7-e4fddc3f95db tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:31:21.062854 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-656ead3c-aa70-43f3-aed7-e4fddc3f95db tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:31:21.096996 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.quota [None req-656ead3c-aa70-43f3-aed7-e4fddc3f95db tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Getting quotas for project 962338c57e5c46ef84460b3dc1a0afea. Resources: {'ram', 'instances', 'cores'} {{(pid=101355) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 16 15:31:21.106151 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.quota [None req-656ead3c-aa70-43f3-aed7-e4fddc3f95db tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Getting quotas for user f509993aaae6478b92d6e5caaf2a7dec and project 962338c57e5c46ef84460b3dc1a0afea. Resources: {'ram', 'instances', 'cores'} {{(pid=101355) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 16 15:31:21.134402 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-656ead3c-aa70-43f3-aed7-e4fddc3f95db tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Going to run 1 instances... {{(pid=101355) _provision_instances /opt/stack/nova/nova/compute/api.py:1224}} Dec 16 15:31:21.140264 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-656ead3c-aa70-43f3-aed7-e4fddc3f95db tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: c52aff34-91bc-4b2c-9f3b-35d9138871c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9b00ff4e-db72-4324-820b-87a6bd73b055',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1616}} Dec 16 15:31:21.302676 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-656ead3c-aa70-43f3-aed7-e4fddc3f95db tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.690299 Dec 16 15:31:21.303451 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1022/2050] 10.222.0.45 () {60 vars in 1137 bytes} [Thu Dec 16 15:31:19 2021] POST /compute/v2.1/servers => generated 380 bytes in 1692 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 16 15:31:21.319444 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-04ea8517-b238-406c-9ffc-06ef2a416525 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:31:21.320216 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-04ea8517-b238-406c-9ffc-06ef2a416525 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: c52aff34-91bc-4b2c-9f3b-35d9138871c3] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:31:21.932748 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-04ea8517-b238-406c-9ffc-06ef2a416525 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f509993aaae6478b92d6e5caaf2a7dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962338c57e5c46ef84460b3dc1a0afea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:31:21.944343 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-04ea8517-b238-406c-9ffc-06ef2a416525 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "GET /compute/v2.1/servers/c52aff34-91bc-4b2c-9f3b-35d9138871c3" status: 200 len: 1218 microversion: 2.1 time: 0.633384 Dec 16 15:31:21.945104 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1029/2051] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:31:21 2021] GET /compute/v2.1/servers/c52aff34-91bc-4b2c-9f3b-35d9138871c3 => generated 1218 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:31:22.973820 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-1b37cb1b-4b1a-4018-885f-9a88734b13c6 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:31:22.974674 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-1b37cb1b-4b1a-4018-885f-9a88734b13c6 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: c52aff34-91bc-4b2c-9f3b-35d9138871c3] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:31:22.984265 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1b37cb1b-4b1a-4018-885f-9a88734b13c6 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:31:22.984775 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1b37cb1b-4b1a-4018-885f-9a88734b13c6 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:31:22.985643 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1b37cb1b-4b1a-4018-885f-9a88734b13c6 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:31:22.986693 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1b37cb1b-4b1a-4018-885f-9a88734b13c6 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:31:23.162134 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-1b37cb1b-4b1a-4018-885f-9a88734b13c6 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f509993aaae6478b92d6e5caaf2a7dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962338c57e5c46ef84460b3dc1a0afea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:31:23.173139 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-1b37cb1b-4b1a-4018-885f-9a88734b13c6 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "GET /compute/v2.1/servers/c52aff34-91bc-4b2c-9f3b-35d9138871c3" status: 200 len: 1222 microversion: 2.1 time: 0.207536 Dec 16 15:31:23.173829 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1023/2052] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:31:22 2021] GET /compute/v2.1/servers/c52aff34-91bc-4b2c-9f3b-35d9138871c3 => generated 1222 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:31:24.205683 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-c2bb5c67-f27f-47f8-82a7-bba99c00191b tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:31:24.206919 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-c2bb5c67-f27f-47f8-82a7-bba99c00191b tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: c52aff34-91bc-4b2c-9f3b-35d9138871c3] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:31:24.223321 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c2bb5c67-f27f-47f8-82a7-bba99c00191b tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:31:24.224431 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c2bb5c67-f27f-47f8-82a7-bba99c00191b tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:31:24.226312 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c2bb5c67-f27f-47f8-82a7-bba99c00191b tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:31:24.227203 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c2bb5c67-f27f-47f8-82a7-bba99c00191b tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:31:24.482689 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-c2bb5c67-f27f-47f8-82a7-bba99c00191b tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f509993aaae6478b92d6e5caaf2a7dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962338c57e5c46ef84460b3dc1a0afea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:31:24.493799 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-c2bb5c67-f27f-47f8-82a7-bba99c00191b tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "GET /compute/v2.1/servers/c52aff34-91bc-4b2c-9f3b-35d9138871c3" status: 200 len: 1278 microversion: 2.1 time: 0.304233 Dec 16 15:31:24.494300 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1030/2053] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:31:24 2021] GET /compute/v2.1/servers/c52aff34-91bc-4b2c-9f3b-35d9138871c3 => generated 1278 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:31:25.520795 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-00ce0437-73bc-4e1d-a99f-6b5f1df415d3 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:31:25.521639 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-00ce0437-73bc-4e1d-a99f-6b5f1df415d3 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: c52aff34-91bc-4b2c-9f3b-35d9138871c3] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:31:25.535840 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-00ce0437-73bc-4e1d-a99f-6b5f1df415d3 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:31:25.535840 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-00ce0437-73bc-4e1d-a99f-6b5f1df415d3 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:31:25.535840 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-00ce0437-73bc-4e1d-a99f-6b5f1df415d3 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:31:25.535840 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-00ce0437-73bc-4e1d-a99f-6b5f1df415d3 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:31:26.054170 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-00ce0437-73bc-4e1d-a99f-6b5f1df415d3 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f509993aaae6478b92d6e5caaf2a7dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962338c57e5c46ef84460b3dc1a0afea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:31:26.066630 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-00ce0437-73bc-4e1d-a99f-6b5f1df415d3 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "GET /compute/v2.1/servers/c52aff34-91bc-4b2c-9f3b-35d9138871c3" status: 200 len: 1318 microversion: 2.1 time: 0.556160 Dec 16 15:31:26.067303 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1024/2054] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:31:25 2021] GET /compute/v2.1/servers/c52aff34-91bc-4b2c-9f3b-35d9138871c3 => generated 1318 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:31:27.095344 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-bcd023c6-1d7a-48d5-b00f-6de825b42c23 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:31:27.096163 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-bcd023c6-1d7a-48d5-b00f-6de825b42c23 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: c52aff34-91bc-4b2c-9f3b-35d9138871c3] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:31:27.104913 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-bcd023c6-1d7a-48d5-b00f-6de825b42c23 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:31:27.105811 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-bcd023c6-1d7a-48d5-b00f-6de825b42c23 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:31:27.106822 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-bcd023c6-1d7a-48d5-b00f-6de825b42c23 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:31:27.107524 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-bcd023c6-1d7a-48d5-b00f-6de825b42c23 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:31:27.454934 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-bcd023c6-1d7a-48d5-b00f-6de825b42c23 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f509993aaae6478b92d6e5caaf2a7dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962338c57e5c46ef84460b3dc1a0afea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:31:27.473516 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-bcd023c6-1d7a-48d5-b00f-6de825b42c23 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "GET /compute/v2.1/servers/c52aff34-91bc-4b2c-9f3b-35d9138871c3" status: 200 len: 1318 microversion: 2.1 time: 0.386985 Dec 16 15:31:27.474389 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1031/2055] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:31:27 2021] GET /compute/v2.1/servers/c52aff34-91bc-4b2c-9f3b-35d9138871c3 => generated 1318 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:31:27.936216 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [req-19a92487-dfb4-4e47-a281-a78f8bb21767 req-d2feda19-33a7-4129-90d7-ebc2fd5259b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c52aff34-91bc-4b2c-9f3b-35d9138871c3", "tag": "b3c2827e-74a7-4dcd-b34d-70db98c4121c"}]} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:31:27.941410 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:31:27.941410 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: warnings.warn(msg) Dec 16 15:31:27.952720 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-19a92487-dfb4-4e47-a281-a78f8bb21767 req-d2feda19-33a7-4129-90d7-ebc2fd5259b9 service nova] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:31:27.953347 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-19a92487-dfb4-4e47-a281-a78f8bb21767 req-d2feda19-33a7-4129-90d7-ebc2fd5259b9 service nova] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:31:27.977095 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.compute.server_external_events [req-19a92487-dfb4-4e47-a281-a78f8bb21767 req-d2feda19-33a7-4129-90d7-ebc2fd5259b9 service nova] Creating event network-changed:b3c2827e-74a7-4dcd-b34d-70db98c4121c for instance c52aff34-91bc-4b2c-9f3b-35d9138871c3 on hv-cinder-82189 Dec 16 15:31:27.983803 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [req-19a92487-dfb4-4e47-a281-a78f8bb21767 req-d2feda19-33a7-4129-90d7-ebc2fd5259b9 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.256482 Dec 16 15:31:27.984655 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1025/2056] 10.222.0.45 () {64 vars in 1308 bytes} [Thu Dec 16 15:31:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:31:28.497429 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-17d7b674-272d-4b37-930c-411ea0312fe4 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:31:28.498820 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-17d7b674-272d-4b37-930c-411ea0312fe4 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: c52aff34-91bc-4b2c-9f3b-35d9138871c3] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:31:28.507934 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-17d7b674-272d-4b37-930c-411ea0312fe4 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:31:28.508816 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-17d7b674-272d-4b37-930c-411ea0312fe4 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:31:28.509912 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-17d7b674-272d-4b37-930c-411ea0312fe4 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:31:28.510438 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-17d7b674-272d-4b37-930c-411ea0312fe4 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:31:28.780073 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-17d7b674-272d-4b37-930c-411ea0312fe4 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f509993aaae6478b92d6e5caaf2a7dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962338c57e5c46ef84460b3dc1a0afea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:31:28.793120 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-17d7b674-272d-4b37-930c-411ea0312fe4 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "GET /compute/v2.1/servers/c52aff34-91bc-4b2c-9f3b-35d9138871c3" status: 200 len: 1318 microversion: 2.1 time: 0.303888 Dec 16 15:31:28.793733 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1032/2057] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:31:28 2021] GET /compute/v2.1/servers/c52aff34-91bc-4b2c-9f3b-35d9138871c3 => generated 1318 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:31:29.819104 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-d75bb4e6-d57b-47e9-a99c-91d0bde6cf33 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:31:29.820906 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-d75bb4e6-d57b-47e9-a99c-91d0bde6cf33 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: c52aff34-91bc-4b2c-9f3b-35d9138871c3] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:31:29.833209 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d75bb4e6-d57b-47e9-a99c-91d0bde6cf33 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:31:29.835076 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d75bb4e6-d57b-47e9-a99c-91d0bde6cf33 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:31:29.837104 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d75bb4e6-d57b-47e9-a99c-91d0bde6cf33 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:31:29.837776 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d75bb4e6-d57b-47e9-a99c-91d0bde6cf33 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:31:30.266755 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-d75bb4e6-d57b-47e9-a99c-91d0bde6cf33 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f509993aaae6478b92d6e5caaf2a7dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962338c57e5c46ef84460b3dc1a0afea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:31:30.276183 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-d75bb4e6-d57b-47e9-a99c-91d0bde6cf33 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "GET /compute/v2.1/servers/c52aff34-91bc-4b2c-9f3b-35d9138871c3" status: 200 len: 1318 microversion: 2.1 time: 0.468202 Dec 16 15:31:30.276977 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1026/2058] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:31:29 2021] GET /compute/v2.1/servers/c52aff34-91bc-4b2c-9f3b-35d9138871c3 => generated 1318 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:31:31.308313 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-20efe95a-f444-4580-b617-c957aa70dfba tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:31:31.309496 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-20efe95a-f444-4580-b617-c957aa70dfba tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: c52aff34-91bc-4b2c-9f3b-35d9138871c3] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:31:31.323764 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-20efe95a-f444-4580-b617-c957aa70dfba tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:31:31.324542 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-20efe95a-f444-4580-b617-c957aa70dfba tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:31:31.326923 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-20efe95a-f444-4580-b617-c957aa70dfba tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:31:31.327437 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-20efe95a-f444-4580-b617-c957aa70dfba tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:31:31.649253 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-20efe95a-f444-4580-b617-c957aa70dfba tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f509993aaae6478b92d6e5caaf2a7dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962338c57e5c46ef84460b3dc1a0afea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:31:31.660829 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-20efe95a-f444-4580-b617-c957aa70dfba tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "GET /compute/v2.1/servers/c52aff34-91bc-4b2c-9f3b-35d9138871c3" status: 200 len: 1318 microversion: 2.1 time: 0.367795 Dec 16 15:31:31.661638 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1033/2059] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:31:31 2021] GET /compute/v2.1/servers/c52aff34-91bc-4b2c-9f3b-35d9138871c3 => generated 1318 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:31:32.685951 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-75679ef8-6f0b-4520-bf9d-61747b3aff23 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:31:32.686892 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-75679ef8-6f0b-4520-bf9d-61747b3aff23 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: c52aff34-91bc-4b2c-9f3b-35d9138871c3] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:31:32.699014 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-75679ef8-6f0b-4520-bf9d-61747b3aff23 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:31:32.699940 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-75679ef8-6f0b-4520-bf9d-61747b3aff23 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:31:32.702214 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-75679ef8-6f0b-4520-bf9d-61747b3aff23 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:31:32.702878 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-75679ef8-6f0b-4520-bf9d-61747b3aff23 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:31:32.963928 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-75679ef8-6f0b-4520-bf9d-61747b3aff23 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f509993aaae6478b92d6e5caaf2a7dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962338c57e5c46ef84460b3dc1a0afea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:31:32.973483 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-75679ef8-6f0b-4520-bf9d-61747b3aff23 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "GET /compute/v2.1/servers/c52aff34-91bc-4b2c-9f3b-35d9138871c3" status: 200 len: 1318 microversion: 2.1 time: 0.296157 Dec 16 15:31:32.974170 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1027/2060] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:31:32 2021] GET /compute/v2.1/servers/c52aff34-91bc-4b2c-9f3b-35d9138871c3 => generated 1318 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:31:33.996683 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-1cb716e4-deec-492d-8d7a-6371f882ab7f tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:31:33.997476 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-1cb716e4-deec-492d-8d7a-6371f882ab7f tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: c52aff34-91bc-4b2c-9f3b-35d9138871c3] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:31:34.007038 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1cb716e4-deec-492d-8d7a-6371f882ab7f tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:31:34.007616 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1cb716e4-deec-492d-8d7a-6371f882ab7f tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:31:34.008481 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1cb716e4-deec-492d-8d7a-6371f882ab7f tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:31:34.009054 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1cb716e4-deec-492d-8d7a-6371f882ab7f tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:31:34.525804 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-1cb716e4-deec-492d-8d7a-6371f882ab7f tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f509993aaae6478b92d6e5caaf2a7dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962338c57e5c46ef84460b3dc1a0afea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:31:34.537179 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-1cb716e4-deec-492d-8d7a-6371f882ab7f tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "GET /compute/v2.1/servers/c52aff34-91bc-4b2c-9f3b-35d9138871c3" status: 200 len: 1318 microversion: 2.1 time: 0.548441 Dec 16 15:31:34.537804 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1034/2061] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:31:33 2021] GET /compute/v2.1/servers/c52aff34-91bc-4b2c-9f3b-35d9138871c3 => generated 1318 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:31:35.562077 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-32f6a97d-7a2f-4f65-8abe-7e904cb4375b tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:31:35.562816 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-32f6a97d-7a2f-4f65-8abe-7e904cb4375b tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: c52aff34-91bc-4b2c-9f3b-35d9138871c3] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:31:35.571491 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-32f6a97d-7a2f-4f65-8abe-7e904cb4375b tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:31:35.572004 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-32f6a97d-7a2f-4f65-8abe-7e904cb4375b tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:31:35.572876 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-32f6a97d-7a2f-4f65-8abe-7e904cb4375b tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:31:35.573371 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-32f6a97d-7a2f-4f65-8abe-7e904cb4375b tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:31:35.899974 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [req-2528d2a6-2f72-478e-b1d9-60250825daa2 req-58791662-5e9b-4a35-be99-00cfc73e0385 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c52aff34-91bc-4b2c-9f3b-35d9138871c3", "name": "network-vif-plugged", "status": "completed", "tag": "b3c2827e-74a7-4dcd-b34d-70db98c4121c"}]} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:31:35.909066 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:31:35.909066 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: warnings.warn(msg) Dec 16 15:31:35.930865 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-2528d2a6-2f72-478e-b1d9-60250825daa2 req-58791662-5e9b-4a35-be99-00cfc73e0385 service nova] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:31:35.931821 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-2528d2a6-2f72-478e-b1d9-60250825daa2 req-58791662-5e9b-4a35-be99-00cfc73e0385 service nova] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:31:35.955056 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.compute.server_external_events [req-2528d2a6-2f72-478e-b1d9-60250825daa2 req-58791662-5e9b-4a35-be99-00cfc73e0385 service nova] Creating event network-vif-plugged:b3c2827e-74a7-4dcd-b34d-70db98c4121c for instance c52aff34-91bc-4b2c-9f3b-35d9138871c3 on hv-cinder-82189 Dec 16 15:31:35.961256 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [req-2528d2a6-2f72-478e-b1d9-60250825daa2 req-58791662-5e9b-4a35-be99-00cfc73e0385 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.329922 Dec 16 15:31:35.961945 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1035/2062] 10.222.0.45 () {64 vars in 1308 bytes} [Thu Dec 16 15:31:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 15:31:36.419439 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-32f6a97d-7a2f-4f65-8abe-7e904cb4375b tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f509993aaae6478b92d6e5caaf2a7dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962338c57e5c46ef84460b3dc1a0afea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:31:36.429804 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-32f6a97d-7a2f-4f65-8abe-7e904cb4375b tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "GET /compute/v2.1/servers/c52aff34-91bc-4b2c-9f3b-35d9138871c3" status: 200 len: 1318 microversion: 2.1 time: 0.876401 Dec 16 15:31:36.430795 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1028/2063] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:31:35 2021] GET /compute/v2.1/servers/c52aff34-91bc-4b2c-9f3b-35d9138871c3 => generated 1318 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:31:37.471450 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-8b4af8c1-c7b4-42e4-93db-90e4f197188b tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:31:37.491504 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-8b4af8c1-c7b4-42e4-93db-90e4f197188b tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: c52aff34-91bc-4b2c-9f3b-35d9138871c3] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:31:37.517646 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8b4af8c1-c7b4-42e4-93db-90e4f197188b tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:31:37.518548 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8b4af8c1-c7b4-42e4-93db-90e4f197188b tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:31:37.520109 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8b4af8c1-c7b4-42e4-93db-90e4f197188b tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:31:37.523173 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8b4af8c1-c7b4-42e4-93db-90e4f197188b tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:31:38.570256 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-8b4af8c1-c7b4-42e4-93db-90e4f197188b tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f509993aaae6478b92d6e5caaf2a7dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962338c57e5c46ef84460b3dc1a0afea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:31:38.580909 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-8b4af8c1-c7b4-42e4-93db-90e4f197188b tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "GET /compute/v2.1/servers/c52aff34-91bc-4b2c-9f3b-35d9138871c3" status: 200 len: 1318 microversion: 2.1 time: 1.134858 Dec 16 15:31:38.581962 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1036/2064] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:31:37 2021] GET /compute/v2.1/servers/c52aff34-91bc-4b2c-9f3b-35d9138871c3 => generated 1318 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:31:39.603790 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-4ebaf430-d999-43dd-b0f8-03903a02c1d9 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:31:39.605161 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-4ebaf430-d999-43dd-b0f8-03903a02c1d9 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: c52aff34-91bc-4b2c-9f3b-35d9138871c3] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:31:39.614496 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4ebaf430-d999-43dd-b0f8-03903a02c1d9 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:31:39.615332 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4ebaf430-d999-43dd-b0f8-03903a02c1d9 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:31:39.616412 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4ebaf430-d999-43dd-b0f8-03903a02c1d9 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:31:39.617071 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4ebaf430-d999-43dd-b0f8-03903a02c1d9 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:31:40.030553 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-4ebaf430-d999-43dd-b0f8-03903a02c1d9 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f509993aaae6478b92d6e5caaf2a7dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962338c57e5c46ef84460b3dc1a0afea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:31:40.046103 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-4ebaf430-d999-43dd-b0f8-03903a02c1d9 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "GET /compute/v2.1/servers/c52aff34-91bc-4b2c-9f3b-35d9138871c3" status: 200 len: 1507 microversion: 2.1 time: 0.449630 Dec 16 15:31:40.047163 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1029/2065] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:31:39 2021] GET /compute/v2.1/servers/c52aff34-91bc-4b2c-9f3b-35d9138871c3 => generated 1507 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:31:40.084509 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-d5e2fa85-219b-4932-bded-2276defacb0b tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2ff5466d-18ac-4a85-a792-a4334f51d2e9"}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:31:40.087798 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-d5e2fa85-219b-4932-bded-2276defacb0b tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: c52aff34-91bc-4b2c-9f3b-35d9138871c3] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:31:40.105889 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d5e2fa85-219b-4932-bded-2276defacb0b tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:31:40.107008 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d5e2fa85-219b-4932-bded-2276defacb0b tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:31:40.109296 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d5e2fa85-219b-4932-bded-2276defacb0b tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:31:40.111009 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d5e2fa85-219b-4932-bded-2276defacb0b tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:31:40.850354 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.wsgi [None req-d5e2fa85-219b-4932-bded-2276defacb0b tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] HTTP exception thrown: Invalid input received: Invalid volume: Volume 2ff5466d-18ac-4a85-a792-a4334f51d2e9 status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-663a8738-46b4-4c79-b7b9-9fc9ce509223) Dec 16 15:31:40.851853 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-d5e2fa85-219b-4932-bded-2276defacb0b tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Returning 400 to user: Invalid input received: Invalid volume: Volume 2ff5466d-18ac-4a85-a792-a4334f51d2e9 status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-663a8738-46b4-4c79-b7b9-9fc9ce509223) {{(pid=101356) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:941}} Dec 16 15:31:40.852834 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-d5e2fa85-219b-4932-bded-2276defacb0b tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "POST /compute/v2.1/servers/c52aff34-91bc-4b2c-9f3b-35d9138871c3/os-volume_attachments" status: 400 len: 279 microversion: 2.1 time: 0.791393 Dec 16 15:31:40.856747 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1037/2066] 10.222.0.45 () {60 vars in 1313 bytes} [Thu Dec 16 15:31:40 2021] POST /compute/v2.1/servers/c52aff34-91bc-4b2c-9f3b-35d9138871c3/os-volume_attachments => generated 279 bytes in 797 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 16 15:31:41.009626 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-ca8ca320-2abf-428a-b86b-268f3bf4c37e tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:31:41.010289 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-ca8ca320-2abf-428a-b86b-268f3bf4c37e tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: c47a38ca-4ce3-4387-af13-dc2d25144f8c] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:31:41.019301 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ca8ca320-2abf-428a-b86b-268f3bf4c37e tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:31:41.020015 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ca8ca320-2abf-428a-b86b-268f3bf4c37e tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:31:41.020965 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ca8ca320-2abf-428a-b86b-268f3bf4c37e tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:31:41.021442 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ca8ca320-2abf-428a-b86b-268f3bf4c37e tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:31:41.601501 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-ca8ca320-2abf-428a-b86b-268f3bf4c37e tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "DELETE /compute/v2.1/servers/c47a38ca-4ce3-4387-af13-dc2d25144f8c/os-volume_attachments/2ff5466d-18ac-4a85-a792-a4334f51d2e9" status: 202 len: 0 microversion: 2.1 time: 0.601050 Dec 16 15:31:41.602189 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1030/2067] 10.222.0.45 () {58 vars in 1406 bytes} [Thu Dec 16 15:31:40 2021] DELETE /compute/v2.1/servers/c47a38ca-4ce3-4387-af13-dc2d25144f8c/os-volume_attachments/2ff5466d-18ac-4a85-a792-a4334f51d2e9 => generated 0 bytes in 604 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:31:41.616580 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-5900a4c4-78a5-48cd-9a28-e44ca7072b9c tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:31:41.626357 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-5900a4c4-78a5-48cd-9a28-e44ca7072b9c tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: c47a38ca-4ce3-4387-af13-dc2d25144f8c] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:31:41.639091 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5900a4c4-78a5-48cd-9a28-e44ca7072b9c tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:31:41.639903 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5900a4c4-78a5-48cd-9a28-e44ca7072b9c tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:31:41.641554 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5900a4c4-78a5-48cd-9a28-e44ca7072b9c tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:31:41.642430 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5900a4c4-78a5-48cd-9a28-e44ca7072b9c tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:31:41.877969 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-5900a4c4-78a5-48cd-9a28-e44ca7072b9c tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "GET /compute/v2.1/servers/c47a38ca-4ce3-4387-af13-dc2d25144f8c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.270382 Dec 16 15:31:41.881836 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1038/2068] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:31:41 2021] GET /compute/v2.1/servers/c47a38ca-4ce3-4387-af13-dc2d25144f8c/os-volume_attachments => generated 197 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:31:42.898277 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-90c23e1e-cdbf-4676-a58c-e0783bc5fa50 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:31:42.899438 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-90c23e1e-cdbf-4676-a58c-e0783bc5fa50 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: c47a38ca-4ce3-4387-af13-dc2d25144f8c] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:31:42.907976 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-90c23e1e-cdbf-4676-a58c-e0783bc5fa50 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:31:42.908598 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-90c23e1e-cdbf-4676-a58c-e0783bc5fa50 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:31:42.909403 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-90c23e1e-cdbf-4676-a58c-e0783bc5fa50 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:31:42.909903 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-90c23e1e-cdbf-4676-a58c-e0783bc5fa50 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:31:42.991484 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-90c23e1e-cdbf-4676-a58c-e0783bc5fa50 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "GET /compute/v2.1/servers/c47a38ca-4ce3-4387-af13-dc2d25144f8c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.102038 Dec 16 15:31:42.992976 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1031/2069] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:31:42 2021] GET /compute/v2.1/servers/c47a38ca-4ce3-4387-af13-dc2d25144f8c/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:31:44.009040 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-5aa10d64-1ef7-4696-a98f-531faecbda55 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:31:44.014553 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-5aa10d64-1ef7-4696-a98f-531faecbda55 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: c47a38ca-4ce3-4387-af13-dc2d25144f8c] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:31:44.025105 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5aa10d64-1ef7-4696-a98f-531faecbda55 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:31:44.025687 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5aa10d64-1ef7-4696-a98f-531faecbda55 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:31:44.026572 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5aa10d64-1ef7-4696-a98f-531faecbda55 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:31:44.027510 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5aa10d64-1ef7-4696-a98f-531faecbda55 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:31:44.113519 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-5aa10d64-1ef7-4696-a98f-531faecbda55 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "GET /compute/v2.1/servers/c47a38ca-4ce3-4387-af13-dc2d25144f8c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.112915 Dec 16 15:31:44.114202 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1039/2070] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:31:43 2021] GET /compute/v2.1/servers/c47a38ca-4ce3-4387-af13-dc2d25144f8c/os-volume_attachments => generated 25 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 15:31:44.415036 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-5927f89a-4646-4163-9074-f1769f2c7214 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-25738377", "imageRef": "9b00ff4e-db72-4324-820b-87a6bd73b055", "flavorRef": "452", "networks": [{"uuid": "93ae9bca-879a-41a2-8378-cb0164469bca"}]}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:31:44.503289 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.network.neutron [None req-5927f89a-4646-4163-9074-f1769f2c7214 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] validate_networks() for [('93ae9bca-879a-41a2-8378-cb0164469bca', None, None, None)] {{(pid=101355) validate_networks /opt/stack/nova/nova/network/neutron.py:2383}} Dec 16 15:31:45.310847 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.virt.hardware [None req-5927f89a-4646-4163-9074-f1769f2c7214 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Flavor limits 0:0:0 {{(pid=101355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:338}} Dec 16 15:31:45.311630 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.virt.hardware [None req-5927f89a-4646-4163-9074-f1769f2c7214 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Image limits 0:0:0 {{(pid=101355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:342}} Dec 16 15:31:45.311820 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.virt.hardware [None req-5927f89a-4646-4163-9074-f1769f2c7214 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Flavor pref 0:0:0 {{(pid=101355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:378}} Dec 16 15:31:45.312451 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.virt.hardware [None req-5927f89a-4646-4163-9074-f1769f2c7214 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Image pref 0:0:0 {{(pid=101355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:382}} Dec 16 15:31:45.312917 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.virt.hardware [None req-5927f89a-4646-4163-9074-f1769f2c7214 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=101355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:422}} Dec 16 15:31:45.322617 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5927f89a-4646-4163-9074-f1769f2c7214 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:31:45.323608 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5927f89a-4646-4163-9074-f1769f2c7214 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:31:45.324537 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5927f89a-4646-4163-9074-f1769f2c7214 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:31:45.325280 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5927f89a-4646-4163-9074-f1769f2c7214 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:31:45.345488 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.quota [None req-5927f89a-4646-4163-9074-f1769f2c7214 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Getting quotas for project 962338c57e5c46ef84460b3dc1a0afea. Resources: {'ram', 'instances', 'cores'} {{(pid=101355) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 16 15:31:45.350562 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.quota [None req-5927f89a-4646-4163-9074-f1769f2c7214 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Getting quotas for user f509993aaae6478b92d6e5caaf2a7dec and project 962338c57e5c46ef84460b3dc1a0afea. Resources: {'ram', 'instances', 'cores'} {{(pid=101355) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 16 15:31:45.365983 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-5927f89a-4646-4163-9074-f1769f2c7214 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Going to run 1 instances... {{(pid=101355) _provision_instances /opt/stack/nova/nova/compute/api.py:1224}} Dec 16 15:31:45.369059 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-5927f89a-4646-4163-9074-f1769f2c7214 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: d0133f89-c4d2-43e8-a9ef-5f0222bdc104] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9b00ff4e-db72-4324-820b-87a6bd73b055',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1616}} Dec 16 15:31:45.522189 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-5927f89a-4646-4163-9074-f1769f2c7214 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.114199 Dec 16 15:31:45.523256 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1032/2071] 10.222.0.45 () {60 vars in 1137 bytes} [Thu Dec 16 15:31:44 2021] POST /compute/v2.1/servers => generated 380 bytes in 1117 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 16 15:31:45.542690 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-54cb7bf7-20c3-4810-9947-737965efbc47 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:31:45.545510 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-54cb7bf7-20c3-4810-9947-737965efbc47 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: d0133f89-c4d2-43e8-a9ef-5f0222bdc104] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:31:45.658949 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-54cb7bf7-20c3-4810-9947-737965efbc47 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f509993aaae6478b92d6e5caaf2a7dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962338c57e5c46ef84460b3dc1a0afea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:31:45.668822 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-54cb7bf7-20c3-4810-9947-737965efbc47 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "GET /compute/v2.1/servers/d0133f89-c4d2-43e8-a9ef-5f0222bdc104" status: 200 len: 1216 microversion: 2.1 time: 0.137665 Dec 16 15:31:45.671722 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1040/2072] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:31:45 2021] GET /compute/v2.1/servers/d0133f89-c4d2-43e8-a9ef-5f0222bdc104 => generated 1216 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:31:46.694749 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-c30a430f-3b90-42fc-b55b-10427c8efeee tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:31:46.695417 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-c30a430f-3b90-42fc-b55b-10427c8efeee tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: d0133f89-c4d2-43e8-a9ef-5f0222bdc104] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:31:46.871604 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-c30a430f-3b90-42fc-b55b-10427c8efeee tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f509993aaae6478b92d6e5caaf2a7dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962338c57e5c46ef84460b3dc1a0afea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:31:46.880854 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-c30a430f-3b90-42fc-b55b-10427c8efeee tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "GET /compute/v2.1/servers/d0133f89-c4d2-43e8-a9ef-5f0222bdc104" status: 200 len: 1216 microversion: 2.1 time: 0.194909 Dec 16 15:31:46.882128 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1033/2073] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:31:46 2021] GET /compute/v2.1/servers/d0133f89-c4d2-43e8-a9ef-5f0222bdc104 => generated 1216 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:31:47.909718 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-f8b8e6e0-293b-42c9-b0e3-04887a8032d4 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:31:47.909718 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-f8b8e6e0-293b-42c9-b0e3-04887a8032d4 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: d0133f89-c4d2-43e8-a9ef-5f0222bdc104] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:31:48.037720 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-f8b8e6e0-293b-42c9-b0e3-04887a8032d4 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f509993aaae6478b92d6e5caaf2a7dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962338c57e5c46ef84460b3dc1a0afea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:31:48.049222 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-f8b8e6e0-293b-42c9-b0e3-04887a8032d4 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "GET /compute/v2.1/servers/d0133f89-c4d2-43e8-a9ef-5f0222bdc104" status: 200 len: 1216 microversion: 2.1 time: 0.149169 Dec 16 15:31:48.050118 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1041/2074] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:31:47 2021] GET /compute/v2.1/servers/d0133f89-c4d2-43e8-a9ef-5f0222bdc104 => generated 1216 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:31:49.079676 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-e436820e-ae8c-41c8-8adc-8590eb5ffe5f tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:31:49.080594 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-e436820e-ae8c-41c8-8adc-8590eb5ffe5f tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: d0133f89-c4d2-43e8-a9ef-5f0222bdc104] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:31:49.237104 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-e436820e-ae8c-41c8-8adc-8590eb5ffe5f tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f509993aaae6478b92d6e5caaf2a7dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962338c57e5c46ef84460b3dc1a0afea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:31:49.248461 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-e436820e-ae8c-41c8-8adc-8590eb5ffe5f tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "GET /compute/v2.1/servers/d0133f89-c4d2-43e8-a9ef-5f0222bdc104" status: 200 len: 1216 microversion: 2.1 time: 0.182877 Dec 16 15:31:49.271882 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1034/2075] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:31:49 2021] GET /compute/v2.1/servers/d0133f89-c4d2-43e8-a9ef-5f0222bdc104 => generated 1216 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:31:50.272093 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-bfc2b779-21fa-4c5e-baa9-eeebfae8017e tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:31:50.273347 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-bfc2b779-21fa-4c5e-baa9-eeebfae8017e tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: d0133f89-c4d2-43e8-a9ef-5f0222bdc104] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:31:50.285614 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-bfc2b779-21fa-4c5e-baa9-eeebfae8017e tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:31:50.286589 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-bfc2b779-21fa-4c5e-baa9-eeebfae8017e tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:31:50.287718 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-bfc2b779-21fa-4c5e-baa9-eeebfae8017e tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:31:50.288544 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-bfc2b779-21fa-4c5e-baa9-eeebfae8017e tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:31:50.449892 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-bfc2b779-21fa-4c5e-baa9-eeebfae8017e tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f509993aaae6478b92d6e5caaf2a7dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962338c57e5c46ef84460b3dc1a0afea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:31:50.462077 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-bfc2b779-21fa-4c5e-baa9-eeebfae8017e tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "GET /compute/v2.1/servers/d0133f89-c4d2-43e8-a9ef-5f0222bdc104" status: 200 len: 1220 microversion: 2.1 time: 0.199365 Dec 16 15:31:50.462929 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1042/2076] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:31:50 2021] GET /compute/v2.1/servers/d0133f89-c4d2-43e8-a9ef-5f0222bdc104 => generated 1220 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:31:51.508446 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-7edc7754-5248-4246-a016-46bad160a1bb tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:31:51.509820 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-7edc7754-5248-4246-a016-46bad160a1bb tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: d0133f89-c4d2-43e8-a9ef-5f0222bdc104] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:31:51.520268 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7edc7754-5248-4246-a016-46bad160a1bb tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:31:51.520949 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7edc7754-5248-4246-a016-46bad160a1bb tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:31:51.522235 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7edc7754-5248-4246-a016-46bad160a1bb tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:31:51.522997 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7edc7754-5248-4246-a016-46bad160a1bb tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:31:51.878472 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-7edc7754-5248-4246-a016-46bad160a1bb tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f509993aaae6478b92d6e5caaf2a7dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962338c57e5c46ef84460b3dc1a0afea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:31:51.909506 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-7edc7754-5248-4246-a016-46bad160a1bb tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "GET /compute/v2.1/servers/d0133f89-c4d2-43e8-a9ef-5f0222bdc104" status: 200 len: 1268 microversion: 2.1 time: 0.427857 Dec 16 15:31:51.916885 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1035/2077] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:31:51 2021] GET /compute/v2.1/servers/d0133f89-c4d2-43e8-a9ef-5f0222bdc104 => generated 1268 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:31:52.945299 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-0d1e9a01-2687-418e-9a34-9d43b2a89cde tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:31:52.946662 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-0d1e9a01-2687-418e-9a34-9d43b2a89cde tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: d0133f89-c4d2-43e8-a9ef-5f0222bdc104] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:31:52.955758 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0d1e9a01-2687-418e-9a34-9d43b2a89cde tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:31:52.956314 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0d1e9a01-2687-418e-9a34-9d43b2a89cde tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:31:52.957175 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0d1e9a01-2687-418e-9a34-9d43b2a89cde tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:31:52.957663 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0d1e9a01-2687-418e-9a34-9d43b2a89cde tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:31:53.127838 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-0d1e9a01-2687-418e-9a34-9d43b2a89cde tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f509993aaae6478b92d6e5caaf2a7dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962338c57e5c46ef84460b3dc1a0afea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:31:53.141868 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-0d1e9a01-2687-418e-9a34-9d43b2a89cde tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "GET /compute/v2.1/servers/d0133f89-c4d2-43e8-a9ef-5f0222bdc104" status: 200 len: 1274 microversion: 2.1 time: 0.209924 Dec 16 15:31:53.142528 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1043/2078] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:31:52 2021] GET /compute/v2.1/servers/d0133f89-c4d2-43e8-a9ef-5f0222bdc104 => generated 1274 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:31:53.584284 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-7b2a9182-0a12-4856-9662-cedf259edf6f tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Action: 'create', calling method: .version_select at 0x7f14f723d400>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1519735302"}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:31:53.615697 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.quota [None req-7b2a9182-0a12-4856-9662-cedf259edf6f tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Getting quotas for project 211699de14224a63a48d253eaa061c69. Resources: {'key_pairs'} {{(pid=101355) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 16 15:31:53.619935 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.quota [None req-7b2a9182-0a12-4856-9662-cedf259edf6f tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Getting quotas for user 7508cb16ab6343dfb7de72c6b3600ae8 and project 211699de14224a63a48d253eaa061c69. Resources: {'key_pairs'} {{(pid=101355) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 16 15:31:54.168026 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-25c1beac-9c32-4a9a-9976-52a256fc8043 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:31:54.168713 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-25c1beac-9c32-4a9a-9976-52a256fc8043 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: d0133f89-c4d2-43e8-a9ef-5f0222bdc104] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:31:54.177881 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-25c1beac-9c32-4a9a-9976-52a256fc8043 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:31:54.179046 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-25c1beac-9c32-4a9a-9976-52a256fc8043 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:31:54.180673 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-25c1beac-9c32-4a9a-9976-52a256fc8043 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:31:54.181704 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-25c1beac-9c32-4a9a-9976-52a256fc8043 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:31:54.347021 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.quota [None req-7b2a9182-0a12-4856-9662-cedf259edf6f tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Getting quotas for project 211699de14224a63a48d253eaa061c69. Resources: {'key_pairs'} {{(pid=101355) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 16 15:31:54.357182 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.quota [None req-7b2a9182-0a12-4856-9662-cedf259edf6f tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Getting quotas for user 7508cb16ab6343dfb7de72c6b3600ae8 and project 211699de14224a63a48d253eaa061c69. Resources: {'key_pairs'} {{(pid=101355) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 16 15:31:54.381724 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-7b2a9182-0a12-4856-9662-cedf259edf6f tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 1.082163 Dec 16 15:31:54.382825 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1036/2079] 10.222.0.45 () {60 vars in 1148 bytes} [Thu Dec 16 15:31:53 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:31:54.446474 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-25c1beac-9c32-4a9a-9976-52a256fc8043 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f509993aaae6478b92d6e5caaf2a7dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962338c57e5c46ef84460b3dc1a0afea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:31:54.457598 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-25c1beac-9c32-4a9a-9976-52a256fc8043 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "GET /compute/v2.1/servers/d0133f89-c4d2-43e8-a9ef-5f0222bdc104" status: 200 len: 1316 microversion: 2.1 time: 0.298167 Dec 16 15:31:54.459952 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1044/2080] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:31:54 2021] GET /compute/v2.1/servers/d0133f89-c4d2-43e8-a9ef-5f0222bdc104 => generated 1316 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:31:55.480254 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-5a65b15b-8b39-486d-bdfa-0bf68635f25b tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:31:55.482284 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-5a65b15b-8b39-486d-bdfa-0bf68635f25b tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: d0133f89-c4d2-43e8-a9ef-5f0222bdc104] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:31:55.493049 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5a65b15b-8b39-486d-bdfa-0bf68635f25b tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:31:55.493918 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5a65b15b-8b39-486d-bdfa-0bf68635f25b tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:31:55.495036 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5a65b15b-8b39-486d-bdfa-0bf68635f25b tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:31:55.495728 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5a65b15b-8b39-486d-bdfa-0bf68635f25b tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:31:56.076999 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-5a65b15b-8b39-486d-bdfa-0bf68635f25b tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f509993aaae6478b92d6e5caaf2a7dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962338c57e5c46ef84460b3dc1a0afea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:31:56.085959 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-5a65b15b-8b39-486d-bdfa-0bf68635f25b tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "GET /compute/v2.1/servers/d0133f89-c4d2-43e8-a9ef-5f0222bdc104" status: 200 len: 1316 microversion: 2.1 time: 0.613448 Dec 16 15:31:56.086762 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1037/2081] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:31:55 2021] GET /compute/v2.1/servers/d0133f89-c4d2-43e8-a9ef-5f0222bdc104 => generated 1316 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:31:56.189612 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [req-b1deadbd-bce3-4d4c-9c44-d347031978ba req-c11547e1-0f9e-42db-9dc1-cddee3015671 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0133f89-c4d2-43e8-a9ef-5f0222bdc104", "tag": "29c539d0-bf3c-431b-a920-17c04ec109e1"}]} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:31:56.197610 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:31:56.197610 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: warnings.warn(msg) Dec 16 15:31:56.216778 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-b1deadbd-bce3-4d4c-9c44-d347031978ba req-c11547e1-0f9e-42db-9dc1-cddee3015671 service nova] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:31:56.217598 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-b1deadbd-bce3-4d4c-9c44-d347031978ba req-c11547e1-0f9e-42db-9dc1-cddee3015671 service nova] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:31:56.239503 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.compute.server_external_events [req-b1deadbd-bce3-4d4c-9c44-d347031978ba req-c11547e1-0f9e-42db-9dc1-cddee3015671 service nova] Creating event network-changed:29c539d0-bf3c-431b-a920-17c04ec109e1 for instance d0133f89-c4d2-43e8-a9ef-5f0222bdc104 on hv-cinder-82189 Dec 16 15:31:56.246573 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [req-b1deadbd-bce3-4d4c-9c44-d347031978ba req-c11547e1-0f9e-42db-9dc1-cddee3015671 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064176 Dec 16 15:31:56.247175 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1045/2082] 10.222.0.45 () {64 vars in 1308 bytes} [Thu Dec 16 15:31:56 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:31:57.109623 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-afaf3a5a-048f-4de5-ae8e-5ee7410d0536 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:31:57.110426 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-afaf3a5a-048f-4de5-ae8e-5ee7410d0536 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: d0133f89-c4d2-43e8-a9ef-5f0222bdc104] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:31:57.120951 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-afaf3a5a-048f-4de5-ae8e-5ee7410d0536 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:31:57.122335 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-afaf3a5a-048f-4de5-ae8e-5ee7410d0536 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:31:57.123396 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-afaf3a5a-048f-4de5-ae8e-5ee7410d0536 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:31:57.124138 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-afaf3a5a-048f-4de5-ae8e-5ee7410d0536 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:31:57.464315 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-afaf3a5a-048f-4de5-ae8e-5ee7410d0536 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f509993aaae6478b92d6e5caaf2a7dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962338c57e5c46ef84460b3dc1a0afea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:31:57.475004 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-afaf3a5a-048f-4de5-ae8e-5ee7410d0536 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "GET /compute/v2.1/servers/d0133f89-c4d2-43e8-a9ef-5f0222bdc104" status: 200 len: 1316 microversion: 2.1 time: 0.374269 Dec 16 15:31:57.487308 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1038/2083] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:31:57 2021] GET /compute/v2.1/servers/d0133f89-c4d2-43e8-a9ef-5f0222bdc104 => generated 1316 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:31:58.505063 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-b4a619ed-d29f-41a4-8d9d-d4bf325b5297 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:31:58.509390 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-b4a619ed-d29f-41a4-8d9d-d4bf325b5297 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: d0133f89-c4d2-43e8-a9ef-5f0222bdc104] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:31:58.524327 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b4a619ed-d29f-41a4-8d9d-d4bf325b5297 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:31:58.527413 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b4a619ed-d29f-41a4-8d9d-d4bf325b5297 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:31:58.528930 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b4a619ed-d29f-41a4-8d9d-d4bf325b5297 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:31:58.529802 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b4a619ed-d29f-41a4-8d9d-d4bf325b5297 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:31:58.847808 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-b4a619ed-d29f-41a4-8d9d-d4bf325b5297 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f509993aaae6478b92d6e5caaf2a7dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962338c57e5c46ef84460b3dc1a0afea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:31:58.860398 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-b4a619ed-d29f-41a4-8d9d-d4bf325b5297 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "GET /compute/v2.1/servers/d0133f89-c4d2-43e8-a9ef-5f0222bdc104" status: 200 len: 1316 microversion: 2.1 time: 0.369148 Dec 16 15:31:58.861268 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1046/2084] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:31:58 2021] GET /compute/v2.1/servers/d0133f89-c4d2-43e8-a9ef-5f0222bdc104 => generated 1316 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:31:59.884357 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-b2c67f3f-2fe1-4784-abd8-32a23a579885 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:31:59.884860 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-b2c67f3f-2fe1-4784-abd8-32a23a579885 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: d0133f89-c4d2-43e8-a9ef-5f0222bdc104] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:31:59.893774 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b2c67f3f-2fe1-4784-abd8-32a23a579885 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:31:59.894322 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b2c67f3f-2fe1-4784-abd8-32a23a579885 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:31:59.895188 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b2c67f3f-2fe1-4784-abd8-32a23a579885 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:31:59.895700 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b2c67f3f-2fe1-4784-abd8-32a23a579885 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:00.167324 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-b2c67f3f-2fe1-4784-abd8-32a23a579885 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f509993aaae6478b92d6e5caaf2a7dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962338c57e5c46ef84460b3dc1a0afea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:32:00.179487 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-b2c67f3f-2fe1-4784-abd8-32a23a579885 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "GET /compute/v2.1/servers/d0133f89-c4d2-43e8-a9ef-5f0222bdc104" status: 200 len: 1316 microversion: 2.1 time: 0.303143 Dec 16 15:32:00.180108 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1039/2085] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:31:59 2021] GET /compute/v2.1/servers/d0133f89-c4d2-43e8-a9ef-5f0222bdc104 => generated 1316 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:32:01.207134 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-d08951b4-0899-4a23-a3d1-3251dd045d14 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:32:01.207815 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-d08951b4-0899-4a23-a3d1-3251dd045d14 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: d0133f89-c4d2-43e8-a9ef-5f0222bdc104] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:32:01.216245 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d08951b4-0899-4a23-a3d1-3251dd045d14 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:01.216746 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d08951b4-0899-4a23-a3d1-3251dd045d14 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:01.217595 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d08951b4-0899-4a23-a3d1-3251dd045d14 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:01.218115 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d08951b4-0899-4a23-a3d1-3251dd045d14 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:01.479694 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-d08951b4-0899-4a23-a3d1-3251dd045d14 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f509993aaae6478b92d6e5caaf2a7dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962338c57e5c46ef84460b3dc1a0afea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:32:01.489452 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-d08951b4-0899-4a23-a3d1-3251dd045d14 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "GET /compute/v2.1/servers/d0133f89-c4d2-43e8-a9ef-5f0222bdc104" status: 200 len: 1316 microversion: 2.1 time: 0.293511 Dec 16 15:32:01.490265 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1047/2086] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:32:01 2021] GET /compute/v2.1/servers/d0133f89-c4d2-43e8-a9ef-5f0222bdc104 => generated 1316 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:32:02.513815 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-d70fec51-03fa-47fd-a692-db4929986ca7 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:32:02.514484 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-d70fec51-03fa-47fd-a692-db4929986ca7 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: d0133f89-c4d2-43e8-a9ef-5f0222bdc104] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:32:02.522436 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d70fec51-03fa-47fd-a692-db4929986ca7 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:02.522946 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d70fec51-03fa-47fd-a692-db4929986ca7 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:02.523787 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d70fec51-03fa-47fd-a692-db4929986ca7 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:02.524277 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d70fec51-03fa-47fd-a692-db4929986ca7 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:02.766064 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-d70fec51-03fa-47fd-a692-db4929986ca7 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f509993aaae6478b92d6e5caaf2a7dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962338c57e5c46ef84460b3dc1a0afea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:32:02.777049 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-d70fec51-03fa-47fd-a692-db4929986ca7 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "GET /compute/v2.1/servers/d0133f89-c4d2-43e8-a9ef-5f0222bdc104" status: 200 len: 1316 microversion: 2.1 time: 0.272405 Dec 16 15:32:02.777662 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1040/2087] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:32:02 2021] GET /compute/v2.1/servers/d0133f89-c4d2-43e8-a9ef-5f0222bdc104 => generated 1316 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:32:03.826904 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-fd6f16be-ab79-4504-9d56-67f4badee7d7 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:32:03.826904 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-fd6f16be-ab79-4504-9d56-67f4badee7d7 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: d0133f89-c4d2-43e8-a9ef-5f0222bdc104] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:32:03.838821 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fd6f16be-ab79-4504-9d56-67f4badee7d7 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:03.839792 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fd6f16be-ab79-4504-9d56-67f4badee7d7 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:03.841960 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fd6f16be-ab79-4504-9d56-67f4badee7d7 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:03.842927 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fd6f16be-ab79-4504-9d56-67f4badee7d7 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:04.168142 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-fd6f16be-ab79-4504-9d56-67f4badee7d7 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f509993aaae6478b92d6e5caaf2a7dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962338c57e5c46ef84460b3dc1a0afea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:32:04.177982 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-fd6f16be-ab79-4504-9d56-67f4badee7d7 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "GET /compute/v2.1/servers/d0133f89-c4d2-43e8-a9ef-5f0222bdc104" status: 200 len: 1316 microversion: 2.1 time: 0.376817 Dec 16 15:32:04.178620 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1048/2088] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:32:03 2021] GET /compute/v2.1/servers/d0133f89-c4d2-43e8-a9ef-5f0222bdc104 => generated 1316 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:32:05.202266 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-d775dc26-aa53-4536-bae6-24279be1276c tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:32:05.203020 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-d775dc26-aa53-4536-bae6-24279be1276c tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: d0133f89-c4d2-43e8-a9ef-5f0222bdc104] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:32:05.211600 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d775dc26-aa53-4536-bae6-24279be1276c tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:05.212112 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d775dc26-aa53-4536-bae6-24279be1276c tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:05.212964 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d775dc26-aa53-4536-bae6-24279be1276c tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:05.213453 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d775dc26-aa53-4536-bae6-24279be1276c tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:05.455891 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-d775dc26-aa53-4536-bae6-24279be1276c tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f509993aaae6478b92d6e5caaf2a7dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962338c57e5c46ef84460b3dc1a0afea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:32:05.464801 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-d775dc26-aa53-4536-bae6-24279be1276c tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "GET /compute/v2.1/servers/d0133f89-c4d2-43e8-a9ef-5f0222bdc104" status: 200 len: 1316 microversion: 2.1 time: 0.271009 Dec 16 15:32:05.465423 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1041/2089] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:32:05 2021] GET /compute/v2.1/servers/d0133f89-c4d2-43e8-a9ef-5f0222bdc104 => generated 1316 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:32:06.488738 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-6fc053f9-26ee-4bde-a7b3-64823c65738c tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:32:06.489763 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-6fc053f9-26ee-4bde-a7b3-64823c65738c tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: d0133f89-c4d2-43e8-a9ef-5f0222bdc104] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:32:06.499108 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6fc053f9-26ee-4bde-a7b3-64823c65738c tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:06.499726 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6fc053f9-26ee-4bde-a7b3-64823c65738c tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:06.500695 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6fc053f9-26ee-4bde-a7b3-64823c65738c tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:06.501226 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6fc053f9-26ee-4bde-a7b3-64823c65738c tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:06.737867 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-6fc053f9-26ee-4bde-a7b3-64823c65738c tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f509993aaae6478b92d6e5caaf2a7dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962338c57e5c46ef84460b3dc1a0afea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:32:06.747402 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-6fc053f9-26ee-4bde-a7b3-64823c65738c tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "GET /compute/v2.1/servers/d0133f89-c4d2-43e8-a9ef-5f0222bdc104" status: 200 len: 1316 microversion: 2.1 time: 0.267075 Dec 16 15:32:06.747999 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1049/2090] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:32:06 2021] GET /compute/v2.1/servers/d0133f89-c4d2-43e8-a9ef-5f0222bdc104 => generated 1316 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:32:07.769817 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-ac140842-6393-49dd-8a3f-7088e4ba5925 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:32:07.770446 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-ac140842-6393-49dd-8a3f-7088e4ba5925 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: d0133f89-c4d2-43e8-a9ef-5f0222bdc104] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:32:07.778395 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ac140842-6393-49dd-8a3f-7088e4ba5925 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:07.778904 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ac140842-6393-49dd-8a3f-7088e4ba5925 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:07.779747 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ac140842-6393-49dd-8a3f-7088e4ba5925 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:07.780247 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ac140842-6393-49dd-8a3f-7088e4ba5925 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:08.029039 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-ac140842-6393-49dd-8a3f-7088e4ba5925 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f509993aaae6478b92d6e5caaf2a7dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962338c57e5c46ef84460b3dc1a0afea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:32:08.037949 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-ac140842-6393-49dd-8a3f-7088e4ba5925 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "GET /compute/v2.1/servers/d0133f89-c4d2-43e8-a9ef-5f0222bdc104" status: 200 len: 1316 microversion: 2.1 time: 0.276577 Dec 16 15:32:08.038610 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1042/2091] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:32:07 2021] GET /compute/v2.1/servers/d0133f89-c4d2-43e8-a9ef-5f0222bdc104 => generated 1316 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:32:09.062676 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-9abebf98-bb01-4f0b-ba76-75806bce7913 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:32:09.063849 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-9abebf98-bb01-4f0b-ba76-75806bce7913 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: d0133f89-c4d2-43e8-a9ef-5f0222bdc104] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:32:09.078938 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9abebf98-bb01-4f0b-ba76-75806bce7913 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:09.079795 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9abebf98-bb01-4f0b-ba76-75806bce7913 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:09.081217 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9abebf98-bb01-4f0b-ba76-75806bce7913 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:09.082135 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9abebf98-bb01-4f0b-ba76-75806bce7913 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:09.332736 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-9abebf98-bb01-4f0b-ba76-75806bce7913 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f509993aaae6478b92d6e5caaf2a7dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962338c57e5c46ef84460b3dc1a0afea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:32:09.349870 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-9abebf98-bb01-4f0b-ba76-75806bce7913 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "GET /compute/v2.1/servers/d0133f89-c4d2-43e8-a9ef-5f0222bdc104" status: 200 len: 1316 microversion: 2.1 time: 0.295517 Dec 16 15:32:09.354782 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1050/2092] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:32:09 2021] GET /compute/v2.1/servers/d0133f89-c4d2-43e8-a9ef-5f0222bdc104 => generated 1316 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:32:10.375019 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-d71dc511-a8a6-4b86-92ed-41a5de55dd26 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:32:10.375732 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-d71dc511-a8a6-4b86-92ed-41a5de55dd26 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: d0133f89-c4d2-43e8-a9ef-5f0222bdc104] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:32:10.384431 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d71dc511-a8a6-4b86-92ed-41a5de55dd26 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:10.385220 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d71dc511-a8a6-4b86-92ed-41a5de55dd26 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:10.386180 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d71dc511-a8a6-4b86-92ed-41a5de55dd26 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:10.386729 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d71dc511-a8a6-4b86-92ed-41a5de55dd26 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:10.615000 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-d71dc511-a8a6-4b86-92ed-41a5de55dd26 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f509993aaae6478b92d6e5caaf2a7dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962338c57e5c46ef84460b3dc1a0afea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:32:10.624154 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-d71dc511-a8a6-4b86-92ed-41a5de55dd26 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "GET /compute/v2.1/servers/d0133f89-c4d2-43e8-a9ef-5f0222bdc104" status: 200 len: 1316 microversion: 2.1 time: 0.257943 Dec 16 15:32:10.624762 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1043/2093] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:32:10 2021] GET /compute/v2.1/servers/d0133f89-c4d2-43e8-a9ef-5f0222bdc104 => generated 1316 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:32:11.646586 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-85b0c783-0567-4311-b40e-efd9236d4d66 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:32:11.647263 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-85b0c783-0567-4311-b40e-efd9236d4d66 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: d0133f89-c4d2-43e8-a9ef-5f0222bdc104] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:32:11.655745 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-85b0c783-0567-4311-b40e-efd9236d4d66 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:11.656253 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-85b0c783-0567-4311-b40e-efd9236d4d66 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:11.657098 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-85b0c783-0567-4311-b40e-efd9236d4d66 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:11.657591 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-85b0c783-0567-4311-b40e-efd9236d4d66 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:11.886481 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-85b0c783-0567-4311-b40e-efd9236d4d66 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f509993aaae6478b92d6e5caaf2a7dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962338c57e5c46ef84460b3dc1a0afea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:32:11.896089 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-85b0c783-0567-4311-b40e-efd9236d4d66 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "GET /compute/v2.1/servers/d0133f89-c4d2-43e8-a9ef-5f0222bdc104" status: 200 len: 1316 microversion: 2.1 time: 0.257954 Dec 16 15:32:11.896720 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1051/2094] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:32:11 2021] GET /compute/v2.1/servers/d0133f89-c4d2-43e8-a9ef-5f0222bdc104 => generated 1316 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:32:12.925114 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-63b1591e-44f5-46f5-baef-9a1bacac89de tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:32:12.925710 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-63b1591e-44f5-46f5-baef-9a1bacac89de tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: d0133f89-c4d2-43e8-a9ef-5f0222bdc104] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:32:12.934523 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-63b1591e-44f5-46f5-baef-9a1bacac89de tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:12.935034 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-63b1591e-44f5-46f5-baef-9a1bacac89de tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:12.935893 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-63b1591e-44f5-46f5-baef-9a1bacac89de tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:12.936391 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-63b1591e-44f5-46f5-baef-9a1bacac89de tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:13.177891 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-63b1591e-44f5-46f5-baef-9a1bacac89de tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f509993aaae6478b92d6e5caaf2a7dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962338c57e5c46ef84460b3dc1a0afea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:32:13.187818 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-63b1591e-44f5-46f5-baef-9a1bacac89de tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "GET /compute/v2.1/servers/d0133f89-c4d2-43e8-a9ef-5f0222bdc104" status: 200 len: 1316 microversion: 2.1 time: 0.272739 Dec 16 15:32:13.188435 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1044/2095] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:32:12 2021] GET /compute/v2.1/servers/d0133f89-c4d2-43e8-a9ef-5f0222bdc104 => generated 1316 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:32:14.215540 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-c0450c5d-ce73-4dc5-9a92-904b08f07dd3 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:32:14.216103 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-c0450c5d-ce73-4dc5-9a92-904b08f07dd3 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: d0133f89-c4d2-43e8-a9ef-5f0222bdc104] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:32:14.224233 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c0450c5d-ce73-4dc5-9a92-904b08f07dd3 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:14.224908 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c0450c5d-ce73-4dc5-9a92-904b08f07dd3 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:14.225938 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c0450c5d-ce73-4dc5-9a92-904b08f07dd3 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:14.226566 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c0450c5d-ce73-4dc5-9a92-904b08f07dd3 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:14.460587 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-c0450c5d-ce73-4dc5-9a92-904b08f07dd3 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f509993aaae6478b92d6e5caaf2a7dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962338c57e5c46ef84460b3dc1a0afea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:32:14.469741 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-c0450c5d-ce73-4dc5-9a92-904b08f07dd3 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "GET /compute/v2.1/servers/d0133f89-c4d2-43e8-a9ef-5f0222bdc104" status: 200 len: 1316 microversion: 2.1 time: 0.262753 Dec 16 15:32:14.470355 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1052/2096] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:32:14 2021] GET /compute/v2.1/servers/d0133f89-c4d2-43e8-a9ef-5f0222bdc104 => generated 1316 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:32:15.492360 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-9893fd8b-73fe-4955-b2e3-49a68330514c tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:32:15.493068 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-9893fd8b-73fe-4955-b2e3-49a68330514c tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: d0133f89-c4d2-43e8-a9ef-5f0222bdc104] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:32:15.501381 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9893fd8b-73fe-4955-b2e3-49a68330514c tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:15.504555 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9893fd8b-73fe-4955-b2e3-49a68330514c tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:15.505484 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9893fd8b-73fe-4955-b2e3-49a68330514c tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:15.505979 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9893fd8b-73fe-4955-b2e3-49a68330514c tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:15.759440 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-9893fd8b-73fe-4955-b2e3-49a68330514c tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f509993aaae6478b92d6e5caaf2a7dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962338c57e5c46ef84460b3dc1a0afea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:32:15.769523 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-9893fd8b-73fe-4955-b2e3-49a68330514c tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "GET /compute/v2.1/servers/d0133f89-c4d2-43e8-a9ef-5f0222bdc104" status: 200 len: 1316 microversion: 2.1 time: 0.285481 Dec 16 15:32:15.770780 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1045/2097] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:32:15 2021] GET /compute/v2.1/servers/d0133f89-c4d2-43e8-a9ef-5f0222bdc104 => generated 1316 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:32:15.839568 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [req-ac2c7cba-f7a6-4779-8c57-b14011cfa1b3 req-6f7000de-12b0-4ae4-9535-08cdf34c72c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0133f89-c4d2-43e8-a9ef-5f0222bdc104", "name": "network-vif-plugged", "status": "completed", "tag": "29c539d0-bf3c-431b-a920-17c04ec109e1"}]} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:32:15.846563 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:32:15.846563 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: warnings.warn(msg) Dec 16 15:32:15.855688 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-ac2c7cba-f7a6-4779-8c57-b14011cfa1b3 req-6f7000de-12b0-4ae4-9535-08cdf34c72c3 service nova] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:15.858166 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-ac2c7cba-f7a6-4779-8c57-b14011cfa1b3 req-6f7000de-12b0-4ae4-9535-08cdf34c72c3 service nova] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:15.873631 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.compute.server_external_events [req-ac2c7cba-f7a6-4779-8c57-b14011cfa1b3 req-6f7000de-12b0-4ae4-9535-08cdf34c72c3 service nova] Creating event network-vif-plugged:29c539d0-bf3c-431b-a920-17c04ec109e1 for instance d0133f89-c4d2-43e8-a9ef-5f0222bdc104 on hv-cinder-82189 Dec 16 15:32:15.879225 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [req-ac2c7cba-f7a6-4779-8c57-b14011cfa1b3 req-6f7000de-12b0-4ae4-9535-08cdf34c72c3 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047636 Dec 16 15:32:15.879735 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1053/2098] 10.222.0.45 () {64 vars in 1308 bytes} [Thu Dec 16 15:32:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:32:16.795652 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-b94b3c76-e468-4b30-9e8d-2e6ecd8f44b5 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:32:16.796463 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-b94b3c76-e468-4b30-9e8d-2e6ecd8f44b5 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: d0133f89-c4d2-43e8-a9ef-5f0222bdc104] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:32:16.804447 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b94b3c76-e468-4b30-9e8d-2e6ecd8f44b5 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:16.805128 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b94b3c76-e468-4b30-9e8d-2e6ecd8f44b5 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:16.805788 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b94b3c76-e468-4b30-9e8d-2e6ecd8f44b5 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:16.806310 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b94b3c76-e468-4b30-9e8d-2e6ecd8f44b5 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:17.031212 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-b94b3c76-e468-4b30-9e8d-2e6ecd8f44b5 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f509993aaae6478b92d6e5caaf2a7dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962338c57e5c46ef84460b3dc1a0afea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:32:17.040216 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-b94b3c76-e468-4b30-9e8d-2e6ecd8f44b5 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "GET /compute/v2.1/servers/d0133f89-c4d2-43e8-a9ef-5f0222bdc104" status: 200 len: 1316 microversion: 2.1 time: 0.253801 Dec 16 15:32:17.040814 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1046/2099] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:32:16 2021] GET /compute/v2.1/servers/d0133f89-c4d2-43e8-a9ef-5f0222bdc104 => generated 1316 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:32:18.067316 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-b665cbe4-fa80-4066-a79f-f7150d1da7f8 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:32:18.068091 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-b665cbe4-fa80-4066-a79f-f7150d1da7f8 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: d0133f89-c4d2-43e8-a9ef-5f0222bdc104] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:32:18.076965 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b665cbe4-fa80-4066-a79f-f7150d1da7f8 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:18.077461 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b665cbe4-fa80-4066-a79f-f7150d1da7f8 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:18.078350 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b665cbe4-fa80-4066-a79f-f7150d1da7f8 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:18.078822 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b665cbe4-fa80-4066-a79f-f7150d1da7f8 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:18.351816 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-b665cbe4-fa80-4066-a79f-f7150d1da7f8 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f509993aaae6478b92d6e5caaf2a7dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962338c57e5c46ef84460b3dc1a0afea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:32:18.362756 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-b665cbe4-fa80-4066-a79f-f7150d1da7f8 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "GET /compute/v2.1/servers/d0133f89-c4d2-43e8-a9ef-5f0222bdc104" status: 200 len: 1316 microversion: 2.1 time: 0.306618 Dec 16 15:32:18.363380 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1054/2100] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:32:18 2021] GET /compute/v2.1/servers/d0133f89-c4d2-43e8-a9ef-5f0222bdc104 => generated 1316 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:32:19.385701 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-4d7ad400-60fa-4383-ad19-61236c863eb8 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:32:19.386281 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-4d7ad400-60fa-4383-ad19-61236c863eb8 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: d0133f89-c4d2-43e8-a9ef-5f0222bdc104] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:32:19.396408 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4d7ad400-60fa-4383-ad19-61236c863eb8 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:19.397341 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4d7ad400-60fa-4383-ad19-61236c863eb8 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:19.398566 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4d7ad400-60fa-4383-ad19-61236c863eb8 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:19.398763 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4d7ad400-60fa-4383-ad19-61236c863eb8 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:19.632362 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-4d7ad400-60fa-4383-ad19-61236c863eb8 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f509993aaae6478b92d6e5caaf2a7dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962338c57e5c46ef84460b3dc1a0afea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:32:19.641312 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-4d7ad400-60fa-4383-ad19-61236c863eb8 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "GET /compute/v2.1/servers/d0133f89-c4d2-43e8-a9ef-5f0222bdc104" status: 200 len: 1506 microversion: 2.1 time: 0.264569 Dec 16 15:32:19.641893 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1047/2101] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:32:19 2021] GET /compute/v2.1/servers/d0133f89-c4d2-43e8-a9ef-5f0222bdc104 => generated 1506 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:32:22.780689 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-e33a25ae-f76a-4dcf-b6c1-05bd899cf70d tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a4d4740b-9ea4-4592-90ba-8d439dff8482"}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:32:22.781907 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-e33a25ae-f76a-4dcf-b6c1-05bd899cf70d tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: d0133f89-c4d2-43e8-a9ef-5f0222bdc104] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:32:22.790030 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e33a25ae-f76a-4dcf-b6c1-05bd899cf70d tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:22.790631 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e33a25ae-f76a-4dcf-b6c1-05bd899cf70d tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:22.791706 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e33a25ae-f76a-4dcf-b6c1-05bd899cf70d tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:22.795512 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e33a25ae-f76a-4dcf-b6c1-05bd899cf70d tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:23.536681 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-e33a25ae-f76a-4dcf-b6c1-05bd899cf70d tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "POST /compute/v2.1/servers/d0133f89-c4d2-43e8-a9ef-5f0222bdc104/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.764326 Dec 16 15:32:23.537643 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1055/2102] 10.222.0.45 () {60 vars in 1313 bytes} [Thu Dec 16 15:32:22 2021] POST /compute/v2.1/servers/d0133f89-c4d2-43e8-a9ef-5f0222bdc104/os-volume_attachments => generated 194 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 15:32:27.366601 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-2d3a0867-f4bd-46b6-979c-bd8e41bdb703 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-710632216", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1519735302", "security_groups": [{"name": "tempest-secgroup-smoke-1827351747"}], "block_device_mapping_v2": [{"uuid": "b6291f8a-55f7-44a8-954d-7e6c7b63893d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "888cf1c9-54d5-43ec-9d53-9903be1aba42"}]}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:32:27.590994 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.network.neutron [None req-2d3a0867-f4bd-46b6-979c-bd8e41bdb703 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] validate_networks() for [('888cf1c9-54d5-43ec-9d53-9903be1aba42', None, None, None)] {{(pid=101355) validate_networks /opt/stack/nova/nova/network/neutron.py:2383}} Dec 16 15:32:28.191518 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.virt.hardware [None req-2d3a0867-f4bd-46b6-979c-bd8e41bdb703 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Flavor limits 0:0:0 {{(pid=101355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:338}} Dec 16 15:32:28.192020 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.virt.hardware [None req-2d3a0867-f4bd-46b6-979c-bd8e41bdb703 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Image limits 0:0:0 {{(pid=101355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:342}} Dec 16 15:32:28.192554 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.virt.hardware [None req-2d3a0867-f4bd-46b6-979c-bd8e41bdb703 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Flavor pref 0:0:0 {{(pid=101355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:378}} Dec 16 15:32:28.193008 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.virt.hardware [None req-2d3a0867-f4bd-46b6-979c-bd8e41bdb703 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Image pref 0:0:0 {{(pid=101355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:382}} Dec 16 15:32:28.193573 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.virt.hardware [None req-2d3a0867-f4bd-46b6-979c-bd8e41bdb703 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=101355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:422}} Dec 16 15:32:28.202870 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2d3a0867-f4bd-46b6-979c-bd8e41bdb703 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:28.203860 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2d3a0867-f4bd-46b6-979c-bd8e41bdb703 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:28.204234 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2d3a0867-f4bd-46b6-979c-bd8e41bdb703 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:28.204721 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2d3a0867-f4bd-46b6-979c-bd8e41bdb703 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:28.226803 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.quota [None req-2d3a0867-f4bd-46b6-979c-bd8e41bdb703 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Getting quotas for project 211699de14224a63a48d253eaa061c69. Resources: {'ram', 'instances', 'cores'} {{(pid=101355) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 16 15:32:28.230877 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.quota [None req-2d3a0867-f4bd-46b6-979c-bd8e41bdb703 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Getting quotas for user 7508cb16ab6343dfb7de72c6b3600ae8 and project 211699de14224a63a48d253eaa061c69. Resources: {'ram', 'instances', 'cores'} {{(pid=101355) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 16 15:32:28.350098 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-2d3a0867-f4bd-46b6-979c-bd8e41bdb703 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Going to run 1 instances... {{(pid=101355) _provision_instances /opt/stack/nova/nova/compute/api.py:1224}} Dec 16 15:32:28.353735 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-2d3a0867-f4bd-46b6-979c-bd8e41bdb703 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] [instance: cd530067-1ba5-46f5-8d47-2dac866e61c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b6291f8a-55f7-44a8-954d-7e6c7b63893d',volume_size=None,volume_type=None)] {{(pid=101355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1616}} Dec 16 15:32:28.713449 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-2d3a0867-f4bd-46b6-979c-bd8e41bdb703 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.354723 Dec 16 15:32:28.715647 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1048/2103] 10.222.0.45 () {60 vars in 1137 bytes} [Thu Dec 16 15:32:27 2021] POST /compute/v2.1/servers => generated 406 bytes in 1358 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 16 15:32:28.731550 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-09075576-f410-4ef9-bf9f-c5a276e9e59d tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:32:28.732313 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-09075576-f410-4ef9-bf9f-c5a276e9e59d tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] [instance: cd530067-1ba5-46f5-8d47-2dac866e61c1] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:32:28.904685 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-09075576-f410-4ef9-bf9f-c5a276e9e59d tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508cb16ab6343dfb7de72c6b3600ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211699de14224a63a48d253eaa061c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:32:28.914700 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-09075576-f410-4ef9-bf9f-c5a276e9e59d tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] 10.222.0.45 "GET /compute/v2.1/servers/cd530067-1ba5-46f5-8d47-2dac866e61c1" status: 200 len: 1094 microversion: 2.1 time: 0.192284 Dec 16 15:32:28.924546 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1056/2104] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:32:28 2021] GET /compute/v2.1/servers/cd530067-1ba5-46f5-8d47-2dac866e61c1 => generated 1094 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:32:29.938491 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-463435af-0509-42b0-ac9b-27b53568f083 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:32:29.939731 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-463435af-0509-42b0-ac9b-27b53568f083 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] [instance: cd530067-1ba5-46f5-8d47-2dac866e61c1] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:32:29.951655 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-463435af-0509-42b0-ac9b-27b53568f083 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:29.952148 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-463435af-0509-42b0-ac9b-27b53568f083 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:29.953014 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-463435af-0509-42b0-ac9b-27b53568f083 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:29.953506 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-463435af-0509-42b0-ac9b-27b53568f083 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:30.092618 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-463435af-0509-42b0-ac9b-27b53568f083 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508cb16ab6343dfb7de72c6b3600ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211699de14224a63a48d253eaa061c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:32:30.102830 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-463435af-0509-42b0-ac9b-27b53568f083 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] 10.222.0.45 "GET /compute/v2.1/servers/cd530067-1ba5-46f5-8d47-2dac866e61c1" status: 200 len: 1136 microversion: 2.1 time: 0.172955 Dec 16 15:32:30.103450 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1049/2105] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:32:29 2021] GET /compute/v2.1/servers/cd530067-1ba5-46f5-8d47-2dac866e61c1 => generated 1136 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:32:31.127785 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-00b9a36f-6596-4655-aed3-08df147eb842 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:32:31.129067 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-00b9a36f-6596-4655-aed3-08df147eb842 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] [instance: cd530067-1ba5-46f5-8d47-2dac866e61c1] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:32:31.139110 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-00b9a36f-6596-4655-aed3-08df147eb842 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:31.140091 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-00b9a36f-6596-4655-aed3-08df147eb842 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:31.141130 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-00b9a36f-6596-4655-aed3-08df147eb842 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:31.141789 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-00b9a36f-6596-4655-aed3-08df147eb842 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:31.287345 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-00b9a36f-6596-4655-aed3-08df147eb842 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508cb16ab6343dfb7de72c6b3600ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211699de14224a63a48d253eaa061c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:32:31.298540 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-00b9a36f-6596-4655-aed3-08df147eb842 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] 10.222.0.45 "GET /compute/v2.1/servers/cd530067-1ba5-46f5-8d47-2dac866e61c1" status: 200 len: 1210 microversion: 2.1 time: 0.179641 Dec 16 15:32:31.299429 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1057/2106] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:32:31 2021] GET /compute/v2.1/servers/cd530067-1ba5-46f5-8d47-2dac866e61c1 => generated 1210 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:32:31.821071 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-f47bf734-6de0-4156-b336-dac5ce9fd80a tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a4d4740b-9ea4-4592-90ba-8d439dff8482"}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:32:31.822539 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-f47bf734-6de0-4156-b336-dac5ce9fd80a tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: d0133f89-c4d2-43e8-a9ef-5f0222bdc104] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:32:31.832499 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f47bf734-6de0-4156-b336-dac5ce9fd80a tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:31.833030 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f47bf734-6de0-4156-b336-dac5ce9fd80a tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:31.833999 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f47bf734-6de0-4156-b336-dac5ce9fd80a tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:31.834567 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f47bf734-6de0-4156-b336-dac5ce9fd80a tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:31.914203 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.wsgi [None req-f47bf734-6de0-4156-b336-dac5ce9fd80a tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] HTTP exception thrown: Invalid volume: volume a4d4740b-9ea4-4592-90ba-8d439dff8482 already attached Dec 16 15:32:31.914856 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-f47bf734-6de0-4156-b336-dac5ce9fd80a tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Returning 400 to user: Invalid volume: volume a4d4740b-9ea4-4592-90ba-8d439dff8482 already attached {{(pid=101355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:941}} Dec 16 15:32:31.916179 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-f47bf734-6de0-4156-b336-dac5ce9fd80a tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "POST /compute/v2.1/servers/d0133f89-c4d2-43e8-a9ef-5f0222bdc104/os-volume_attachments" status: 400 len: 120 microversion: 2.1 time: 0.103273 Dec 16 15:32:31.916976 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1050/2107] 10.222.0.45 () {60 vars in 1313 bytes} [Thu Dec 16 15:32:31 2021] POST /compute/v2.1/servers/d0133f89-c4d2-43e8-a9ef-5f0222bdc104/os-volume_attachments => generated 120 bytes in 105 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 16 15:32:32.083205 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-1d96c0b3-c7ec-433d-95d5-ec42c3578b87 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:32:32.083918 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-1d96c0b3-c7ec-433d-95d5-ec42c3578b87 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: d0133f89-c4d2-43e8-a9ef-5f0222bdc104] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:32:32.092575 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1d96c0b3-c7ec-433d-95d5-ec42c3578b87 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:32.093080 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1d96c0b3-c7ec-433d-95d5-ec42c3578b87 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:32.094130 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1d96c0b3-c7ec-433d-95d5-ec42c3578b87 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:32.094615 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1d96c0b3-c7ec-433d-95d5-ec42c3578b87 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:32.160976 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 15:32:32.161513 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: Thu Dec 16 15:32:32 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d0133f89-c4d2-43e8-a9ef-5f0222bdc104/os-volume_attachments/a4d4740b-9ea4-4592-90ba-8d439dff8482 (ip 10.222.0.45) !!! Dec 16 15:32:32.173279 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 15:32:32.173519 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: Thu Dec 16 15:32:32 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d0133f89-c4d2-43e8-a9ef-5f0222bdc104/os-volume_attachments/a4d4740b-9ea4-4592-90ba-8d439dff8482 (ip 10.222.0.45) !!! Dec 16 15:32:32.329840 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-c054a718-e2ab-4082-82c5-c1f8ba8f1f8a tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:32:32.330529 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-c054a718-e2ab-4082-82c5-c1f8ba8f1f8a tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] [instance: cd530067-1ba5-46f5-8d47-2dac866e61c1] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:32:32.355346 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c054a718-e2ab-4082-82c5-c1f8ba8f1f8a tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:32.356111 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c054a718-e2ab-4082-82c5-c1f8ba8f1f8a tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:32.357356 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c054a718-e2ab-4082-82c5-c1f8ba8f1f8a tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:32.358053 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c054a718-e2ab-4082-82c5-c1f8ba8f1f8a tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:32.665176 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-1d96c0b3-c7ec-433d-95d5-ec42c3578b87 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "DELETE /compute/v2.1/servers/d0133f89-c4d2-43e8-a9ef-5f0222bdc104/os-volume_attachments/a4d4740b-9ea4-4592-90ba-8d439dff8482" status: 202 len: 0 microversion: 2.1 time: 0.592399 Dec 16 15:32:32.667246 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1058/2108] 10.222.0.45 () {58 vars in 1406 bytes} [Thu Dec 16 15:32:32 2021] DELETE /compute/v2.1/servers/d0133f89-c4d2-43e8-a9ef-5f0222bdc104/os-volume_attachments/a4d4740b-9ea4-4592-90ba-8d439dff8482 => generated 0 bytes in 595 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:32:32.691135 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-dcad253e-8543-4a15-ba39-4fa8e57aedd0 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:32:32.695690 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-dcad253e-8543-4a15-ba39-4fa8e57aedd0 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: d0133f89-c4d2-43e8-a9ef-5f0222bdc104] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:32:32.703203 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-dcad253e-8543-4a15-ba39-4fa8e57aedd0 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:32.703710 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-dcad253e-8543-4a15-ba39-4fa8e57aedd0 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:32.704607 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-dcad253e-8543-4a15-ba39-4fa8e57aedd0 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:32.705174 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-dcad253e-8543-4a15-ba39-4fa8e57aedd0 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:32.960583 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-dcad253e-8543-4a15-ba39-4fa8e57aedd0 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "GET /compute/v2.1/servers/d0133f89-c4d2-43e8-a9ef-5f0222bdc104/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.287953 Dec 16 15:32:32.961428 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1059/2109] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:32:32 2021] GET /compute/v2.1/servers/d0133f89-c4d2-43e8-a9ef-5f0222bdc104/os-volume_attachments => generated 197 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 15:32:32.988159 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-c054a718-e2ab-4082-82c5-c1f8ba8f1f8a tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508cb16ab6343dfb7de72c6b3600ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211699de14224a63a48d253eaa061c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:32:33.001134 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-c054a718-e2ab-4082-82c5-c1f8ba8f1f8a tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] 10.222.0.45 "GET /compute/v2.1/servers/cd530067-1ba5-46f5-8d47-2dac866e61c1" status: 200 len: 1278 microversion: 2.1 time: 0.679467 Dec 16 15:32:33.001974 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1051/2110] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:32:32 2021] GET /compute/v2.1/servers/cd530067-1ba5-46f5-8d47-2dac866e61c1 => generated 1278 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:32:33.985199 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-b4b33747-ba95-438b-8d64-894b946edb05 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:32:33.987341 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-b4b33747-ba95-438b-8d64-894b946edb05 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: d0133f89-c4d2-43e8-a9ef-5f0222bdc104] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:32:33.999190 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b4b33747-ba95-438b-8d64-894b946edb05 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:34.000468 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b4b33747-ba95-438b-8d64-894b946edb05 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:34.001370 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b4b33747-ba95-438b-8d64-894b946edb05 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:34.001869 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b4b33747-ba95-438b-8d64-894b946edb05 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:34.015901 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [req-b98e586e-8751-407d-aa6d-9dd6cccc59c2 req-d5d27918-736a-411f-8920-290d9029d63a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd530067-1ba5-46f5-8d47-2dac866e61c1", "tag": "0e4d14e0-cb79-43cb-9b80-5ced96d4c2b7"}]} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:32:34.024899 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:32:34.024899 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: warnings.warn(msg) Dec 16 15:32:34.041212 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-b98e586e-8751-407d-aa6d-9dd6cccc59c2 req-d5d27918-736a-411f-8920-290d9029d63a service nova] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:34.041212 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-b98e586e-8751-407d-aa6d-9dd6cccc59c2 req-d5d27918-736a-411f-8920-290d9029d63a service nova] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:34.061851 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.compute.server_external_events [req-b98e586e-8751-407d-aa6d-9dd6cccc59c2 req-d5d27918-736a-411f-8920-290d9029d63a service nova] Creating event network-changed:0e4d14e0-cb79-43cb-9b80-5ced96d4c2b7 for instance cd530067-1ba5-46f5-8d47-2dac866e61c1 on hv-cinder-82189 Dec 16 15:32:34.067378 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [req-b98e586e-8751-407d-aa6d-9dd6cccc59c2 req-d5d27918-736a-411f-8920-290d9029d63a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083676 Dec 16 15:32:34.068360 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1052/2111] 10.222.0.45 () {64 vars in 1308 bytes} [Thu Dec 16 15:32:33 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:32:34.091283 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-5d280085-05fc-4167-b9ee-904c66061517 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:32:34.093784 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-5d280085-05fc-4167-b9ee-904c66061517 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] [instance: cd530067-1ba5-46f5-8d47-2dac866e61c1] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:32:34.108629 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5d280085-05fc-4167-b9ee-904c66061517 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:34.109343 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5d280085-05fc-4167-b9ee-904c66061517 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:34.110531 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5d280085-05fc-4167-b9ee-904c66061517 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:34.111249 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5d280085-05fc-4167-b9ee-904c66061517 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:34.190007 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-b4b33747-ba95-438b-8d64-894b946edb05 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "GET /compute/v2.1/servers/d0133f89-c4d2-43e8-a9ef-5f0222bdc104/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.220130 Dec 16 15:32:34.194347 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1060/2112] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:32:33 2021] GET /compute/v2.1/servers/d0133f89-c4d2-43e8-a9ef-5f0222bdc104/os-volume_attachments => generated 197 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:32:34.550436 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-5d280085-05fc-4167-b9ee-904c66061517 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508cb16ab6343dfb7de72c6b3600ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211699de14224a63a48d253eaa061c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:32:34.561067 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-5d280085-05fc-4167-b9ee-904c66061517 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] 10.222.0.45 "GET /compute/v2.1/servers/cd530067-1ba5-46f5-8d47-2dac866e61c1" status: 200 len: 1266 microversion: 2.1 time: 0.491151 Dec 16 15:32:34.561695 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1053/2113] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:32:34 2021] GET /compute/v2.1/servers/cd530067-1ba5-46f5-8d47-2dac866e61c1 => generated 1266 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:32:35.214633 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-ddb2403f-e1a2-4fed-b175-19a062b3f2b0 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:32:35.215701 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-ddb2403f-e1a2-4fed-b175-19a062b3f2b0 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: d0133f89-c4d2-43e8-a9ef-5f0222bdc104] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:32:35.224886 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ddb2403f-e1a2-4fed-b175-19a062b3f2b0 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:35.225401 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ddb2403f-e1a2-4fed-b175-19a062b3f2b0 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:35.226496 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ddb2403f-e1a2-4fed-b175-19a062b3f2b0 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:35.226997 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ddb2403f-e1a2-4fed-b175-19a062b3f2b0 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:35.327726 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-ddb2403f-e1a2-4fed-b175-19a062b3f2b0 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "GET /compute/v2.1/servers/d0133f89-c4d2-43e8-a9ef-5f0222bdc104/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.128595 Dec 16 15:32:35.329132 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1061/2114] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:32:35 2021] GET /compute/v2.1/servers/d0133f89-c4d2-43e8-a9ef-5f0222bdc104/os-volume_attachments => generated 25 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 15:32:35.587041 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-a6e6efa2-3e81-4021-b640-4b15d76d5f01 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:32:35.587840 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-a6e6efa2-3e81-4021-b640-4b15d76d5f01 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] [instance: cd530067-1ba5-46f5-8d47-2dac866e61c1] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:32:35.598335 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a6e6efa2-3e81-4021-b640-4b15d76d5f01 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:35.599193 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a6e6efa2-3e81-4021-b640-4b15d76d5f01 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:35.600066 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a6e6efa2-3e81-4021-b640-4b15d76d5f01 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:35.600536 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a6e6efa2-3e81-4021-b640-4b15d76d5f01 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:35.622033 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-976b02eb-47a8-4678-8b5c-5cc38581d5f5 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2088377344", "imageRef": "9b00ff4e-db72-4324-820b-87a6bd73b055", "flavorRef": "452", "networks": [{"uuid": "93ae9bca-879a-41a2-8378-cb0164469bca"}]}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:32:35.708699 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.network.neutron [None req-976b02eb-47a8-4678-8b5c-5cc38581d5f5 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] validate_networks() for [('93ae9bca-879a-41a2-8378-cb0164469bca', None, None, None)] {{(pid=101356) validate_networks /opt/stack/nova/nova/network/neutron.py:2383}} Dec 16 15:32:35.843857 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-a6e6efa2-3e81-4021-b640-4b15d76d5f01 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508cb16ab6343dfb7de72c6b3600ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211699de14224a63a48d253eaa061c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:32:35.853570 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-a6e6efa2-3e81-4021-b640-4b15d76d5f01 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] 10.222.0.45 "GET /compute/v2.1/servers/cd530067-1ba5-46f5-8d47-2dac866e61c1" status: 200 len: 1266 microversion: 2.1 time: 0.277292 Dec 16 15:32:35.854242 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1054/2115] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:32:35 2021] GET /compute/v2.1/servers/cd530067-1ba5-46f5-8d47-2dac866e61c1 => generated 1266 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:32:36.512559 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.virt.hardware [None req-976b02eb-47a8-4678-8b5c-5cc38581d5f5 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Flavor limits 0:0:0 {{(pid=101356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:338}} Dec 16 15:32:36.513092 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.virt.hardware [None req-976b02eb-47a8-4678-8b5c-5cc38581d5f5 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Image limits 0:0:0 {{(pid=101356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:342}} Dec 16 15:32:36.513560 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.virt.hardware [None req-976b02eb-47a8-4678-8b5c-5cc38581d5f5 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Flavor pref 0:0:0 {{(pid=101356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:378}} Dec 16 15:32:36.514029 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.virt.hardware [None req-976b02eb-47a8-4678-8b5c-5cc38581d5f5 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Image pref 0:0:0 {{(pid=101356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:382}} Dec 16 15:32:36.514544 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.virt.hardware [None req-976b02eb-47a8-4678-8b5c-5cc38581d5f5 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=101356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:422}} Dec 16 15:32:36.531606 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-976b02eb-47a8-4678-8b5c-5cc38581d5f5 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:36.532117 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-976b02eb-47a8-4678-8b5c-5cc38581d5f5 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:36.533031 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-976b02eb-47a8-4678-8b5c-5cc38581d5f5 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:36.533556 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-976b02eb-47a8-4678-8b5c-5cc38581d5f5 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:36.559665 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.quota [None req-976b02eb-47a8-4678-8b5c-5cc38581d5f5 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Getting quotas for project 962338c57e5c46ef84460b3dc1a0afea. Resources: {'ram', 'instances', 'cores'} {{(pid=101356) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 16 15:32:36.565939 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.quota [None req-976b02eb-47a8-4678-8b5c-5cc38581d5f5 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Getting quotas for user f509993aaae6478b92d6e5caaf2a7dec and project 962338c57e5c46ef84460b3dc1a0afea. Resources: {'ram', 'instances', 'cores'} {{(pid=101356) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 16 15:32:36.578326 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-976b02eb-47a8-4678-8b5c-5cc38581d5f5 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Going to run 1 instances... {{(pid=101356) _provision_instances /opt/stack/nova/nova/compute/api.py:1224}} Dec 16 15:32:36.581038 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-976b02eb-47a8-4678-8b5c-5cc38581d5f5 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: 2d8b0385-ed5c-48a2-9742-64dcb0c0d34e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9b00ff4e-db72-4324-820b-87a6bd73b055',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101356) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1616}} Dec 16 15:32:36.725975 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-976b02eb-47a8-4678-8b5c-5cc38581d5f5 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.111528 Dec 16 15:32:36.726956 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1062/2116] 10.222.0.45 () {60 vars in 1137 bytes} [Thu Dec 16 15:32:35 2021] POST /compute/v2.1/servers => generated 380 bytes in 1113 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 16 15:32:36.747105 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-26a808b3-c2b6-481b-97bc-74f7e539df93 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:32:36.747937 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-26a808b3-c2b6-481b-97bc-74f7e539df93 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: 2d8b0385-ed5c-48a2-9742-64dcb0c0d34e] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:32:36.840045 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-26a808b3-c2b6-481b-97bc-74f7e539df93 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f509993aaae6478b92d6e5caaf2a7dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962338c57e5c46ef84460b3dc1a0afea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:32:36.850157 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-26a808b3-c2b6-481b-97bc-74f7e539df93 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "GET /compute/v2.1/servers/2d8b0385-ed5c-48a2-9742-64dcb0c0d34e" status: 200 len: 1218 microversion: 2.1 time: 0.116057 Dec 16 15:32:36.851306 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1055/2117] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:32:36 2021] GET /compute/v2.1/servers/2d8b0385-ed5c-48a2-9742-64dcb0c0d34e => generated 1218 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:32:36.879463 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-c3f3dede-351c-4c20-a409-19bb871b68ae tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:32:36.880160 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-c3f3dede-351c-4c20-a409-19bb871b68ae tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] [instance: cd530067-1ba5-46f5-8d47-2dac866e61c1] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:32:36.888607 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c3f3dede-351c-4c20-a409-19bb871b68ae tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:36.889114 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c3f3dede-351c-4c20-a409-19bb871b68ae tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:36.889970 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c3f3dede-351c-4c20-a409-19bb871b68ae tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:36.890507 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c3f3dede-351c-4c20-a409-19bb871b68ae tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:37.163462 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-c3f3dede-351c-4c20-a409-19bb871b68ae tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508cb16ab6343dfb7de72c6b3600ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211699de14224a63a48d253eaa061c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:32:37.183666 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-c3f3dede-351c-4c20-a409-19bb871b68ae tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] 10.222.0.45 "GET /compute/v2.1/servers/cd530067-1ba5-46f5-8d47-2dac866e61c1" status: 200 len: 1266 microversion: 2.1 time: 0.316068 Dec 16 15:32:37.185129 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1063/2118] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:32:36 2021] GET /compute/v2.1/servers/cd530067-1ba5-46f5-8d47-2dac866e61c1 => generated 1266 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:32:37.875162 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-a83dab23-2c46-4917-bdab-c5c12f9c28aa tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:32:37.875932 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-a83dab23-2c46-4917-bdab-c5c12f9c28aa tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: 2d8b0385-ed5c-48a2-9742-64dcb0c0d34e] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:32:37.884066 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a83dab23-2c46-4917-bdab-c5c12f9c28aa tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:37.884571 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a83dab23-2c46-4917-bdab-c5c12f9c28aa tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:37.885434 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a83dab23-2c46-4917-bdab-c5c12f9c28aa tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:37.886516 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a83dab23-2c46-4917-bdab-c5c12f9c28aa tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:38.165310 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-a83dab23-2c46-4917-bdab-c5c12f9c28aa tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f509993aaae6478b92d6e5caaf2a7dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962338c57e5c46ef84460b3dc1a0afea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:32:38.175628 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-a83dab23-2c46-4917-bdab-c5c12f9c28aa tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "GET /compute/v2.1/servers/2d8b0385-ed5c-48a2-9742-64dcb0c0d34e" status: 200 len: 1214 microversion: 2.1 time: 0.309890 Dec 16 15:32:38.176256 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1056/2119] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:32:37 2021] GET /compute/v2.1/servers/2d8b0385-ed5c-48a2-9742-64dcb0c0d34e => generated 1214 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:32:38.219398 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-47d57335-bc0d-4e8a-9e24-4e95b644396a tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:32:38.220069 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-47d57335-bc0d-4e8a-9e24-4e95b644396a tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] [instance: cd530067-1ba5-46f5-8d47-2dac866e61c1] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:32:38.235073 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-47d57335-bc0d-4e8a-9e24-4e95b644396a tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:38.235949 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-47d57335-bc0d-4e8a-9e24-4e95b644396a tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:38.237377 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-47d57335-bc0d-4e8a-9e24-4e95b644396a tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:38.238514 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-47d57335-bc0d-4e8a-9e24-4e95b644396a tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:38.533563 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-47d57335-bc0d-4e8a-9e24-4e95b644396a tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508cb16ab6343dfb7de72c6b3600ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211699de14224a63a48d253eaa061c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:32:38.543815 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-47d57335-bc0d-4e8a-9e24-4e95b644396a tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] 10.222.0.45 "GET /compute/v2.1/servers/cd530067-1ba5-46f5-8d47-2dac866e61c1" status: 200 len: 1266 microversion: 2.1 time: 0.336248 Dec 16 15:32:38.544440 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1064/2120] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:32:38 2021] GET /compute/v2.1/servers/cd530067-1ba5-46f5-8d47-2dac866e61c1 => generated 1266 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:32:39.202110 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-a671282c-b81c-4880-8cd6-1b4e12c523c5 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:32:39.202867 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-a671282c-b81c-4880-8cd6-1b4e12c523c5 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: 2d8b0385-ed5c-48a2-9742-64dcb0c0d34e] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:32:39.210949 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a671282c-b81c-4880-8cd6-1b4e12c523c5 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:39.211456 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a671282c-b81c-4880-8cd6-1b4e12c523c5 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:39.212307 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a671282c-b81c-4880-8cd6-1b4e12c523c5 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:39.212866 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a671282c-b81c-4880-8cd6-1b4e12c523c5 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:39.400086 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-a671282c-b81c-4880-8cd6-1b4e12c523c5 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f509993aaae6478b92d6e5caaf2a7dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962338c57e5c46ef84460b3dc1a0afea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:32:39.410986 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-a671282c-b81c-4880-8cd6-1b4e12c523c5 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "GET /compute/v2.1/servers/2d8b0385-ed5c-48a2-9742-64dcb0c0d34e" status: 200 len: 1276 microversion: 2.1 time: 0.219016 Dec 16 15:32:39.411637 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1057/2121] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:32:39 2021] GET /compute/v2.1/servers/2d8b0385-ed5c-48a2-9742-64dcb0c0d34e => generated 1276 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:32:39.571339 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-396d1f1b-7536-4917-8690-0bfc1ec5184d tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:32:39.572346 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-396d1f1b-7536-4917-8690-0bfc1ec5184d tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] [instance: cd530067-1ba5-46f5-8d47-2dac866e61c1] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:32:39.586200 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-396d1f1b-7536-4917-8690-0bfc1ec5184d tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:39.586973 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-396d1f1b-7536-4917-8690-0bfc1ec5184d tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:39.588417 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-396d1f1b-7536-4917-8690-0bfc1ec5184d tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:39.589294 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-396d1f1b-7536-4917-8690-0bfc1ec5184d tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:39.833988 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-396d1f1b-7536-4917-8690-0bfc1ec5184d tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508cb16ab6343dfb7de72c6b3600ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211699de14224a63a48d253eaa061c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:32:39.843317 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-396d1f1b-7536-4917-8690-0bfc1ec5184d tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] 10.222.0.45 "GET /compute/v2.1/servers/cd530067-1ba5-46f5-8d47-2dac866e61c1" status: 200 len: 1266 microversion: 2.1 time: 0.284191 Dec 16 15:32:39.847040 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1065/2122] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:32:39 2021] GET /compute/v2.1/servers/cd530067-1ba5-46f5-8d47-2dac866e61c1 => generated 1266 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:32:40.435585 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-04262e97-b10f-4419-9d43-32e4a4147df1 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:32:40.436292 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-04262e97-b10f-4419-9d43-32e4a4147df1 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: 2d8b0385-ed5c-48a2-9742-64dcb0c0d34e] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:32:40.444779 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-04262e97-b10f-4419-9d43-32e4a4147df1 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:40.445298 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-04262e97-b10f-4419-9d43-32e4a4147df1 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:40.446201 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-04262e97-b10f-4419-9d43-32e4a4147df1 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:40.446703 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-04262e97-b10f-4419-9d43-32e4a4147df1 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:40.868688 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-4edbb64d-c113-43dc-9519-e1371ce735e9 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:32:40.869508 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-4edbb64d-c113-43dc-9519-e1371ce735e9 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] [instance: cd530067-1ba5-46f5-8d47-2dac866e61c1] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:32:40.878771 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4edbb64d-c113-43dc-9519-e1371ce735e9 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:40.879498 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4edbb64d-c113-43dc-9519-e1371ce735e9 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:40.880534 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4edbb64d-c113-43dc-9519-e1371ce735e9 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:40.881029 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4edbb64d-c113-43dc-9519-e1371ce735e9 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:40.958989 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-04262e97-b10f-4419-9d43-32e4a4147df1 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f509993aaae6478b92d6e5caaf2a7dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962338c57e5c46ef84460b3dc1a0afea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:32:40.969348 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-04262e97-b10f-4419-9d43-32e4a4147df1 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "GET /compute/v2.1/servers/2d8b0385-ed5c-48a2-9742-64dcb0c0d34e" status: 200 len: 1318 microversion: 2.1 time: 0.541667 Dec 16 15:32:40.974665 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1058/2123] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:32:40 2021] GET /compute/v2.1/servers/2d8b0385-ed5c-48a2-9742-64dcb0c0d34e => generated 1318 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:32:41.126455 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-4edbb64d-c113-43dc-9519-e1371ce735e9 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508cb16ab6343dfb7de72c6b3600ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211699de14224a63a48d253eaa061c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:32:41.135790 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-4edbb64d-c113-43dc-9519-e1371ce735e9 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] 10.222.0.45 "GET /compute/v2.1/servers/cd530067-1ba5-46f5-8d47-2dac866e61c1" status: 200 len: 1266 microversion: 2.1 time: 0.275803 Dec 16 15:32:41.136394 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1066/2124] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:32:40 2021] GET /compute/v2.1/servers/cd530067-1ba5-46f5-8d47-2dac866e61c1 => generated 1266 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:32:41.324845 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [req-68227e8a-ba68-4313-a21f-c599b17b05c4 req-0d374024-c6d2-4d0e-bec0-79b852b798cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d8b0385-ed5c-48a2-9742-64dcb0c0d34e", "tag": "2c1fbf14-1cd5-4ac3-876e-5e2cffc34def"}]} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:32:41.329939 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:32:41.329939 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: warnings.warn(msg) Dec 16 15:32:41.342581 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-68227e8a-ba68-4313-a21f-c599b17b05c4 req-0d374024-c6d2-4d0e-bec0-79b852b798cc service nova] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:41.345297 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-68227e8a-ba68-4313-a21f-c599b17b05c4 req-0d374024-c6d2-4d0e-bec0-79b852b798cc service nova] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:41.361883 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.compute.server_external_events [req-68227e8a-ba68-4313-a21f-c599b17b05c4 req-0d374024-c6d2-4d0e-bec0-79b852b798cc service nova] Creating event network-changed:2c1fbf14-1cd5-4ac3-876e-5e2cffc34def for instance 2d8b0385-ed5c-48a2-9742-64dcb0c0d34e on hv-cinder-82189 Dec 16 15:32:41.367121 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [req-68227e8a-ba68-4313-a21f-c599b17b05c4 req-0d374024-c6d2-4d0e-bec0-79b852b798cc service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050069 Dec 16 15:32:41.367778 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1059/2125] 10.222.0.45 () {64 vars in 1308 bytes} [Thu Dec 16 15:32:41 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:32:41.991994 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-69053ae4-4303-4307-ab60-55135c5abf66 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:32:41.992996 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-69053ae4-4303-4307-ab60-55135c5abf66 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: 2d8b0385-ed5c-48a2-9742-64dcb0c0d34e] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:32:42.001812 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-69053ae4-4303-4307-ab60-55135c5abf66 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:42.002351 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-69053ae4-4303-4307-ab60-55135c5abf66 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:42.003414 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-69053ae4-4303-4307-ab60-55135c5abf66 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:42.003904 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-69053ae4-4303-4307-ab60-55135c5abf66 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:42.157545 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-11b66f21-a995-4655-b977-e3825ea1ae4b tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:32:42.158741 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-11b66f21-a995-4655-b977-e3825ea1ae4b tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] [instance: cd530067-1ba5-46f5-8d47-2dac866e61c1] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:32:42.167987 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-11b66f21-a995-4655-b977-e3825ea1ae4b tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:42.168598 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-11b66f21-a995-4655-b977-e3825ea1ae4b tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:42.169511 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-11b66f21-a995-4655-b977-e3825ea1ae4b tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:42.170103 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-11b66f21-a995-4655-b977-e3825ea1ae4b tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:42.246071 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-69053ae4-4303-4307-ab60-55135c5abf66 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f509993aaae6478b92d6e5caaf2a7dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962338c57e5c46ef84460b3dc1a0afea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:32:42.256460 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-69053ae4-4303-4307-ab60-55135c5abf66 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "GET /compute/v2.1/servers/2d8b0385-ed5c-48a2-9742-64dcb0c0d34e" status: 200 len: 1318 microversion: 2.1 time: 0.272240 Dec 16 15:32:42.257052 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1067/2126] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:32:41 2021] GET /compute/v2.1/servers/2d8b0385-ed5c-48a2-9742-64dcb0c0d34e => generated 1318 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:32:42.818244 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-11b66f21-a995-4655-b977-e3825ea1ae4b tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508cb16ab6343dfb7de72c6b3600ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211699de14224a63a48d253eaa061c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:32:42.828112 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-11b66f21-a995-4655-b977-e3825ea1ae4b tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] 10.222.0.45 "GET /compute/v2.1/servers/cd530067-1ba5-46f5-8d47-2dac866e61c1" status: 200 len: 1266 microversion: 2.1 time: 0.678721 Dec 16 15:32:42.828962 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1060/2127] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:32:42 2021] GET /compute/v2.1/servers/cd530067-1ba5-46f5-8d47-2dac866e61c1 => generated 1266 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:32:43.279032 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-ad97616d-4bf0-461a-8c10-db17920f2488 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:32:43.279585 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-ad97616d-4bf0-461a-8c10-db17920f2488 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: 2d8b0385-ed5c-48a2-9742-64dcb0c0d34e] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:32:43.288463 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ad97616d-4bf0-461a-8c10-db17920f2488 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:43.288948 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ad97616d-4bf0-461a-8c10-db17920f2488 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:43.289981 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ad97616d-4bf0-461a-8c10-db17920f2488 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:43.290805 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ad97616d-4bf0-461a-8c10-db17920f2488 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:43.514723 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-ad97616d-4bf0-461a-8c10-db17920f2488 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f509993aaae6478b92d6e5caaf2a7dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962338c57e5c46ef84460b3dc1a0afea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:32:43.523433 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-ad97616d-4bf0-461a-8c10-db17920f2488 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "GET /compute/v2.1/servers/2d8b0385-ed5c-48a2-9742-64dcb0c0d34e" status: 200 len: 1318 microversion: 2.1 time: 0.252639 Dec 16 15:32:43.524023 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1068/2128] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:32:43 2021] GET /compute/v2.1/servers/2d8b0385-ed5c-48a2-9742-64dcb0c0d34e => generated 1318 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:32:43.853883 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-813a5b1e-b349-422c-8d74-5c828c160c8e tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:32:43.853883 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-813a5b1e-b349-422c-8d74-5c828c160c8e tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] [instance: cd530067-1ba5-46f5-8d47-2dac866e61c1] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:32:43.858571 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-813a5b1e-b349-422c-8d74-5c828c160c8e tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:43.859083 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-813a5b1e-b349-422c-8d74-5c828c160c8e tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:43.859918 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-813a5b1e-b349-422c-8d74-5c828c160c8e tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:43.860401 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-813a5b1e-b349-422c-8d74-5c828c160c8e tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:44.084999 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-813a5b1e-b349-422c-8d74-5c828c160c8e tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508cb16ab6343dfb7de72c6b3600ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211699de14224a63a48d253eaa061c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:32:44.094772 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-813a5b1e-b349-422c-8d74-5c828c160c8e tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] 10.222.0.45 "GET /compute/v2.1/servers/cd530067-1ba5-46f5-8d47-2dac866e61c1" status: 200 len: 1266 microversion: 2.1 time: 0.253163 Dec 16 15:32:44.095381 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1061/2129] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:32:43 2021] GET /compute/v2.1/servers/cd530067-1ba5-46f5-8d47-2dac866e61c1 => generated 1266 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:32:44.545254 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-31461341-df41-4d3b-91e5-c20ed1130b8d tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:32:44.545955 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-31461341-df41-4d3b-91e5-c20ed1130b8d tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: 2d8b0385-ed5c-48a2-9742-64dcb0c0d34e] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:32:44.554548 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-31461341-df41-4d3b-91e5-c20ed1130b8d tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:44.555210 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-31461341-df41-4d3b-91e5-c20ed1130b8d tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:44.556101 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-31461341-df41-4d3b-91e5-c20ed1130b8d tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:44.556641 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-31461341-df41-4d3b-91e5-c20ed1130b8d tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:44.772698 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-31461341-df41-4d3b-91e5-c20ed1130b8d tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f509993aaae6478b92d6e5caaf2a7dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962338c57e5c46ef84460b3dc1a0afea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:32:44.781585 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-31461341-df41-4d3b-91e5-c20ed1130b8d tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "GET /compute/v2.1/servers/2d8b0385-ed5c-48a2-9742-64dcb0c0d34e" status: 200 len: 1318 microversion: 2.1 time: 0.244369 Dec 16 15:32:44.782192 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1069/2130] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:32:44 2021] GET /compute/v2.1/servers/2d8b0385-ed5c-48a2-9742-64dcb0c0d34e => generated 1318 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:32:45.115849 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-2a80026a-3828-4386-8bcc-5dc313094cb1 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:32:45.116512 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-2a80026a-3828-4386-8bcc-5dc313094cb1 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] [instance: cd530067-1ba5-46f5-8d47-2dac866e61c1] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:32:45.125196 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2a80026a-3828-4386-8bcc-5dc313094cb1 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:45.125699 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2a80026a-3828-4386-8bcc-5dc313094cb1 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:45.126559 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2a80026a-3828-4386-8bcc-5dc313094cb1 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:45.127041 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2a80026a-3828-4386-8bcc-5dc313094cb1 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:45.351851 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-2a80026a-3828-4386-8bcc-5dc313094cb1 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508cb16ab6343dfb7de72c6b3600ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211699de14224a63a48d253eaa061c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:32:45.361705 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-2a80026a-3828-4386-8bcc-5dc313094cb1 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] 10.222.0.45 "GET /compute/v2.1/servers/cd530067-1ba5-46f5-8d47-2dac866e61c1" status: 200 len: 1266 microversion: 2.1 time: 0.253448 Dec 16 15:32:45.362360 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1062/2131] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:32:45 2021] GET /compute/v2.1/servers/cd530067-1ba5-46f5-8d47-2dac866e61c1 => generated 1266 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:32:45.804786 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-4a73075b-6ccb-4aef-88c1-611bd1cdac13 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:32:45.805589 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-4a73075b-6ccb-4aef-88c1-611bd1cdac13 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: 2d8b0385-ed5c-48a2-9742-64dcb0c0d34e] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:32:45.814941 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4a73075b-6ccb-4aef-88c1-611bd1cdac13 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:45.815460 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4a73075b-6ccb-4aef-88c1-611bd1cdac13 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:45.816315 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4a73075b-6ccb-4aef-88c1-611bd1cdac13 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:45.816809 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4a73075b-6ccb-4aef-88c1-611bd1cdac13 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:46.039980 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-4a73075b-6ccb-4aef-88c1-611bd1cdac13 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f509993aaae6478b92d6e5caaf2a7dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962338c57e5c46ef84460b3dc1a0afea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:32:46.051425 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-4a73075b-6ccb-4aef-88c1-611bd1cdac13 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "GET /compute/v2.1/servers/2d8b0385-ed5c-48a2-9742-64dcb0c0d34e" status: 200 len: 1318 microversion: 2.1 time: 0.255085 Dec 16 15:32:46.052015 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1070/2132] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:32:45 2021] GET /compute/v2.1/servers/2d8b0385-ed5c-48a2-9742-64dcb0c0d34e => generated 1318 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:32:46.384307 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-26264911-b099-42df-99be-5cd8a9a4234a tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:32:46.384985 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-26264911-b099-42df-99be-5cd8a9a4234a tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] [instance: cd530067-1ba5-46f5-8d47-2dac866e61c1] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:32:46.393498 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-26264911-b099-42df-99be-5cd8a9a4234a tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:46.394107 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-26264911-b099-42df-99be-5cd8a9a4234a tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:46.395100 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-26264911-b099-42df-99be-5cd8a9a4234a tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:46.395595 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-26264911-b099-42df-99be-5cd8a9a4234a tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:46.634369 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-26264911-b099-42df-99be-5cd8a9a4234a tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508cb16ab6343dfb7de72c6b3600ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211699de14224a63a48d253eaa061c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:32:46.645133 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-26264911-b099-42df-99be-5cd8a9a4234a tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] 10.222.0.45 "GET /compute/v2.1/servers/cd530067-1ba5-46f5-8d47-2dac866e61c1" status: 200 len: 1266 microversion: 2.1 time: 0.269014 Dec 16 15:32:46.645750 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1063/2133] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:32:46 2021] GET /compute/v2.1/servers/cd530067-1ba5-46f5-8d47-2dac866e61c1 => generated 1266 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:32:47.073894 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-b5070d82-f6ca-46a1-93b9-851aede9e263 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:32:47.074592 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-b5070d82-f6ca-46a1-93b9-851aede9e263 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: 2d8b0385-ed5c-48a2-9742-64dcb0c0d34e] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:32:47.082547 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b5070d82-f6ca-46a1-93b9-851aede9e263 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:47.083057 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b5070d82-f6ca-46a1-93b9-851aede9e263 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:47.083904 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b5070d82-f6ca-46a1-93b9-851aede9e263 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:47.084403 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b5070d82-f6ca-46a1-93b9-851aede9e263 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:47.318708 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-b5070d82-f6ca-46a1-93b9-851aede9e263 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f509993aaae6478b92d6e5caaf2a7dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962338c57e5c46ef84460b3dc1a0afea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:32:47.339498 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-b5070d82-f6ca-46a1-93b9-851aede9e263 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "GET /compute/v2.1/servers/2d8b0385-ed5c-48a2-9742-64dcb0c0d34e" status: 200 len: 1318 microversion: 2.1 time: 0.273322 Dec 16 15:32:47.340533 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1071/2134] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:32:47 2021] GET /compute/v2.1/servers/2d8b0385-ed5c-48a2-9742-64dcb0c0d34e => generated 1318 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:32:47.669453 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-0a0337eb-54a0-4858-b708-562112644b4b tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:32:47.670029 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-0a0337eb-54a0-4858-b708-562112644b4b tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] [instance: cd530067-1ba5-46f5-8d47-2dac866e61c1] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:32:47.679158 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0a0337eb-54a0-4858-b708-562112644b4b tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:47.679158 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0a0337eb-54a0-4858-b708-562112644b4b tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:47.679979 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0a0337eb-54a0-4858-b708-562112644b4b tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:47.680712 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0a0337eb-54a0-4858-b708-562112644b4b tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:47.953839 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-0a0337eb-54a0-4858-b708-562112644b4b tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508cb16ab6343dfb7de72c6b3600ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211699de14224a63a48d253eaa061c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:32:47.975792 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-0a0337eb-54a0-4858-b708-562112644b4b tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] 10.222.0.45 "GET /compute/v2.1/servers/cd530067-1ba5-46f5-8d47-2dac866e61c1" status: 200 len: 1266 microversion: 2.1 time: 0.315098 Dec 16 15:32:47.976546 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1064/2135] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:32:47 2021] GET /compute/v2.1/servers/cd530067-1ba5-46f5-8d47-2dac866e61c1 => generated 1266 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:32:48.363761 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-ce91e702-ac07-44dc-bc95-f5631e293363 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:32:48.364419 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-ce91e702-ac07-44dc-bc95-f5631e293363 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: 2d8b0385-ed5c-48a2-9742-64dcb0c0d34e] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:32:48.372464 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ce91e702-ac07-44dc-bc95-f5631e293363 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:48.372957 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ce91e702-ac07-44dc-bc95-f5631e293363 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:48.373799 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ce91e702-ac07-44dc-bc95-f5631e293363 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:48.374342 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ce91e702-ac07-44dc-bc95-f5631e293363 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:48.830605 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-ce91e702-ac07-44dc-bc95-f5631e293363 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f509993aaae6478b92d6e5caaf2a7dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962338c57e5c46ef84460b3dc1a0afea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:32:48.839589 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-ce91e702-ac07-44dc-bc95-f5631e293363 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "GET /compute/v2.1/servers/2d8b0385-ed5c-48a2-9742-64dcb0c0d34e" status: 200 len: 1318 microversion: 2.1 time: 0.483433 Dec 16 15:32:48.840184 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1072/2136] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:32:48 2021] GET /compute/v2.1/servers/2d8b0385-ed5c-48a2-9742-64dcb0c0d34e => generated 1318 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:32:49.005338 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-561466fa-c657-486c-afd5-da911304d191 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:32:49.006010 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-561466fa-c657-486c-afd5-da911304d191 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] [instance: cd530067-1ba5-46f5-8d47-2dac866e61c1] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:32:49.013913 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-561466fa-c657-486c-afd5-da911304d191 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:49.014493 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-561466fa-c657-486c-afd5-da911304d191 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:49.015824 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-561466fa-c657-486c-afd5-da911304d191 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:49.015824 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-561466fa-c657-486c-afd5-da911304d191 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:49.262464 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-561466fa-c657-486c-afd5-da911304d191 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508cb16ab6343dfb7de72c6b3600ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211699de14224a63a48d253eaa061c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:32:49.271625 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-561466fa-c657-486c-afd5-da911304d191 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] 10.222.0.45 "GET /compute/v2.1/servers/cd530067-1ba5-46f5-8d47-2dac866e61c1" status: 200 len: 1266 microversion: 2.1 time: 0.273755 Dec 16 15:32:49.272268 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1065/2137] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:32:48 2021] GET /compute/v2.1/servers/cd530067-1ba5-46f5-8d47-2dac866e61c1 => generated 1266 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:32:49.861670 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-5a48427b-f53f-4908-8523-4e799f081403 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:32:49.862462 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-5a48427b-f53f-4908-8523-4e799f081403 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: 2d8b0385-ed5c-48a2-9742-64dcb0c0d34e] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:32:49.871190 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5a48427b-f53f-4908-8523-4e799f081403 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:49.871699 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5a48427b-f53f-4908-8523-4e799f081403 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:49.872554 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5a48427b-f53f-4908-8523-4e799f081403 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:49.873054 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5a48427b-f53f-4908-8523-4e799f081403 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:50.092073 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-5a48427b-f53f-4908-8523-4e799f081403 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f509993aaae6478b92d6e5caaf2a7dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962338c57e5c46ef84460b3dc1a0afea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:32:50.100977 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-5a48427b-f53f-4908-8523-4e799f081403 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "GET /compute/v2.1/servers/2d8b0385-ed5c-48a2-9742-64dcb0c0d34e" status: 200 len: 1318 microversion: 2.1 time: 0.247145 Dec 16 15:32:50.101569 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1073/2138] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:32:49 2021] GET /compute/v2.1/servers/2d8b0385-ed5c-48a2-9742-64dcb0c0d34e => generated 1318 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:32:50.297553 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-e5729fe8-e137-4c27-a127-e7a2322a8ca7 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:32:50.298169 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-e5729fe8-e137-4c27-a127-e7a2322a8ca7 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] [instance: cd530067-1ba5-46f5-8d47-2dac866e61c1] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:32:50.306676 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e5729fe8-e137-4c27-a127-e7a2322a8ca7 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:50.307193 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e5729fe8-e137-4c27-a127-e7a2322a8ca7 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:50.308095 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e5729fe8-e137-4c27-a127-e7a2322a8ca7 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:50.308593 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e5729fe8-e137-4c27-a127-e7a2322a8ca7 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:50.533961 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-e5729fe8-e137-4c27-a127-e7a2322a8ca7 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508cb16ab6343dfb7de72c6b3600ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211699de14224a63a48d253eaa061c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:32:50.543924 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-e5729fe8-e137-4c27-a127-e7a2322a8ca7 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] 10.222.0.45 "GET /compute/v2.1/servers/cd530067-1ba5-46f5-8d47-2dac866e61c1" status: 200 len: 1266 microversion: 2.1 time: 0.255062 Dec 16 15:32:50.544531 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1066/2139] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:32:50 2021] GET /compute/v2.1/servers/cd530067-1ba5-46f5-8d47-2dac866e61c1 => generated 1266 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:32:50.853090 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [req-8a3f2972-ee40-453c-b97d-e0002e086ae0 req-57468285-b5e9-4034-8ebc-2654eabea2db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd530067-1ba5-46f5-8d47-2dac866e61c1", "name": "network-vif-plugged", "status": "completed", "tag": "0e4d14e0-cb79-43cb-9b80-5ced96d4c2b7"}]} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:32:50.859255 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:32:50.859255 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: warnings.warn(msg) Dec 16 15:32:50.866915 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-8a3f2972-ee40-453c-b97d-e0002e086ae0 req-57468285-b5e9-4034-8ebc-2654eabea2db service nova] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:50.867422 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-8a3f2972-ee40-453c-b97d-e0002e086ae0 req-57468285-b5e9-4034-8ebc-2654eabea2db service nova] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:50.886800 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.compute.server_external_events [req-8a3f2972-ee40-453c-b97d-e0002e086ae0 req-57468285-b5e9-4034-8ebc-2654eabea2db service nova] Creating event network-vif-plugged:0e4d14e0-cb79-43cb-9b80-5ced96d4c2b7 for instance cd530067-1ba5-46f5-8d47-2dac866e61c1 on hv-cinder-82189 Dec 16 15:32:50.892156 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [req-8a3f2972-ee40-453c-b97d-e0002e086ae0 req-57468285-b5e9-4034-8ebc-2654eabea2db service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046644 Dec 16 15:32:50.892815 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1074/2140] 10.222.0.45 () {64 vars in 1308 bytes} [Thu Dec 16 15:32:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:32:51.123974 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-4d25cc95-1894-4e49-9865-1b46d5257062 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:32:51.124649 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-4d25cc95-1894-4e49-9865-1b46d5257062 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: 2d8b0385-ed5c-48a2-9742-64dcb0c0d34e] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:32:51.132667 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4d25cc95-1894-4e49-9865-1b46d5257062 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:51.133177 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4d25cc95-1894-4e49-9865-1b46d5257062 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:51.134030 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4d25cc95-1894-4e49-9865-1b46d5257062 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:51.134571 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4d25cc95-1894-4e49-9865-1b46d5257062 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:51.354212 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-4d25cc95-1894-4e49-9865-1b46d5257062 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f509993aaae6478b92d6e5caaf2a7dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962338c57e5c46ef84460b3dc1a0afea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:32:51.363877 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-4d25cc95-1894-4e49-9865-1b46d5257062 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "GET /compute/v2.1/servers/2d8b0385-ed5c-48a2-9742-64dcb0c0d34e" status: 200 len: 1318 microversion: 2.1 time: 0.247811 Dec 16 15:32:51.364477 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1067/2141] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:32:51 2021] GET /compute/v2.1/servers/2d8b0385-ed5c-48a2-9742-64dcb0c0d34e => generated 1318 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:32:51.565804 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-63b31267-6e03-466b-931d-fbea533040d5 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:32:51.566614 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-63b31267-6e03-466b-931d-fbea533040d5 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] [instance: cd530067-1ba5-46f5-8d47-2dac866e61c1] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:32:51.575425 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-63b31267-6e03-466b-931d-fbea533040d5 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:51.575941 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-63b31267-6e03-466b-931d-fbea533040d5 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:51.576835 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-63b31267-6e03-466b-931d-fbea533040d5 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:51.577333 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-63b31267-6e03-466b-931d-fbea533040d5 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:51.800782 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-63b31267-6e03-466b-931d-fbea533040d5 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508cb16ab6343dfb7de72c6b3600ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211699de14224a63a48d253eaa061c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:32:51.810397 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-63b31267-6e03-466b-931d-fbea533040d5 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] 10.222.0.45 "GET /compute/v2.1/servers/cd530067-1ba5-46f5-8d47-2dac866e61c1" status: 200 len: 1266 microversion: 2.1 time: 0.252783 Dec 16 15:32:51.810998 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1075/2142] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:32:51 2021] GET /compute/v2.1/servers/cd530067-1ba5-46f5-8d47-2dac866e61c1 => generated 1266 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:32:52.384635 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-38e1ec9f-02be-446f-9e73-d01f15819cf3 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:32:52.385298 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-38e1ec9f-02be-446f-9e73-d01f15819cf3 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: 2d8b0385-ed5c-48a2-9742-64dcb0c0d34e] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:32:52.394027 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-38e1ec9f-02be-446f-9e73-d01f15819cf3 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:52.394553 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-38e1ec9f-02be-446f-9e73-d01f15819cf3 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:52.395388 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-38e1ec9f-02be-446f-9e73-d01f15819cf3 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:52.395877 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-38e1ec9f-02be-446f-9e73-d01f15819cf3 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:52.614970 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-38e1ec9f-02be-446f-9e73-d01f15819cf3 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f509993aaae6478b92d6e5caaf2a7dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962338c57e5c46ef84460b3dc1a0afea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:32:52.623671 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-38e1ec9f-02be-446f-9e73-d01f15819cf3 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "GET /compute/v2.1/servers/2d8b0385-ed5c-48a2-9742-64dcb0c0d34e" status: 200 len: 1318 microversion: 2.1 time: 0.246625 Dec 16 15:32:52.624257 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1068/2143] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:32:52 2021] GET /compute/v2.1/servers/2d8b0385-ed5c-48a2-9742-64dcb0c0d34e => generated 1318 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:32:52.832945 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-5aa155af-f08d-4547-adef-810fcc68514a tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:32:52.833622 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-5aa155af-f08d-4547-adef-810fcc68514a tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] [instance: cd530067-1ba5-46f5-8d47-2dac866e61c1] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:32:52.842669 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5aa155af-f08d-4547-adef-810fcc68514a tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:52.843184 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5aa155af-f08d-4547-adef-810fcc68514a tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:52.844050 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5aa155af-f08d-4547-adef-810fcc68514a tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:52.844547 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5aa155af-f08d-4547-adef-810fcc68514a tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:53.092251 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-5aa155af-f08d-4547-adef-810fcc68514a tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508cb16ab6343dfb7de72c6b3600ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211699de14224a63a48d253eaa061c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:32:53.104505 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-5aa155af-f08d-4547-adef-810fcc68514a tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] 10.222.0.45 "GET /compute/v2.1/servers/cd530067-1ba5-46f5-8d47-2dac866e61c1" status: 200 len: 1266 microversion: 2.1 time: 0.279630 Dec 16 15:32:53.105127 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1076/2144] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:32:52 2021] GET /compute/v2.1/servers/cd530067-1ba5-46f5-8d47-2dac866e61c1 => generated 1266 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:32:53.645568 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-84397a50-6e59-41c6-a381-8cb6cf1fb4de tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:32:53.646299 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-84397a50-6e59-41c6-a381-8cb6cf1fb4de tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: 2d8b0385-ed5c-48a2-9742-64dcb0c0d34e] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:32:53.654556 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-84397a50-6e59-41c6-a381-8cb6cf1fb4de tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:53.654859 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-84397a50-6e59-41c6-a381-8cb6cf1fb4de tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:53.655768 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-84397a50-6e59-41c6-a381-8cb6cf1fb4de tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:53.656263 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-84397a50-6e59-41c6-a381-8cb6cf1fb4de tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:54.025244 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-84397a50-6e59-41c6-a381-8cb6cf1fb4de tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f509993aaae6478b92d6e5caaf2a7dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962338c57e5c46ef84460b3dc1a0afea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:32:54.034721 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-84397a50-6e59-41c6-a381-8cb6cf1fb4de tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "GET /compute/v2.1/servers/2d8b0385-ed5c-48a2-9742-64dcb0c0d34e" status: 200 len: 1318 microversion: 2.1 time: 0.397043 Dec 16 15:32:54.035317 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1069/2145] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:32:53 2021] GET /compute/v2.1/servers/2d8b0385-ed5c-48a2-9742-64dcb0c0d34e => generated 1318 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:32:54.126581 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-4fec1567-9266-41df-a272-9575006c16fd tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:32:54.127259 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-4fec1567-9266-41df-a272-9575006c16fd tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] [instance: cd530067-1ba5-46f5-8d47-2dac866e61c1] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:32:54.135225 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4fec1567-9266-41df-a272-9575006c16fd tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:54.136232 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4fec1567-9266-41df-a272-9575006c16fd tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:54.137096 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4fec1567-9266-41df-a272-9575006c16fd tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:54.137593 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4fec1567-9266-41df-a272-9575006c16fd tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:54.360270 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-4fec1567-9266-41df-a272-9575006c16fd tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508cb16ab6343dfb7de72c6b3600ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211699de14224a63a48d253eaa061c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:32:54.369462 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-4fec1567-9266-41df-a272-9575006c16fd tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] 10.222.0.45 "GET /compute/v2.1/servers/cd530067-1ba5-46f5-8d47-2dac866e61c1" status: 200 len: 1266 microversion: 2.1 time: 0.250823 Dec 16 15:32:54.370627 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1077/2146] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:32:54 2021] GET /compute/v2.1/servers/cd530067-1ba5-46f5-8d47-2dac866e61c1 => generated 1266 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:32:55.056733 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-f615fbf6-9a14-484e-9042-4fafc2a94d25 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:32:55.057448 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-f615fbf6-9a14-484e-9042-4fafc2a94d25 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: 2d8b0385-ed5c-48a2-9742-64dcb0c0d34e] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:32:55.065890 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f615fbf6-9a14-484e-9042-4fafc2a94d25 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:55.066461 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f615fbf6-9a14-484e-9042-4fafc2a94d25 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:55.067324 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f615fbf6-9a14-484e-9042-4fafc2a94d25 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:55.067816 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f615fbf6-9a14-484e-9042-4fafc2a94d25 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:55.221741 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [req-647a03cf-6b2d-455e-bfcc-fef3b7f4b8d2 req-30b74ecb-2041-41a6-aaa9-fa29a1c10e41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d8b0385-ed5c-48a2-9742-64dcb0c0d34e", "name": "network-vif-plugged", "status": "completed", "tag": "2c1fbf14-1cd5-4ac3-876e-5e2cffc34def"}]} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:32:55.228486 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:32:55.228486 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: warnings.warn(msg) Dec 16 15:32:55.237912 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-647a03cf-6b2d-455e-bfcc-fef3b7f4b8d2 req-30b74ecb-2041-41a6-aaa9-fa29a1c10e41 service nova] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:55.238442 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-647a03cf-6b2d-455e-bfcc-fef3b7f4b8d2 req-30b74ecb-2041-41a6-aaa9-fa29a1c10e41 service nova] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:55.258711 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.compute.server_external_events [req-647a03cf-6b2d-455e-bfcc-fef3b7f4b8d2 req-30b74ecb-2041-41a6-aaa9-fa29a1c10e41 service nova] Creating event network-vif-plugged:2c1fbf14-1cd5-4ac3-876e-5e2cffc34def for instance 2d8b0385-ed5c-48a2-9742-64dcb0c0d34e on hv-cinder-82189 Dec 16 15:32:55.265095 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [req-647a03cf-6b2d-455e-bfcc-fef3b7f4b8d2 req-30b74ecb-2041-41a6-aaa9-fa29a1c10e41 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050957 Dec 16 15:32:55.266058 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1078/2147] 10.222.0.45 () {64 vars in 1308 bytes} [Thu Dec 16 15:32:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:32:55.317955 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-f615fbf6-9a14-484e-9042-4fafc2a94d25 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f509993aaae6478b92d6e5caaf2a7dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962338c57e5c46ef84460b3dc1a0afea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:32:55.329783 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-f615fbf6-9a14-484e-9042-4fafc2a94d25 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "GET /compute/v2.1/servers/2d8b0385-ed5c-48a2-9742-64dcb0c0d34e" status: 200 len: 1318 microversion: 2.1 time: 0.281041 Dec 16 15:32:55.330438 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1070/2148] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:32:55 2021] GET /compute/v2.1/servers/2d8b0385-ed5c-48a2-9742-64dcb0c0d34e => generated 1318 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:32:55.392824 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-b207a79a-090f-4860-ba8d-1a95586b0521 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:32:55.393575 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-b207a79a-090f-4860-ba8d-1a95586b0521 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] [instance: cd530067-1ba5-46f5-8d47-2dac866e61c1] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:32:55.403524 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b207a79a-090f-4860-ba8d-1a95586b0521 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:55.404038 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b207a79a-090f-4860-ba8d-1a95586b0521 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:55.404900 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b207a79a-090f-4860-ba8d-1a95586b0521 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:55.405407 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b207a79a-090f-4860-ba8d-1a95586b0521 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:55.664004 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-b207a79a-090f-4860-ba8d-1a95586b0521 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508cb16ab6343dfb7de72c6b3600ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211699de14224a63a48d253eaa061c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:32:55.680277 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-b207a79a-090f-4860-ba8d-1a95586b0521 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] 10.222.0.45 "GET /compute/v2.1/servers/cd530067-1ba5-46f5-8d47-2dac866e61c1" status: 200 len: 1266 microversion: 2.1 time: 0.295796 Dec 16 15:32:55.681211 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1079/2149] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:32:55 2021] GET /compute/v2.1/servers/cd530067-1ba5-46f5-8d47-2dac866e61c1 => generated 1266 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:32:56.362203 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-164b37b6-da56-4836-8820-8815fcb8db04 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:32:56.363039 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-164b37b6-da56-4836-8820-8815fcb8db04 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: 2d8b0385-ed5c-48a2-9742-64dcb0c0d34e] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:32:56.372922 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-164b37b6-da56-4836-8820-8815fcb8db04 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:56.373752 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-164b37b6-da56-4836-8820-8815fcb8db04 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:56.374824 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-164b37b6-da56-4836-8820-8815fcb8db04 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:56.375313 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-164b37b6-da56-4836-8820-8815fcb8db04 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:56.602139 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-164b37b6-da56-4836-8820-8815fcb8db04 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f509993aaae6478b92d6e5caaf2a7dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962338c57e5c46ef84460b3dc1a0afea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:32:56.611045 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-164b37b6-da56-4836-8820-8815fcb8db04 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "GET /compute/v2.1/servers/2d8b0385-ed5c-48a2-9742-64dcb0c0d34e" status: 200 len: 1318 microversion: 2.1 time: 0.266447 Dec 16 15:32:56.611636 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1071/2150] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:32:56 2021] GET /compute/v2.1/servers/2d8b0385-ed5c-48a2-9742-64dcb0c0d34e => generated 1318 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:32:56.711319 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-32f822d9-bf63-44ed-9af8-56dcc54fd48c tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:32:56.711992 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-32f822d9-bf63-44ed-9af8-56dcc54fd48c tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] [instance: cd530067-1ba5-46f5-8d47-2dac866e61c1] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:32:56.720319 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-32f822d9-bf63-44ed-9af8-56dcc54fd48c tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:56.720832 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-32f822d9-bf63-44ed-9af8-56dcc54fd48c tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:56.721678 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-32f822d9-bf63-44ed-9af8-56dcc54fd48c tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:56.722272 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-32f822d9-bf63-44ed-9af8-56dcc54fd48c tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:56.949634 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-32f822d9-bf63-44ed-9af8-56dcc54fd48c tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508cb16ab6343dfb7de72c6b3600ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211699de14224a63a48d253eaa061c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:32:56.958733 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-32f822d9-bf63-44ed-9af8-56dcc54fd48c tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] 10.222.0.45 "GET /compute/v2.1/servers/cd530067-1ba5-46f5-8d47-2dac866e61c1" status: 200 len: 1452 microversion: 2.1 time: 0.255460 Dec 16 15:32:56.969457 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1080/2151] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:32:56 2021] GET /compute/v2.1/servers/cd530067-1ba5-46f5-8d47-2dac866e61c1 => generated 1452 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:32:56.983221 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-6a77e1b3-0ab1-408b-9657-b3e7c925a06b tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:32:56.984031 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-6a77e1b3-0ab1-408b-9657-b3e7c925a06b tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] [instance: cd530067-1ba5-46f5-8d47-2dac866e61c1] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:32:56.992607 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6a77e1b3-0ab1-408b-9657-b3e7c925a06b tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:56.993071 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6a77e1b3-0ab1-408b-9657-b3e7c925a06b tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:56.993930 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6a77e1b3-0ab1-408b-9657-b3e7c925a06b tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:56.994462 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6a77e1b3-0ab1-408b-9657-b3e7c925a06b tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:57.233859 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-6a77e1b3-0ab1-408b-9657-b3e7c925a06b tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508cb16ab6343dfb7de72c6b3600ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211699de14224a63a48d253eaa061c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:32:57.242877 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-6a77e1b3-0ab1-408b-9657-b3e7c925a06b tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] 10.222.0.45 "GET /compute/v2.1/servers/cd530067-1ba5-46f5-8d47-2dac866e61c1" status: 200 len: 1452 microversion: 2.1 time: 0.267864 Dec 16 15:32:57.243470 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1072/2152] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:32:56 2021] GET /compute/v2.1/servers/cd530067-1ba5-46f5-8d47-2dac866e61c1 => generated 1452 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:32:57.632832 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-680fdda3-5d5e-40fb-af4b-375a80b19fde tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:32:57.633571 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-680fdda3-5d5e-40fb-af4b-375a80b19fde tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: 2d8b0385-ed5c-48a2-9742-64dcb0c0d34e] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:32:57.641759 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-680fdda3-5d5e-40fb-af4b-375a80b19fde tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:57.642342 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-680fdda3-5d5e-40fb-af4b-375a80b19fde tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:57.643193 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-680fdda3-5d5e-40fb-af4b-375a80b19fde tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:57.643685 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-680fdda3-5d5e-40fb-af4b-375a80b19fde tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:58.005995 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-680fdda3-5d5e-40fb-af4b-375a80b19fde tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f509993aaae6478b92d6e5caaf2a7dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962338c57e5c46ef84460b3dc1a0afea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:32:58.017482 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-680fdda3-5d5e-40fb-af4b-375a80b19fde tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "GET /compute/v2.1/servers/2d8b0385-ed5c-48a2-9742-64dcb0c0d34e" status: 200 len: 1318 microversion: 2.1 time: 0.392406 Dec 16 15:32:58.018196 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1081/2153] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:32:57 2021] GET /compute/v2.1/servers/2d8b0385-ed5c-48a2-9742-64dcb0c0d34e => generated 1318 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:32:59.040815 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-b25036d8-82c2-4a84-a0b3-2baefe8df04d tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:32:59.042586 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-b25036d8-82c2-4a84-a0b3-2baefe8df04d tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: 2d8b0385-ed5c-48a2-9742-64dcb0c0d34e] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:32:59.055791 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b25036d8-82c2-4a84-a0b3-2baefe8df04d tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:59.056678 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b25036d8-82c2-4a84-a0b3-2baefe8df04d tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:59.058507 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b25036d8-82c2-4a84-a0b3-2baefe8df04d tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:32:59.059025 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b25036d8-82c2-4a84-a0b3-2baefe8df04d tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:32:59.357675 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-b25036d8-82c2-4a84-a0b3-2baefe8df04d tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f509993aaae6478b92d6e5caaf2a7dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962338c57e5c46ef84460b3dc1a0afea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:32:59.378290 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-b25036d8-82c2-4a84-a0b3-2baefe8df04d tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "GET /compute/v2.1/servers/2d8b0385-ed5c-48a2-9742-64dcb0c0d34e" status: 200 len: 1507 microversion: 2.1 time: 0.345856 Dec 16 15:32:59.407691 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1073/2154] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:32:59 2021] GET /compute/v2.1/servers/2d8b0385-ed5c-48a2-9742-64dcb0c0d34e => generated 1507 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:33:01.515655 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [req-660d3f10-d670-4586-9d7e-739fcf1bb5df req-44725ff0-4a46-4456-94f5-e9bb801ec7d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd530067-1ba5-46f5-8d47-2dac866e61c1", "tag": "0e4d14e0-cb79-43cb-9b80-5ced96d4c2b7"}]} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:33:01.521215 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:33:01.521215 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: warnings.warn(msg) Dec 16 15:33:01.531403 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-660d3f10-d670-4586-9d7e-739fcf1bb5df req-44725ff0-4a46-4456-94f5-e9bb801ec7d2 service nova] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:33:01.532271 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-660d3f10-d670-4586-9d7e-739fcf1bb5df req-44725ff0-4a46-4456-94f5-e9bb801ec7d2 service nova] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:33:01.561950 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.compute.server_external_events [req-660d3f10-d670-4586-9d7e-739fcf1bb5df req-44725ff0-4a46-4456-94f5-e9bb801ec7d2 service nova] Creating event network-changed:0e4d14e0-cb79-43cb-9b80-5ced96d4c2b7 for instance cd530067-1ba5-46f5-8d47-2dac866e61c1 on hv-cinder-82189 Dec 16 15:33:01.567517 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [req-660d3f10-d670-4586-9d7e-739fcf1bb5df req-44725ff0-4a46-4456-94f5-e9bb801ec7d2 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.385283 Dec 16 15:33:01.568524 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1082/2155] 10.222.0.45 () {64 vars in 1308 bytes} [Thu Dec 16 15:33:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:33:02.566255 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-04397342-a1ee-4793-a45e-b651426ea0b2 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "66165854-d380-434d-86e5-628cd1978ea0"}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:33:02.567474 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-04397342-a1ee-4793-a45e-b651426ea0b2 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: 2d8b0385-ed5c-48a2-9742-64dcb0c0d34e] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:33:02.577010 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-04397342-a1ee-4793-a45e-b651426ea0b2 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:33:02.577778 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-04397342-a1ee-4793-a45e-b651426ea0b2 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:33:02.579020 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-04397342-a1ee-4793-a45e-b651426ea0b2 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:33:02.579670 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-04397342-a1ee-4793-a45e-b651426ea0b2 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:33:03.290360 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-04397342-a1ee-4793-a45e-b651426ea0b2 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "POST /compute/v2.1/servers/2d8b0385-ed5c-48a2-9742-64dcb0c0d34e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.731625 Dec 16 15:33:03.291090 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1074/2156] 10.222.0.45 () {60 vars in 1313 bytes} [Thu Dec 16 15:33:02 2021] POST /compute/v2.1/servers/2d8b0385-ed5c-48a2-9742-64dcb0c0d34e/os-volume_attachments => generated 194 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:33:17.060904 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-c33b40fd-8929-463f-b3d2-d9a243cb3213 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:33:17.062321 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-c33b40fd-8929-463f-b3d2-d9a243cb3213 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: 2d8b0385-ed5c-48a2-9742-64dcb0c0d34e] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:33:17.077784 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c33b40fd-8929-463f-b3d2-d9a243cb3213 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:33:17.078760 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c33b40fd-8929-463f-b3d2-d9a243cb3213 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:33:17.080207 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c33b40fd-8929-463f-b3d2-d9a243cb3213 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:33:17.081083 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c33b40fd-8929-463f-b3d2-d9a243cb3213 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:33:17.456333 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-c33b40fd-8929-463f-b3d2-d9a243cb3213 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "DELETE /compute/v2.1/servers/2d8b0385-ed5c-48a2-9742-64dcb0c0d34e/os-volume_attachments/66165854-d380-434d-86e5-628cd1978ea0" status: 202 len: 0 microversion: 2.1 time: 0.404667 Dec 16 15:33:17.457788 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1083/2157] 10.222.0.45 () {58 vars in 1406 bytes} [Thu Dec 16 15:33:17 2021] DELETE /compute/v2.1/servers/2d8b0385-ed5c-48a2-9742-64dcb0c0d34e/os-volume_attachments/66165854-d380-434d-86e5-628cd1978ea0 => generated 0 bytes in 407 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:33:17.472916 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-3d4b2579-0e78-4592-9cf0-1d44c2ee6fbd tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:33:17.474454 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-3d4b2579-0e78-4592-9cf0-1d44c2ee6fbd tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: 2d8b0385-ed5c-48a2-9742-64dcb0c0d34e] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:33:17.487707 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3d4b2579-0e78-4592-9cf0-1d44c2ee6fbd tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:33:17.487707 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3d4b2579-0e78-4592-9cf0-1d44c2ee6fbd tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:33:17.487707 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3d4b2579-0e78-4592-9cf0-1d44c2ee6fbd tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:33:17.487707 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3d4b2579-0e78-4592-9cf0-1d44c2ee6fbd tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:33:17.567479 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-3d4b2579-0e78-4592-9cf0-1d44c2ee6fbd tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "GET /compute/v2.1/servers/2d8b0385-ed5c-48a2-9742-64dcb0c0d34e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.104302 Dec 16 15:33:17.568106 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1075/2158] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:33:17 2021] GET /compute/v2.1/servers/2d8b0385-ed5c-48a2-9742-64dcb0c0d34e/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:33:18.584847 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-3cc53de6-bb93-4420-8b94-29667df06aa6 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:33:18.585986 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-3cc53de6-bb93-4420-8b94-29667df06aa6 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: 2d8b0385-ed5c-48a2-9742-64dcb0c0d34e] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:33:18.595001 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3cc53de6-bb93-4420-8b94-29667df06aa6 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:33:18.595513 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3cc53de6-bb93-4420-8b94-29667df06aa6 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:33:18.596359 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3cc53de6-bb93-4420-8b94-29667df06aa6 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:33:18.596943 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3cc53de6-bb93-4420-8b94-29667df06aa6 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:33:18.680241 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-3cc53de6-bb93-4420-8b94-29667df06aa6 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "GET /compute/v2.1/servers/2d8b0385-ed5c-48a2-9742-64dcb0c0d34e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.103776 Dec 16 15:33:18.680862 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1084/2159] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:33:18 2021] GET /compute/v2.1/servers/2d8b0385-ed5c-48a2-9742-64dcb0c0d34e/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:33:19.696464 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-d9413371-98e2-441d-a209-c08792fc3149 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:33:19.697498 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-d9413371-98e2-441d-a209-c08792fc3149 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: 2d8b0385-ed5c-48a2-9742-64dcb0c0d34e] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:33:19.706475 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d9413371-98e2-441d-a209-c08792fc3149 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:33:19.706988 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d9413371-98e2-441d-a209-c08792fc3149 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:33:19.707832 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d9413371-98e2-441d-a209-c08792fc3149 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:33:19.708334 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d9413371-98e2-441d-a209-c08792fc3149 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:33:19.779807 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-d9413371-98e2-441d-a209-c08792fc3149 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "GET /compute/v2.1/servers/2d8b0385-ed5c-48a2-9742-64dcb0c0d34e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.091025 Dec 16 15:33:19.780410 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1076/2160] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:33:19 2021] GET /compute/v2.1/servers/2d8b0385-ed5c-48a2-9742-64dcb0c0d34e/os-volume_attachments => generated 25 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 15:33:21.218019 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-828f5ea6-865f-4435-b458-7296b61d8370 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:33:21.218653 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-828f5ea6-865f-4435-b458-7296b61d8370 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: 2d8b0385-ed5c-48a2-9742-64dcb0c0d34e] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:33:21.226923 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-828f5ea6-865f-4435-b458-7296b61d8370 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:33:21.227502 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-828f5ea6-865f-4435-b458-7296b61d8370 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:33:21.228415 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-828f5ea6-865f-4435-b458-7296b61d8370 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:33:21.229614 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-828f5ea6-865f-4435-b458-7296b61d8370 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:33:21.299941 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-828f5ea6-865f-4435-b458-7296b61d8370 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: 2d8b0385-ed5c-48a2-9742-64dcb0c0d34e] Going to try to terminate instance {{(pid=101356) delete /opt/stack/nova/nova/compute/api.py:2496}} Dec 16 15:33:21.507808 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-828f5ea6-865f-4435-b458-7296b61d8370 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "DELETE /compute/v2.1/servers/2d8b0385-ed5c-48a2-9742-64dcb0c0d34e" status: 204 len: 0 microversion: 2.1 time: 0.301426 Dec 16 15:33:21.508466 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1085/2161] 10.222.0.45 () {58 vars in 1229 bytes} [Thu Dec 16 15:33:21 2021] DELETE /compute/v2.1/servers/2d8b0385-ed5c-48a2-9742-64dcb0c0d34e => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 16 15:33:21.520833 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-9a41b9da-af5b-4eb0-bd46-abd9241ba11a tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:33:21.521502 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-9a41b9da-af5b-4eb0-bd46-abd9241ba11a tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: 2d8b0385-ed5c-48a2-9742-64dcb0c0d34e] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:33:21.530480 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9a41b9da-af5b-4eb0-bd46-abd9241ba11a tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:33:21.530984 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9a41b9da-af5b-4eb0-bd46-abd9241ba11a tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:33:21.531841 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9a41b9da-af5b-4eb0-bd46-abd9241ba11a tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:33:21.532329 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9a41b9da-af5b-4eb0-bd46-abd9241ba11a tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:33:21.753444 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-9a41b9da-af5b-4eb0-bd46-abd9241ba11a tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f509993aaae6478b92d6e5caaf2a7dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962338c57e5c46ef84460b3dc1a0afea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:33:21.762378 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-9a41b9da-af5b-4eb0-bd46-abd9241ba11a tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "GET /compute/v2.1/servers/2d8b0385-ed5c-48a2-9742-64dcb0c0d34e" status: 200 len: 1513 microversion: 2.1 time: 0.248931 Dec 16 15:33:21.762982 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1077/2162] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:33:21 2021] GET /compute/v2.1/servers/2d8b0385-ed5c-48a2-9742-64dcb0c0d34e => generated 1513 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:33:22.786208 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-85427cbb-cce0-4c6f-8646-186b6647a00a tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:33:22.786981 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-85427cbb-cce0-4c6f-8646-186b6647a00a tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: 2d8b0385-ed5c-48a2-9742-64dcb0c0d34e] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:33:22.796540 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-85427cbb-cce0-4c6f-8646-186b6647a00a tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:33:22.797485 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-85427cbb-cce0-4c6f-8646-186b6647a00a tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:33:22.798502 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-85427cbb-cce0-4c6f-8646-186b6647a00a tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:33:22.798992 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-85427cbb-cce0-4c6f-8646-186b6647a00a tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:33:23.045776 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-85427cbb-cce0-4c6f-8646-186b6647a00a tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f509993aaae6478b92d6e5caaf2a7dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962338c57e5c46ef84460b3dc1a0afea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:33:23.054848 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-85427cbb-cce0-4c6f-8646-186b6647a00a tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "GET /compute/v2.1/servers/2d8b0385-ed5c-48a2-9742-64dcb0c0d34e" status: 200 len: 1513 microversion: 2.1 time: 0.277091 Dec 16 15:33:23.055749 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1086/2163] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:33:22 2021] GET /compute/v2.1/servers/2d8b0385-ed5c-48a2-9742-64dcb0c0d34e => generated 1513 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:33:24.077254 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-22c6db1e-15b5-4817-8b60-286abd22783f tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:33:24.077913 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-22c6db1e-15b5-4817-8b60-286abd22783f tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: 2d8b0385-ed5c-48a2-9742-64dcb0c0d34e] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:33:24.085874 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-22c6db1e-15b5-4817-8b60-286abd22783f tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:33:24.086443 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-22c6db1e-15b5-4817-8b60-286abd22783f tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:33:24.087291 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-22c6db1e-15b5-4817-8b60-286abd22783f tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:33:24.087778 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-22c6db1e-15b5-4817-8b60-286abd22783f tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:33:24.541533 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-22c6db1e-15b5-4817-8b60-286abd22783f tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f509993aaae6478b92d6e5caaf2a7dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962338c57e5c46ef84460b3dc1a0afea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:33:24.551353 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-22c6db1e-15b5-4817-8b60-286abd22783f tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "GET /compute/v2.1/servers/2d8b0385-ed5c-48a2-9742-64dcb0c0d34e" status: 200 len: 1513 microversion: 2.1 time: 0.482391 Dec 16 15:33:24.552061 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1078/2164] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:33:24 2021] GET /compute/v2.1/servers/2d8b0385-ed5c-48a2-9742-64dcb0c0d34e => generated 1513 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:33:25.126102 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [req-7cb70b0e-2c0c-42ab-ace8-47875026a290 req-94ec85b2-d2f8-47b7-9493-362f8bd8e9c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d8b0385-ed5c-48a2-9742-64dcb0c0d34e", "name": "network-vif-deleted", "tag": "2c1fbf14-1cd5-4ac3-876e-5e2cffc34def"}]} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:33:25.139643 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:33:25.139643 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: warnings.warn(msg) Dec 16 15:33:25.154012 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-7cb70b0e-2c0c-42ab-ace8-47875026a290 req-94ec85b2-d2f8-47b7-9493-362f8bd8e9c5 service nova] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:33:25.154547 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-7cb70b0e-2c0c-42ab-ace8-47875026a290 req-94ec85b2-d2f8-47b7-9493-362f8bd8e9c5 service nova] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:33:25.175834 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.compute.server_external_events [req-7cb70b0e-2c0c-42ab-ace8-47875026a290 req-94ec85b2-d2f8-47b7-9493-362f8bd8e9c5 service nova] Creating event network-vif-deleted:2c1fbf14-1cd5-4ac3-876e-5e2cffc34def for instance 2d8b0385-ed5c-48a2-9742-64dcb0c0d34e on hv-cinder-82189 Dec 16 15:33:25.180918 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [req-7cb70b0e-2c0c-42ab-ace8-47875026a290 req-94ec85b2-d2f8-47b7-9493-362f8bd8e9c5 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062810 Dec 16 15:33:25.181560 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1087/2165] 10.222.0.45 () {64 vars in 1308 bytes} [Thu Dec 16 15:33:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:33:25.572534 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-746fb8da-d69a-4c6b-b804-5c71017b4970 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:33:25.573213 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-746fb8da-d69a-4c6b-b804-5c71017b4970 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: 2d8b0385-ed5c-48a2-9742-64dcb0c0d34e] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:33:25.581266 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-746fb8da-d69a-4c6b-b804-5c71017b4970 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:33:25.581930 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-746fb8da-d69a-4c6b-b804-5c71017b4970 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:33:25.582850 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-746fb8da-d69a-4c6b-b804-5c71017b4970 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:33:25.583350 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-746fb8da-d69a-4c6b-b804-5c71017b4970 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:33:25.660556 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-746fb8da-d69a-4c6b-b804-5c71017b4970 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:33:25.660978 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-746fb8da-d69a-4c6b-b804-5c71017b4970 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:33:25.661502 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.objects.instance [None req-746fb8da-d69a-4c6b-b804-5c71017b4970 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lazy-loading 'fault' on Instance uuid 2d8b0385-ed5c-48a2-9742-64dcb0c0d34e {{(pid=101355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 16 15:33:25.777287 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-746fb8da-d69a-4c6b-b804-5c71017b4970 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f509993aaae6478b92d6e5caaf2a7dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962338c57e5c46ef84460b3dc1a0afea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:33:25.786286 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-746fb8da-d69a-4c6b-b804-5c71017b4970 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "GET /compute/v2.1/servers/2d8b0385-ed5c-48a2-9742-64dcb0c0d34e" status: 200 len: 1308 microversion: 2.1 time: 0.221417 Dec 16 15:33:25.787044 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1079/2166] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:33:25 2021] GET /compute/v2.1/servers/2d8b0385-ed5c-48a2-9742-64dcb0c0d34e => generated 1308 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:33:26.809573 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-4abd0a70-ccb3-42c9-aeaf-c0b74b363dfd tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:33:26.810390 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-4abd0a70-ccb3-42c9-aeaf-c0b74b363dfd tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: 2d8b0385-ed5c-48a2-9742-64dcb0c0d34e] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:33:26.819808 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4abd0a70-ccb3-42c9-aeaf-c0b74b363dfd tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:33:26.820358 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4abd0a70-ccb3-42c9-aeaf-c0b74b363dfd tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:33:26.821212 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4abd0a70-ccb3-42c9-aeaf-c0b74b363dfd tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:33:26.821706 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4abd0a70-ccb3-42c9-aeaf-c0b74b363dfd tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:33:26.876257 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.wsgi [None req-4abd0a70-ccb3-42c9-aeaf-c0b74b363dfd tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] HTTP exception thrown: Instance 2d8b0385-ed5c-48a2-9742-64dcb0c0d34e could not be found. Dec 16 15:33:26.876948 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-4abd0a70-ccb3-42c9-aeaf-c0b74b363dfd tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Returning 404 to user: Instance 2d8b0385-ed5c-48a2-9742-64dcb0c0d34e could not be found. {{(pid=101356) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:941}} Dec 16 15:33:26.877835 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-4abd0a70-ccb3-42c9-aeaf-c0b74b363dfd tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "GET /compute/v2.1/servers/2d8b0385-ed5c-48a2-9742-64dcb0c0d34e" status: 404 len: 111 microversion: 2.1 time: 0.076473 Dec 16 15:33:26.878482 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1088/2167] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:33:26 2021] GET /compute/v2.1/servers/2d8b0385-ed5c-48a2-9742-64dcb0c0d34e => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 15:33:28.211060 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-140086b8-c5dd-49ab-9462-7451c1d61d66 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:33:28.211709 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-140086b8-c5dd-49ab-9462-7451c1d61d66 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: d0133f89-c4d2-43e8-a9ef-5f0222bdc104] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:33:28.219745 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-140086b8-c5dd-49ab-9462-7451c1d61d66 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:33:28.220353 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-140086b8-c5dd-49ab-9462-7451c1d61d66 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:33:28.221269 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-140086b8-c5dd-49ab-9462-7451c1d61d66 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:33:28.221830 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-140086b8-c5dd-49ab-9462-7451c1d61d66 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:33:28.290584 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-140086b8-c5dd-49ab-9462-7451c1d61d66 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: d0133f89-c4d2-43e8-a9ef-5f0222bdc104] Going to try to terminate instance {{(pid=101355) delete /opt/stack/nova/nova/compute/api.py:2496}} Dec 16 15:33:28.507831 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-140086b8-c5dd-49ab-9462-7451c1d61d66 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "DELETE /compute/v2.1/servers/d0133f89-c4d2-43e8-a9ef-5f0222bdc104" status: 204 len: 0 microversion: 2.1 time: 0.304072 Dec 16 15:33:28.508590 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1080/2168] 10.222.0.45 () {58 vars in 1229 bytes} [Thu Dec 16 15:33:28 2021] DELETE /compute/v2.1/servers/d0133f89-c4d2-43e8-a9ef-5f0222bdc104 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 16 15:33:28.520850 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-b39b6d72-0155-4fdc-ad82-e1d4594b0a74 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:33:28.521714 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-b39b6d72-0155-4fdc-ad82-e1d4594b0a74 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: d0133f89-c4d2-43e8-a9ef-5f0222bdc104] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:33:28.529586 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b39b6d72-0155-4fdc-ad82-e1d4594b0a74 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:33:28.530155 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b39b6d72-0155-4fdc-ad82-e1d4594b0a74 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:33:28.531198 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b39b6d72-0155-4fdc-ad82-e1d4594b0a74 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:33:28.531674 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b39b6d72-0155-4fdc-ad82-e1d4594b0a74 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:33:28.762869 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-b39b6d72-0155-4fdc-ad82-e1d4594b0a74 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f509993aaae6478b92d6e5caaf2a7dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962338c57e5c46ef84460b3dc1a0afea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:33:28.772623 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-b39b6d72-0155-4fdc-ad82-e1d4594b0a74 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "GET /compute/v2.1/servers/d0133f89-c4d2-43e8-a9ef-5f0222bdc104" status: 200 len: 1512 microversion: 2.1 time: 0.259501 Dec 16 15:33:28.773250 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1089/2169] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:33:28 2021] GET /compute/v2.1/servers/d0133f89-c4d2-43e8-a9ef-5f0222bdc104 => generated 1512 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:33:29.796996 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-5bac48f9-57bd-4671-adb0-c6b1ac6a8cb0 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:33:29.797749 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-5bac48f9-57bd-4671-adb0-c6b1ac6a8cb0 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: d0133f89-c4d2-43e8-a9ef-5f0222bdc104] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:33:29.805498 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5bac48f9-57bd-4671-adb0-c6b1ac6a8cb0 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:33:29.806012 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5bac48f9-57bd-4671-adb0-c6b1ac6a8cb0 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:33:29.806888 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5bac48f9-57bd-4671-adb0-c6b1ac6a8cb0 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:33:29.807374 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5bac48f9-57bd-4671-adb0-c6b1ac6a8cb0 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:33:30.024099 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-5bac48f9-57bd-4671-adb0-c6b1ac6a8cb0 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f509993aaae6478b92d6e5caaf2a7dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962338c57e5c46ef84460b3dc1a0afea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:33:30.032935 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-5bac48f9-57bd-4671-adb0-c6b1ac6a8cb0 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "GET /compute/v2.1/servers/d0133f89-c4d2-43e8-a9ef-5f0222bdc104" status: 200 len: 1512 microversion: 2.1 time: 0.244879 Dec 16 15:33:30.033529 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1081/2170] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:33:29 2021] GET /compute/v2.1/servers/d0133f89-c4d2-43e8-a9ef-5f0222bdc104 => generated 1512 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:33:31.059148 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-1446afa4-f217-4316-9dc6-008b6bcdecd7 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:33:31.060406 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-1446afa4-f217-4316-9dc6-008b6bcdecd7 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: d0133f89-c4d2-43e8-a9ef-5f0222bdc104] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:33:31.074850 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1446afa4-f217-4316-9dc6-008b6bcdecd7 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:33:31.075468 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1446afa4-f217-4316-9dc6-008b6bcdecd7 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:33:31.076366 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1446afa4-f217-4316-9dc6-008b6bcdecd7 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:33:31.076921 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1446afa4-f217-4316-9dc6-008b6bcdecd7 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:33:31.319492 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-1446afa4-f217-4316-9dc6-008b6bcdecd7 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f509993aaae6478b92d6e5caaf2a7dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962338c57e5c46ef84460b3dc1a0afea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:33:31.329548 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-1446afa4-f217-4316-9dc6-008b6bcdecd7 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "GET /compute/v2.1/servers/d0133f89-c4d2-43e8-a9ef-5f0222bdc104" status: 200 len: 1512 microversion: 2.1 time: 0.278759 Dec 16 15:33:31.334129 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1090/2171] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:33:31 2021] GET /compute/v2.1/servers/d0133f89-c4d2-43e8-a9ef-5f0222bdc104 => generated 1512 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:33:31.926437 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [req-cf1a1f67-f98a-4734-86b7-2aa31609f197 req-3f7da5be-eba8-46aa-b8aa-1d302d50491d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0133f89-c4d2-43e8-a9ef-5f0222bdc104", "name": "network-vif-deleted", "tag": "29c539d0-bf3c-431b-a920-17c04ec109e1"}]} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:33:31.932294 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:33:31.932294 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: warnings.warn(msg) Dec 16 15:33:31.942565 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-cf1a1f67-f98a-4734-86b7-2aa31609f197 req-3f7da5be-eba8-46aa-b8aa-1d302d50491d service nova] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:33:31.947369 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-cf1a1f67-f98a-4734-86b7-2aa31609f197 req-3f7da5be-eba8-46aa-b8aa-1d302d50491d service nova] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:33:31.964387 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.compute.server_external_events [req-cf1a1f67-f98a-4734-86b7-2aa31609f197 req-3f7da5be-eba8-46aa-b8aa-1d302d50491d service nova] Creating event network-vif-deleted:29c539d0-bf3c-431b-a920-17c04ec109e1 for instance d0133f89-c4d2-43e8-a9ef-5f0222bdc104 on hv-cinder-82189 Dec 16 15:33:31.970198 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [req-cf1a1f67-f98a-4734-86b7-2aa31609f197 req-3f7da5be-eba8-46aa-b8aa-1d302d50491d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051633 Dec 16 15:33:31.971812 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1082/2172] 10.222.0.45 () {64 vars in 1308 bytes} [Thu Dec 16 15:33:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 15:33:32.354956 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-b479458c-7053-49fd-b10a-85d05a648549 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:33:32.356184 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-b479458c-7053-49fd-b10a-85d05a648549 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: d0133f89-c4d2-43e8-a9ef-5f0222bdc104] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:33:32.367477 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b479458c-7053-49fd-b10a-85d05a648549 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:33:32.368287 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b479458c-7053-49fd-b10a-85d05a648549 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:33:32.369568 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b479458c-7053-49fd-b10a-85d05a648549 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:33:32.371311 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b479458c-7053-49fd-b10a-85d05a648549 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:33:32.458519 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b479458c-7053-49fd-b10a-85d05a648549 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:33:32.459034 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b479458c-7053-49fd-b10a-85d05a648549 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:33:32.459838 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.objects.instance [None req-b479458c-7053-49fd-b10a-85d05a648549 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lazy-loading 'fault' on Instance uuid d0133f89-c4d2-43e8-a9ef-5f0222bdc104 {{(pid=101356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 16 15:33:32.537258 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-b479458c-7053-49fd-b10a-85d05a648549 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f509993aaae6478b92d6e5caaf2a7dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962338c57e5c46ef84460b3dc1a0afea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:33:32.560891 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-b479458c-7053-49fd-b10a-85d05a648549 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "GET /compute/v2.1/servers/d0133f89-c4d2-43e8-a9ef-5f0222bdc104" status: 200 len: 1306 microversion: 2.1 time: 0.215836 Dec 16 15:33:32.562409 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1091/2173] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:33:32 2021] GET /compute/v2.1/servers/d0133f89-c4d2-43e8-a9ef-5f0222bdc104 => generated 1306 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:33:33.589055 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-9c5b844f-8125-4f5c-83fa-4ffdc57a4869 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:33:33.589929 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-9c5b844f-8125-4f5c-83fa-4ffdc57a4869 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: d0133f89-c4d2-43e8-a9ef-5f0222bdc104] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:33:33.598383 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9c5b844f-8125-4f5c-83fa-4ffdc57a4869 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:33:33.598884 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9c5b844f-8125-4f5c-83fa-4ffdc57a4869 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:33:33.599799 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9c5b844f-8125-4f5c-83fa-4ffdc57a4869 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:33:33.600285 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9c5b844f-8125-4f5c-83fa-4ffdc57a4869 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:33:33.652574 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.wsgi [None req-9c5b844f-8125-4f5c-83fa-4ffdc57a4869 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] HTTP exception thrown: Instance d0133f89-c4d2-43e8-a9ef-5f0222bdc104 could not be found. Dec 16 15:33:33.653163 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-9c5b844f-8125-4f5c-83fa-4ffdc57a4869 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Returning 404 to user: Instance d0133f89-c4d2-43e8-a9ef-5f0222bdc104 could not be found. {{(pid=101355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:941}} Dec 16 15:33:33.654116 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-9c5b844f-8125-4f5c-83fa-4ffdc57a4869 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "GET /compute/v2.1/servers/d0133f89-c4d2-43e8-a9ef-5f0222bdc104" status: 404 len: 111 microversion: 2.1 time: 0.077396 Dec 16 15:33:33.658669 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1083/2174] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:33:33 2021] GET /compute/v2.1/servers/d0133f89-c4d2-43e8-a9ef-5f0222bdc104 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 15:33:33.667939 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-31875fa6-083f-4f11-b8ab-e6547e638824 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:33:33.668804 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-31875fa6-083f-4f11-b8ab-e6547e638824 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: c52aff34-91bc-4b2c-9f3b-35d9138871c3] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:33:33.677037 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-31875fa6-083f-4f11-b8ab-e6547e638824 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:33:33.677534 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-31875fa6-083f-4f11-b8ab-e6547e638824 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:33:33.678404 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-31875fa6-083f-4f11-b8ab-e6547e638824 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:33:33.678889 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-31875fa6-083f-4f11-b8ab-e6547e638824 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:33:33.752750 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-31875fa6-083f-4f11-b8ab-e6547e638824 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: c52aff34-91bc-4b2c-9f3b-35d9138871c3] Going to try to terminate instance {{(pid=101356) delete /opt/stack/nova/nova/compute/api.py:2496}} Dec 16 15:33:33.987406 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-31875fa6-083f-4f11-b8ab-e6547e638824 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "DELETE /compute/v2.1/servers/c52aff34-91bc-4b2c-9f3b-35d9138871c3" status: 204 len: 0 microversion: 2.1 time: 0.327765 Dec 16 15:33:33.988043 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1092/2175] 10.222.0.45 () {58 vars in 1229 bytes} [Thu Dec 16 15:33:33 2021] DELETE /compute/v2.1/servers/c52aff34-91bc-4b2c-9f3b-35d9138871c3 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 16 15:33:34.000633 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-a278dc8b-9fed-4176-bbc0-e4f2ff5555ca tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:33:34.001306 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-a278dc8b-9fed-4176-bbc0-e4f2ff5555ca tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: c52aff34-91bc-4b2c-9f3b-35d9138871c3] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:33:34.009138 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a278dc8b-9fed-4176-bbc0-e4f2ff5555ca tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:33:34.009651 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a278dc8b-9fed-4176-bbc0-e4f2ff5555ca tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:33:34.010574 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a278dc8b-9fed-4176-bbc0-e4f2ff5555ca tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:33:34.011066 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a278dc8b-9fed-4176-bbc0-e4f2ff5555ca tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:33:34.289279 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-a278dc8b-9fed-4176-bbc0-e4f2ff5555ca tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f509993aaae6478b92d6e5caaf2a7dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962338c57e5c46ef84460b3dc1a0afea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:33:34.298472 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-a278dc8b-9fed-4176-bbc0-e4f2ff5555ca tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "GET /compute/v2.1/servers/c52aff34-91bc-4b2c-9f3b-35d9138871c3" status: 200 len: 1513 microversion: 2.1 time: 0.305937 Dec 16 15:33:34.299070 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1084/2176] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:33:33 2021] GET /compute/v2.1/servers/c52aff34-91bc-4b2c-9f3b-35d9138871c3 => generated 1513 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:33:35.321879 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-ea800698-b921-4d21-be47-ae323dc93d9f tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:33:35.322674 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-ea800698-b921-4d21-be47-ae323dc93d9f tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: c52aff34-91bc-4b2c-9f3b-35d9138871c3] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:33:35.331274 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ea800698-b921-4d21-be47-ae323dc93d9f tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:33:35.331830 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ea800698-b921-4d21-be47-ae323dc93d9f tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:33:35.332636 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ea800698-b921-4d21-be47-ae323dc93d9f tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:33:35.333230 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ea800698-b921-4d21-be47-ae323dc93d9f tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:33:35.565765 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-ea800698-b921-4d21-be47-ae323dc93d9f tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f509993aaae6478b92d6e5caaf2a7dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962338c57e5c46ef84460b3dc1a0afea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:33:35.575384 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-ea800698-b921-4d21-be47-ae323dc93d9f tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "GET /compute/v2.1/servers/c52aff34-91bc-4b2c-9f3b-35d9138871c3" status: 200 len: 1513 microversion: 2.1 time: 0.262180 Dec 16 15:33:35.575994 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1093/2177] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:33:35 2021] GET /compute/v2.1/servers/c52aff34-91bc-4b2c-9f3b-35d9138871c3 => generated 1513 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:33:36.598030 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-cb718bc8-af6c-457d-aca5-1a845737409b tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:33:36.598733 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-cb718bc8-af6c-457d-aca5-1a845737409b tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: c52aff34-91bc-4b2c-9f3b-35d9138871c3] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:33:36.606743 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cb718bc8-af6c-457d-aca5-1a845737409b tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:33:36.607250 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cb718bc8-af6c-457d-aca5-1a845737409b tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:33:36.608139 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cb718bc8-af6c-457d-aca5-1a845737409b tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:33:36.608702 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cb718bc8-af6c-457d-aca5-1a845737409b tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:33:37.037228 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-cb718bc8-af6c-457d-aca5-1a845737409b tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f509993aaae6478b92d6e5caaf2a7dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962338c57e5c46ef84460b3dc1a0afea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:33:37.048848 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-cb718bc8-af6c-457d-aca5-1a845737409b tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "GET /compute/v2.1/servers/c52aff34-91bc-4b2c-9f3b-35d9138871c3" status: 200 len: 1513 microversion: 2.1 time: 0.458794 Dec 16 15:33:37.049654 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [req-78870927-132c-40a0-bd89-436c2a7ee13c req-30651849-151a-4c98-b061-d5437b523d90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c52aff34-91bc-4b2c-9f3b-35d9138871c3", "name": "network-vif-deleted", "tag": "b3c2827e-74a7-4dcd-b34d-70db98c4121c"}]} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:33:37.050387 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1085/2178] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:33:36 2021] GET /compute/v2.1/servers/c52aff34-91bc-4b2c-9f3b-35d9138871c3 => generated 1513 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:33:37.054453 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:33:37.054453 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: warnings.warn(msg) Dec 16 15:33:37.069244 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-78870927-132c-40a0-bd89-436c2a7ee13c req-30651849-151a-4c98-b061-d5437b523d90 service nova] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:33:37.069752 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-78870927-132c-40a0-bd89-436c2a7ee13c req-30651849-151a-4c98-b061-d5437b523d90 service nova] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:33:37.090124 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.compute.server_external_events [req-78870927-132c-40a0-bd89-436c2a7ee13c req-30651849-151a-4c98-b061-d5437b523d90 service nova] Creating event network-vif-deleted:b3c2827e-74a7-4dcd-b34d-70db98c4121c for instance c52aff34-91bc-4b2c-9f3b-35d9138871c3 on hv-cinder-82189 Dec 16 15:33:37.096705 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [req-78870927-132c-40a0-bd89-436c2a7ee13c req-30651849-151a-4c98-b061-d5437b523d90 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054548 Dec 16 15:33:37.101053 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1094/2179] 10.222.0.45 () {64 vars in 1308 bytes} [Thu Dec 16 15:33:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:33:38.072490 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-b2cf0c4f-6ca4-4b8b-a204-642562d0b106 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:33:38.073594 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-b2cf0c4f-6ca4-4b8b-a204-642562d0b106 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: c52aff34-91bc-4b2c-9f3b-35d9138871c3] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:33:38.081530 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b2cf0c4f-6ca4-4b8b-a204-642562d0b106 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:33:38.082091 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b2cf0c4f-6ca4-4b8b-a204-642562d0b106 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:33:38.082920 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b2cf0c4f-6ca4-4b8b-a204-642562d0b106 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:33:38.083417 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b2cf0c4f-6ca4-4b8b-a204-642562d0b106 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:33:38.138399 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.wsgi [None req-b2cf0c4f-6ca4-4b8b-a204-642562d0b106 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] HTTP exception thrown: Instance c52aff34-91bc-4b2c-9f3b-35d9138871c3 could not be found. Dec 16 15:33:38.139073 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-b2cf0c4f-6ca4-4b8b-a204-642562d0b106 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Returning 404 to user: Instance c52aff34-91bc-4b2c-9f3b-35d9138871c3 could not be found. {{(pid=101355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:941}} Dec 16 15:33:38.140734 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-b2cf0c4f-6ca4-4b8b-a204-642562d0b106 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "GET /compute/v2.1/servers/c52aff34-91bc-4b2c-9f3b-35d9138871c3" status: 404 len: 111 microversion: 2.1 time: 0.075541 Dec 16 15:33:38.140734 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1086/2180] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:33:38 2021] GET /compute/v2.1/servers/c52aff34-91bc-4b2c-9f3b-35d9138871c3 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 15:33:39.459023 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-7837c276-84de-42c5-87ec-4bb968381f14 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:33:39.459603 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-7837c276-84de-42c5-87ec-4bb968381f14 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: c47a38ca-4ce3-4387-af13-dc2d25144f8c] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:33:39.468435 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7837c276-84de-42c5-87ec-4bb968381f14 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:33:39.468943 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7837c276-84de-42c5-87ec-4bb968381f14 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:33:39.469797 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7837c276-84de-42c5-87ec-4bb968381f14 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:33:39.470354 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7837c276-84de-42c5-87ec-4bb968381f14 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:33:39.541111 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-7837c276-84de-42c5-87ec-4bb968381f14 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: c47a38ca-4ce3-4387-af13-dc2d25144f8c] Going to try to terminate instance {{(pid=101356) delete /opt/stack/nova/nova/compute/api.py:2496}} Dec 16 15:33:39.747415 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-7837c276-84de-42c5-87ec-4bb968381f14 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "DELETE /compute/v2.1/servers/c47a38ca-4ce3-4387-af13-dc2d25144f8c" status: 204 len: 0 microversion: 2.1 time: 0.296336 Dec 16 15:33:39.747985 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1095/2181] 10.222.0.45 () {58 vars in 1229 bytes} [Thu Dec 16 15:33:39 2021] DELETE /compute/v2.1/servers/c47a38ca-4ce3-4387-af13-dc2d25144f8c => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 16 15:33:39.760728 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-14c757d2-83d0-4cee-b505-aaf82f630b18 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:33:39.761431 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-14c757d2-83d0-4cee-b505-aaf82f630b18 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: c47a38ca-4ce3-4387-af13-dc2d25144f8c] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:33:39.769595 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-14c757d2-83d0-4cee-b505-aaf82f630b18 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:33:39.770124 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-14c757d2-83d0-4cee-b505-aaf82f630b18 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:33:39.770991 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-14c757d2-83d0-4cee-b505-aaf82f630b18 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:33:39.771467 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-14c757d2-83d0-4cee-b505-aaf82f630b18 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:33:40.046236 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-14c757d2-83d0-4cee-b505-aaf82f630b18 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f509993aaae6478b92d6e5caaf2a7dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962338c57e5c46ef84460b3dc1a0afea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:33:40.055004 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-14c757d2-83d0-4cee-b505-aaf82f630b18 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "GET /compute/v2.1/servers/c47a38ca-4ce3-4387-af13-dc2d25144f8c" status: 200 len: 1514 microversion: 2.1 time: 0.302408 Dec 16 15:33:40.055592 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1087/2182] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:33:39 2021] GET /compute/v2.1/servers/c47a38ca-4ce3-4387-af13-dc2d25144f8c => generated 1514 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:33:41.077826 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-0789b84d-77f2-411c-8878-a5d1ae4ec91f tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:33:41.078660 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-0789b84d-77f2-411c-8878-a5d1ae4ec91f tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: c47a38ca-4ce3-4387-af13-dc2d25144f8c] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:33:41.087309 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0789b84d-77f2-411c-8878-a5d1ae4ec91f tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:33:41.087814 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0789b84d-77f2-411c-8878-a5d1ae4ec91f tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:33:41.088702 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0789b84d-77f2-411c-8878-a5d1ae4ec91f tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:33:41.089180 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0789b84d-77f2-411c-8878-a5d1ae4ec91f tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:33:41.338401 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-0789b84d-77f2-411c-8878-a5d1ae4ec91f tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f509993aaae6478b92d6e5caaf2a7dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962338c57e5c46ef84460b3dc1a0afea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:33:41.349265 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-0789b84d-77f2-411c-8878-a5d1ae4ec91f tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "GET /compute/v2.1/servers/c47a38ca-4ce3-4387-af13-dc2d25144f8c" status: 200 len: 1514 microversion: 2.1 time: 0.279628 Dec 16 15:33:41.350101 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1096/2183] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:33:41 2021] GET /compute/v2.1/servers/c47a38ca-4ce3-4387-af13-dc2d25144f8c => generated 1514 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:33:42.043708 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [req-e7453740-6236-4141-b73b-3a69d6b53330 req-06c5f1f3-ed66-42e1-a60b-d4b21b1aead9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c47a38ca-4ce3-4387-af13-dc2d25144f8c", "name": "network-vif-deleted", "tag": "6ff8ff40-8129-456e-a634-61bb3c8a183c"}]} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:33:42.048225 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:33:42.048225 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: warnings.warn(msg) Dec 16 15:33:42.057686 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-e7453740-6236-4141-b73b-3a69d6b53330 req-06c5f1f3-ed66-42e1-a60b-d4b21b1aead9 service nova] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:33:42.058263 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-e7453740-6236-4141-b73b-3a69d6b53330 req-06c5f1f3-ed66-42e1-a60b-d4b21b1aead9 service nova] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:33:42.075271 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.compute.server_external_events [req-e7453740-6236-4141-b73b-3a69d6b53330 req-06c5f1f3-ed66-42e1-a60b-d4b21b1aead9 service nova] Creating event network-vif-deleted:6ff8ff40-8129-456e-a634-61bb3c8a183c for instance c47a38ca-4ce3-4387-af13-dc2d25144f8c on hv-cinder-82189 Dec 16 15:33:42.080497 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [req-e7453740-6236-4141-b73b-3a69d6b53330 req-06c5f1f3-ed66-42e1-a60b-d4b21b1aead9 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044853 Dec 16 15:33:42.081128 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1088/2184] 10.222.0.45 () {64 vars in 1308 bytes} [Thu Dec 16 15:33:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:33:42.372119 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-1f9f772d-a9c1-42a6-8358-097aab3f134b tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:33:42.372831 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-1f9f772d-a9c1-42a6-8358-097aab3f134b tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: c47a38ca-4ce3-4387-af13-dc2d25144f8c] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:33:42.381855 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1f9f772d-a9c1-42a6-8358-097aab3f134b tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:33:42.382388 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1f9f772d-a9c1-42a6-8358-097aab3f134b tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:33:42.383233 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1f9f772d-a9c1-42a6-8358-097aab3f134b tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:33:42.383725 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1f9f772d-a9c1-42a6-8358-097aab3f134b tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:33:42.463771 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1f9f772d-a9c1-42a6-8358-097aab3f134b tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:33:42.464272 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1f9f772d-a9c1-42a6-8358-097aab3f134b tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:33:42.464780 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.objects.instance [None req-1f9f772d-a9c1-42a6-8358-097aab3f134b tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lazy-loading 'fault' on Instance uuid c47a38ca-4ce3-4387-af13-dc2d25144f8c {{(pid=101356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 16 15:33:42.528474 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-1f9f772d-a9c1-42a6-8358-097aab3f134b tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f509993aaae6478b92d6e5caaf2a7dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '962338c57e5c46ef84460b3dc1a0afea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:33:42.537258 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-1f9f772d-a9c1-42a6-8358-097aab3f134b tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "GET /compute/v2.1/servers/c47a38ca-4ce3-4387-af13-dc2d25144f8c" status: 200 len: 1308 microversion: 2.1 time: 0.173048 Dec 16 15:33:42.537860 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1097/2185] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:33:42 2021] GET /compute/v2.1/servers/c47a38ca-4ce3-4387-af13-dc2d25144f8c => generated 1308 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:33:43.560769 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-9050f91f-ac89-448b-ab37-81df0971f3b3 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:33:43.561531 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-9050f91f-ac89-448b-ab37-81df0971f3b3 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] [instance: c47a38ca-4ce3-4387-af13-dc2d25144f8c] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:33:43.569651 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9050f91f-ac89-448b-ab37-81df0971f3b3 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:33:43.570178 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9050f91f-ac89-448b-ab37-81df0971f3b3 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:33:43.571052 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9050f91f-ac89-448b-ab37-81df0971f3b3 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:33:43.571496 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9050f91f-ac89-448b-ab37-81df0971f3b3 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:33:43.624094 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.wsgi [None req-9050f91f-ac89-448b-ab37-81df0971f3b3 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] HTTP exception thrown: Instance c47a38ca-4ce3-4387-af13-dc2d25144f8c could not be found. Dec 16 15:33:43.624753 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-9050f91f-ac89-448b-ab37-81df0971f3b3 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] Returning 404 to user: Instance c47a38ca-4ce3-4387-af13-dc2d25144f8c could not be found. {{(pid=101355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:941}} Dec 16 15:33:43.625648 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-9050f91f-ac89-448b-ab37-81df0971f3b3 tempest-AttachVolumeNegativeTest-797587787 tempest-AttachVolumeNegativeTest-797587787-project] 10.222.0.45 "GET /compute/v2.1/servers/c47a38ca-4ce3-4387-af13-dc2d25144f8c" status: 404 len: 111 microversion: 2.1 time: 0.073841 Dec 16 15:33:43.626292 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1089/2186] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:33:43 2021] GET /compute/v2.1/servers/c47a38ca-4ce3-4387-af13-dc2d25144f8c => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 15:35:09.945114 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c006f2bf-d7e6-4bb8-aace-c3797b4b538d] AMQP server on 10.222.0.45:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 15:35:09.953029 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-8ccce436-4e76-4dfd-abcf-9467f11cb606 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:35:09.953899 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-8ccce436-4e76-4dfd-abcf-9467f11cb606 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 4feaa08e-6919-4701-ab0e-481fe18c9abd] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:35:09.962527 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8ccce436-4e76-4dfd-abcf-9467f11cb606 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:35:09.963061 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8ccce436-4e76-4dfd-abcf-9467f11cb606 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:35:09.964103 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8ccce436-4e76-4dfd-abcf-9467f11cb606 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:35:09.964594 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8ccce436-4e76-4dfd-abcf-9467f11cb606 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:35:10.081371 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.wsgi [None req-8ccce436-4e76-4dfd-abcf-9467f11cb606 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] HTTP exception thrown: Instance 4feaa08e-6919-4701-ab0e-481fe18c9abd could not be found. Dec 16 15:35:10.082065 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-8ccce436-4e76-4dfd-abcf-9467f11cb606 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Returning 404 to user: Instance 4feaa08e-6919-4701-ab0e-481fe18c9abd could not be found. {{(pid=101356) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:941}} Dec 16 15:35:10.082989 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-8ccce436-4e76-4dfd-abcf-9467f11cb606 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "DELETE /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd" status: 404 len: 111 microversion: 2.1 time: 0.139569 Dec 16 15:35:10.083615 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1098/2187] 10.222.0.45 () {58 vars in 1229 bytes} [Thu Dec 16 15:35:09 2021] DELETE /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 15:35:10.095949 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-3490254a-c50f-412c-a653-399e56678a2b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:35:10.096623 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-3490254a-c50f-412c-a653-399e56678a2b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 4feaa08e-6919-4701-ab0e-481fe18c9abd] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:35:10.100127 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 15:35:10.100259 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: Thu Dec 16 15:35:10 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd (ip 10.222.0.45) !!! Dec 16 15:35:10.112004 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 15:35:10.112158 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: Thu Dec 16 15:35:10 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd (ip 10.222.0.45) !!! Dec 16 15:35:10.131160 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3490254a-c50f-412c-a653-399e56678a2b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:35:10.131668 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3490254a-c50f-412c-a653-399e56678a2b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:35:10.132523 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3490254a-c50f-412c-a653-399e56678a2b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:35:10.133014 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3490254a-c50f-412c-a653-399e56678a2b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:35:10.190010 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.wsgi [None req-3490254a-c50f-412c-a653-399e56678a2b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] HTTP exception thrown: Instance 4feaa08e-6919-4701-ab0e-481fe18c9abd could not be found. Dec 16 15:35:10.190727 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-3490254a-c50f-412c-a653-399e56678a2b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Returning 404 to user: Instance 4feaa08e-6919-4701-ab0e-481fe18c9abd could not be found. {{(pid=101355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:941}} Dec 16 15:35:10.191632 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-3490254a-c50f-412c-a653-399e56678a2b tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd" status: 404 len: 111 microversion: 2.1 time: 0.103477 Dec 16 15:35:10.192236 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1090/2188] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:35:10 2021] GET /compute/v2.1/servers/4feaa08e-6919-4701-ab0e-481fe18c9abd => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 15:35:11.515425 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-ce47d326-c096-4497-9895-e807baf45ea9 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:35:11.516088 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-ce47d326-c096-4497-9895-e807baf45ea9 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:35:11.536384 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ce47d326-c096-4497-9895-e807baf45ea9 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:35:11.536893 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ce47d326-c096-4497-9895-e807baf45ea9 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:35:11.538077 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ce47d326-c096-4497-9895-e807baf45ea9 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:35:11.538588 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ce47d326-c096-4497-9895-e807baf45ea9 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:35:11.576803 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO oslo.messaging._drivers.impl_rabbit [-] [c006f2bf-d7e6-4bb8-aace-c3797b4b538d] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 35200. Dec 16 15:35:11.594424 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.wsgi [None req-ce47d326-c096-4497-9895-e807baf45ea9 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] HTTP exception thrown: Instance 2989cd04-6526-4aca-8f1f-771371323c14 could not be found. Dec 16 15:35:11.595098 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-ce47d326-c096-4497-9895-e807baf45ea9 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Returning 404 to user: Instance 2989cd04-6526-4aca-8f1f-771371323c14 could not be found. {{(pid=101356) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:941}} Dec 16 15:35:11.596021 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-ce47d326-c096-4497-9895-e807baf45ea9 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "DELETE /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14" status: 404 len: 111 microversion: 2.1 time: 0.088928 Dec 16 15:35:11.596650 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1099/2189] 10.222.0.45 () {58 vars in 1229 bytes} [Thu Dec 16 15:35:11 2021] DELETE /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 15:35:11.609358 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-a702fe8a-77e0-43cd-8b72-3358cdd150d0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:35:11.610018 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-a702fe8a-77e0-43cd-8b72-3358cdd150d0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] [instance: 2989cd04-6526-4aca-8f1f-771371323c14] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:35:11.619143 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a702fe8a-77e0-43cd-8b72-3358cdd150d0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:35:11.619644 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a702fe8a-77e0-43cd-8b72-3358cdd150d0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:35:11.620496 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a702fe8a-77e0-43cd-8b72-3358cdd150d0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:35:11.621078 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a702fe8a-77e0-43cd-8b72-3358cdd150d0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:35:11.675946 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.wsgi [None req-a702fe8a-77e0-43cd-8b72-3358cdd150d0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] HTTP exception thrown: Instance 2989cd04-6526-4aca-8f1f-771371323c14 could not be found. Dec 16 15:35:11.676610 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-a702fe8a-77e0-43cd-8b72-3358cdd150d0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] Returning 404 to user: Instance 2989cd04-6526-4aca-8f1f-771371323c14 could not be found. {{(pid=101355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:941}} Dec 16 15:35:11.677515 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-a702fe8a-77e0-43cd-8b72-3358cdd150d0 tempest-AttachVolumeTestJSON-1970163619 tempest-AttachVolumeTestJSON-1970163619-project] 10.222.0.45 "GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14" status: 404 len: 111 microversion: 2.1 time: 0.076272 Dec 16 15:35:11.678159 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1091/2190] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:35:11 2021] GET /compute/v2.1/servers/2989cd04-6526-4aca-8f1f-771371323c14 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 15:35:26.437562 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-9381685a-a095-41ab-ade1-f753ce3d09ac tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:35:26.438181 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-9381685a-a095-41ab-ade1-f753ce3d09ac tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] [instance: cd530067-1ba5-46f5-8d47-2dac866e61c1] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:35:26.446494 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9381685a-a095-41ab-ade1-f753ce3d09ac tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:35:26.447002 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9381685a-a095-41ab-ade1-f753ce3d09ac tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:35:26.447880 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9381685a-a095-41ab-ade1-f753ce3d09ac tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:35:26.448386 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9381685a-a095-41ab-ade1-f753ce3d09ac tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:35:26.520544 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-9381685a-a095-41ab-ade1-f753ce3d09ac tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] [instance: cd530067-1ba5-46f5-8d47-2dac866e61c1] Going to try to terminate instance {{(pid=101356) delete /opt/stack/nova/nova/compute/api.py:2496}} Dec 16 15:35:26.832274 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-9381685a-a095-41ab-ade1-f753ce3d09ac tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] 10.222.0.45 "DELETE /compute/v2.1/servers/cd530067-1ba5-46f5-8d47-2dac866e61c1" status: 204 len: 0 microversion: 2.1 time: 0.402904 Dec 16 15:35:26.832963 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1100/2191] 10.222.0.45 () {58 vars in 1229 bytes} [Thu Dec 16 15:35:26 2021] DELETE /compute/v2.1/servers/cd530067-1ba5-46f5-8d47-2dac866e61c1 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 16 15:35:26.840110 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c89047bd-5046-4dc5-81a4-5f3a093a9e0b] AMQP server on 10.222.0.45:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 15:35:26.847966 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-420e024b-6faf-49e9-b37c-3319f742c454 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:35:26.848686 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-420e024b-6faf-49e9-b37c-3319f742c454 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] [instance: cd530067-1ba5-46f5-8d47-2dac866e61c1] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:35:26.857553 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-420e024b-6faf-49e9-b37c-3319f742c454 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:35:26.857770 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-420e024b-6faf-49e9-b37c-3319f742c454 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:35:26.858602 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-420e024b-6faf-49e9-b37c-3319f742c454 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:35:26.859110 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-420e024b-6faf-49e9-b37c-3319f742c454 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:35:27.136561 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-420e024b-6faf-49e9-b37c-3319f742c454 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508cb16ab6343dfb7de72c6b3600ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211699de14224a63a48d253eaa061c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:35:27.146377 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-420e024b-6faf-49e9-b37c-3319f742c454 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] 10.222.0.45 "GET /compute/v2.1/servers/cd530067-1ba5-46f5-8d47-2dac866e61c1" status: 200 len: 1576 microversion: 2.1 time: 0.307920 Dec 16 15:35:27.146963 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1092/2192] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:35:26 2021] GET /compute/v2.1/servers/cd530067-1ba5-46f5-8d47-2dac866e61c1 => generated 1576 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:35:28.170324 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-c3fde029-9a5c-435b-9b94-22d0dc4741ab tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:35:28.171108 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-c3fde029-9a5c-435b-9b94-22d0dc4741ab tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] [instance: cd530067-1ba5-46f5-8d47-2dac866e61c1] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:35:28.179558 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c3fde029-9a5c-435b-9b94-22d0dc4741ab tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:35:28.180588 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c3fde029-9a5c-435b-9b94-22d0dc4741ab tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:35:28.181443 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c3fde029-9a5c-435b-9b94-22d0dc4741ab tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:35:28.181939 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c3fde029-9a5c-435b-9b94-22d0dc4741ab tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:35:28.685066 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-c3fde029-9a5c-435b-9b94-22d0dc4741ab tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508cb16ab6343dfb7de72c6b3600ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211699de14224a63a48d253eaa061c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:35:28.694316 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-c3fde029-9a5c-435b-9b94-22d0dc4741ab tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] 10.222.0.45 "GET /compute/v2.1/servers/cd530067-1ba5-46f5-8d47-2dac866e61c1" status: 200 len: 1576 microversion: 2.1 time: 0.532887 Dec 16 15:35:28.694933 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1101/2193] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:35:28 2021] GET /compute/v2.1/servers/cd530067-1ba5-46f5-8d47-2dac866e61c1 => generated 1576 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:35:29.717283 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-475bad51-7dd5-4e6c-ba96-da88793c6f27 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:35:29.718347 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-475bad51-7dd5-4e6c-ba96-da88793c6f27 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] [instance: cd530067-1ba5-46f5-8d47-2dac866e61c1] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:35:29.738992 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-475bad51-7dd5-4e6c-ba96-da88793c6f27 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:35:29.739655 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-475bad51-7dd5-4e6c-ba96-da88793c6f27 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:35:29.740635 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-475bad51-7dd5-4e6c-ba96-da88793c6f27 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:35:29.741237 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-475bad51-7dd5-4e6c-ba96-da88793c6f27 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:35:29.809009 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO oslo.messaging._drivers.impl_rabbit [-] [c89047bd-5046-4dc5-81a4-5f3a093a9e0b] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 35392. Dec 16 15:35:30.098494 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-475bad51-7dd5-4e6c-ba96-da88793c6f27 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508cb16ab6343dfb7de72c6b3600ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211699de14224a63a48d253eaa061c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:35:30.108261 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-475bad51-7dd5-4e6c-ba96-da88793c6f27 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] 10.222.0.45 "GET /compute/v2.1/servers/cd530067-1ba5-46f5-8d47-2dac866e61c1" status: 200 len: 1576 microversion: 2.1 time: 0.399277 Dec 16 15:35:30.108853 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1093/2194] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:35:29 2021] GET /compute/v2.1/servers/cd530067-1ba5-46f5-8d47-2dac866e61c1 => generated 1576 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:35:30.782706 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [req-1979911f-828a-4c33-9918-54a8e6b0aebc req-cc983bce-251d-4274-9037-186bea807edf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd530067-1ba5-46f5-8d47-2dac866e61c1", "name": "network-vif-deleted", "tag": "0e4d14e0-cb79-43cb-9b80-5ced96d4c2b7"}]} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:35:30.788601 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:35:30.788601 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: warnings.warn(msg) Dec 16 15:35:30.800270 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-1979911f-828a-4c33-9918-54a8e6b0aebc req-cc983bce-251d-4274-9037-186bea807edf service nova] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:35:30.801313 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-1979911f-828a-4c33-9918-54a8e6b0aebc req-cc983bce-251d-4274-9037-186bea807edf service nova] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:35:30.832980 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.compute.server_external_events [req-1979911f-828a-4c33-9918-54a8e6b0aebc req-cc983bce-251d-4274-9037-186bea807edf service nova] Creating event network-vif-deleted:0e4d14e0-cb79-43cb-9b80-5ced96d4c2b7 for instance cd530067-1ba5-46f5-8d47-2dac866e61c1 on hv-cinder-82189 Dec 16 15:35:30.839660 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [req-1979911f-828a-4c33-9918-54a8e6b0aebc req-cc983bce-251d-4274-9037-186bea807edf service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066135 Dec 16 15:35:30.840307 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1102/2195] 10.222.0.45 () {64 vars in 1308 bytes} [Thu Dec 16 15:35:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:35:31.131912 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-6d6d1f7c-e82c-46fb-b69a-efddfcd3fb35 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:35:31.132597 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-6d6d1f7c-e82c-46fb-b69a-efddfcd3fb35 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] [instance: cd530067-1ba5-46f5-8d47-2dac866e61c1] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:35:31.142631 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6d6d1f7c-e82c-46fb-b69a-efddfcd3fb35 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:35:31.142631 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6d6d1f7c-e82c-46fb-b69a-efddfcd3fb35 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:35:31.142859 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6d6d1f7c-e82c-46fb-b69a-efddfcd3fb35 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:35:31.143186 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6d6d1f7c-e82c-46fb-b69a-efddfcd3fb35 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:35:31.377204 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-6d6d1f7c-e82c-46fb-b69a-efddfcd3fb35 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508cb16ab6343dfb7de72c6b3600ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211699de14224a63a48d253eaa061c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:35:31.387769 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-6d6d1f7c-e82c-46fb-b69a-efddfcd3fb35 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] 10.222.0.45 "GET /compute/v2.1/servers/cd530067-1ba5-46f5-8d47-2dac866e61c1" status: 200 len: 1225 microversion: 2.1 time: 0.264001 Dec 16 15:35:31.389389 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1094/2196] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:35:31 2021] GET /compute/v2.1/servers/cd530067-1ba5-46f5-8d47-2dac866e61c1 => generated 1225 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:35:32.411711 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-44e90188-a8d3-4ccf-9552-955065bce62a tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:35:32.412840 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-44e90188-a8d3-4ccf-9552-955065bce62a tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] [instance: cd530067-1ba5-46f5-8d47-2dac866e61c1] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:35:32.422240 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-44e90188-a8d3-4ccf-9552-955065bce62a tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:35:32.426275 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-44e90188-a8d3-4ccf-9552-955065bce62a tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:35:32.426275 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-44e90188-a8d3-4ccf-9552-955065bce62a tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:35:32.426275 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-44e90188-a8d3-4ccf-9552-955065bce62a tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:35:32.486432 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.wsgi [None req-44e90188-a8d3-4ccf-9552-955065bce62a tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] HTTP exception thrown: Instance cd530067-1ba5-46f5-8d47-2dac866e61c1 could not be found. Dec 16 15:35:32.487432 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-44e90188-a8d3-4ccf-9552-955065bce62a tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Returning 404 to user: Instance cd530067-1ba5-46f5-8d47-2dac866e61c1 could not be found. {{(pid=101356) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:941}} Dec 16 15:35:32.488369 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-44e90188-a8d3-4ccf-9552-955065bce62a tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] 10.222.0.45 "GET /compute/v2.1/servers/cd530067-1ba5-46f5-8d47-2dac866e61c1" status: 404 len: 111 microversion: 2.1 time: 0.085572 Dec 16 15:35:32.488970 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1103/2197] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:35:32 2021] GET /compute/v2.1/servers/cd530067-1ba5-46f5-8d47-2dac866e61c1 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 15:35:32.619508 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-c84c6894-ce5e-4d95-9483-d360c81327bb tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2140691674", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1519735302", "security_groups": [{"name": "tempest-secgroup-smoke-1827351747"}], "block_device_mapping_v2": [{"uuid": "b6291f8a-55f7-44a8-954d-7e6c7b63893d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "888cf1c9-54d5-43ec-9d53-9903be1aba42"}]}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:35:32.824455 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.network.neutron [None req-c84c6894-ce5e-4d95-9483-d360c81327bb tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] validate_networks() for [('888cf1c9-54d5-43ec-9d53-9903be1aba42', None, None, None)] {{(pid=101355) validate_networks /opt/stack/nova/nova/network/neutron.py:2383}} Dec 16 15:35:33.455392 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.virt.hardware [None req-c84c6894-ce5e-4d95-9483-d360c81327bb tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Flavor limits 0:0:0 {{(pid=101355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:338}} Dec 16 15:35:33.455883 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.virt.hardware [None req-c84c6894-ce5e-4d95-9483-d360c81327bb tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Image limits 0:0:0 {{(pid=101355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:342}} Dec 16 15:35:33.456433 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.virt.hardware [None req-c84c6894-ce5e-4d95-9483-d360c81327bb tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Flavor pref 0:0:0 {{(pid=101355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:378}} Dec 16 15:35:33.456895 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.virt.hardware [None req-c84c6894-ce5e-4d95-9483-d360c81327bb tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Image pref 0:0:0 {{(pid=101355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:382}} Dec 16 15:35:33.457382 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.virt.hardware [None req-c84c6894-ce5e-4d95-9483-d360c81327bb tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=101355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:422}} Dec 16 15:35:33.467386 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c84c6894-ce5e-4d95-9483-d360c81327bb tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:35:33.468141 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c84c6894-ce5e-4d95-9483-d360c81327bb tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:35:33.469081 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c84c6894-ce5e-4d95-9483-d360c81327bb tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:35:33.469714 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c84c6894-ce5e-4d95-9483-d360c81327bb tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:35:33.490878 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.quota [None req-c84c6894-ce5e-4d95-9483-d360c81327bb tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Getting quotas for project 211699de14224a63a48d253eaa061c69. Resources: {'ram', 'instances', 'cores'} {{(pid=101355) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 16 15:35:33.496236 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.quota [None req-c84c6894-ce5e-4d95-9483-d360c81327bb tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Getting quotas for user 7508cb16ab6343dfb7de72c6b3600ae8 and project 211699de14224a63a48d253eaa061c69. Resources: {'ram', 'instances', 'cores'} {{(pid=101355) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 16 15:35:33.607324 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-c84c6894-ce5e-4d95-9483-d360c81327bb tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Going to run 1 instances... {{(pid=101355) _provision_instances /opt/stack/nova/nova/compute/api.py:1224}} Dec 16 15:35:33.610412 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-c84c6894-ce5e-4d95-9483-d360c81327bb tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] [instance: 8551537f-b0e4-4f79-b9db-fc097f9828f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b6291f8a-55f7-44a8-954d-7e6c7b63893d',volume_size=None,volume_type=None)] {{(pid=101355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1616}} Dec 16 15:35:34.007335 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-c84c6894-ce5e-4d95-9483-d360c81327bb tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.400465 Dec 16 15:35:34.008234 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1095/2198] 10.222.0.45 () {60 vars in 1137 bytes} [Thu Dec 16 15:35:32 2021] POST /compute/v2.1/servers => generated 406 bytes in 1402 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 16 15:35:34.023182 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-dc209f42-5857-4bae-ba3a-dff3098b3301 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:35:34.024392 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-dc209f42-5857-4bae-ba3a-dff3098b3301 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] [instance: 8551537f-b0e4-4f79-b9db-fc097f9828f3] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:35:34.129707 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-dc209f42-5857-4bae-ba3a-dff3098b3301 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508cb16ab6343dfb7de72c6b3600ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211699de14224a63a48d253eaa061c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:35:34.138770 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-dc209f42-5857-4bae-ba3a-dff3098b3301 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] 10.222.0.45 "GET /compute/v2.1/servers/8551537f-b0e4-4f79-b9db-fc097f9828f3" status: 200 len: 1095 microversion: 2.1 time: 0.123694 Dec 16 15:35:34.139362 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1104/2199] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:35:34 2021] GET /compute/v2.1/servers/8551537f-b0e4-4f79-b9db-fc097f9828f3 => generated 1095 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:35:35.161350 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-8ae52878-3d55-4678-9845-c9a6163d9d70 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:35:35.162010 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-8ae52878-3d55-4678-9845-c9a6163d9d70 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] [instance: 8551537f-b0e4-4f79-b9db-fc097f9828f3] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:35:35.171757 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8ae52878-3d55-4678-9845-c9a6163d9d70 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:35:35.172251 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8ae52878-3d55-4678-9845-c9a6163d9d70 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:35:35.173369 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8ae52878-3d55-4678-9845-c9a6163d9d70 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:35:35.173868 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8ae52878-3d55-4678-9845-c9a6163d9d70 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:35:35.305849 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-8ae52878-3d55-4678-9845-c9a6163d9d70 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508cb16ab6343dfb7de72c6b3600ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211699de14224a63a48d253eaa061c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:35:35.315126 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-8ae52878-3d55-4678-9845-c9a6163d9d70 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] 10.222.0.45 "GET /compute/v2.1/servers/8551537f-b0e4-4f79-b9db-fc097f9828f3" status: 200 len: 1193 microversion: 2.1 time: 0.161952 Dec 16 15:35:35.315891 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1096/2200] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:35:35 2021] GET /compute/v2.1/servers/8551537f-b0e4-4f79-b9db-fc097f9828f3 => generated 1193 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:35:36.339899 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-4ce8ec57-e637-4b76-88ba-113c19632567 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:35:36.344729 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-4ce8ec57-e637-4b76-88ba-113c19632567 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] [instance: 8551537f-b0e4-4f79-b9db-fc097f9828f3] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:35:36.351367 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4ce8ec57-e637-4b76-88ba-113c19632567 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:35:36.352764 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4ce8ec57-e637-4b76-88ba-113c19632567 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:35:36.353870 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4ce8ec57-e637-4b76-88ba-113c19632567 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:35:36.354571 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4ce8ec57-e637-4b76-88ba-113c19632567 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:35:36.529071 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-4ce8ec57-e637-4b76-88ba-113c19632567 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508cb16ab6343dfb7de72c6b3600ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211699de14224a63a48d253eaa061c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:35:36.550109 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-4ce8ec57-e637-4b76-88ba-113c19632567 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] 10.222.0.45 "GET /compute/v2.1/servers/8551537f-b0e4-4f79-b9db-fc097f9828f3" status: 200 len: 1211 microversion: 2.1 time: 0.218319 Dec 16 15:35:36.551821 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1105/2201] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:35:36 2021] GET /compute/v2.1/servers/8551537f-b0e4-4f79-b9db-fc097f9828f3 => generated 1211 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:35:37.583138 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-24367998-ec1b-4c49-a9f0-154504314a0f tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:35:37.583809 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-24367998-ec1b-4c49-a9f0-154504314a0f tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] [instance: 8551537f-b0e4-4f79-b9db-fc097f9828f3] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:35:37.604491 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-24367998-ec1b-4c49-a9f0-154504314a0f tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:35:37.605439 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-24367998-ec1b-4c49-a9f0-154504314a0f tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:35:37.606639 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-24367998-ec1b-4c49-a9f0-154504314a0f tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:35:37.608106 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-24367998-ec1b-4c49-a9f0-154504314a0f tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:35:38.532384 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-24367998-ec1b-4c49-a9f0-154504314a0f tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508cb16ab6343dfb7de72c6b3600ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211699de14224a63a48d253eaa061c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:35:38.543365 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-24367998-ec1b-4c49-a9f0-154504314a0f tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] 10.222.0.45 "GET /compute/v2.1/servers/8551537f-b0e4-4f79-b9db-fc097f9828f3" status: 200 len: 1267 microversion: 2.1 time: 0.975519 Dec 16 15:35:38.544060 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1097/2202] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:35:37 2021] GET /compute/v2.1/servers/8551537f-b0e4-4f79-b9db-fc097f9828f3 => generated 1267 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:35:39.215090 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [req-0e058c96-d5b6-4f4a-97cc-3a1189b78c5b req-4edbc9be-48aa-4855-a2ff-0ca863174a16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8551537f-b0e4-4f79-b9db-fc097f9828f3", "tag": "3fcc49cd-033e-4c73-a0be-c35b404689c8"}]} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:35:39.237750 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:35:39.237750 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: warnings.warn(msg) Dec 16 15:35:39.237750 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-0e058c96-d5b6-4f4a-97cc-3a1189b78c5b req-4edbc9be-48aa-4855-a2ff-0ca863174a16 service nova] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:35:39.238914 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-0e058c96-d5b6-4f4a-97cc-3a1189b78c5b req-4edbc9be-48aa-4855-a2ff-0ca863174a16 service nova] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:35:39.260646 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.compute.server_external_events [req-0e058c96-d5b6-4f4a-97cc-3a1189b78c5b req-4edbc9be-48aa-4855-a2ff-0ca863174a16 service nova] Creating event network-changed:3fcc49cd-033e-4c73-a0be-c35b404689c8 for instance 8551537f-b0e4-4f79-b9db-fc097f9828f3 on hv-cinder-82189 Dec 16 15:35:39.267387 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [req-0e058c96-d5b6-4f4a-97cc-3a1189b78c5b req-4edbc9be-48aa-4855-a2ff-0ca863174a16 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065009 Dec 16 15:35:39.268674 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1106/2203] 10.222.0.45 () {64 vars in 1308 bytes} [Thu Dec 16 15:35:39 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:35:39.568093 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-410d3fff-4367-4f88-bbdb-b912a631226c tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:35:39.568727 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-410d3fff-4367-4f88-bbdb-b912a631226c tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] [instance: 8551537f-b0e4-4f79-b9db-fc097f9828f3] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:35:39.583423 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-410d3fff-4367-4f88-bbdb-b912a631226c tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:35:39.584197 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-410d3fff-4367-4f88-bbdb-b912a631226c tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:35:39.585187 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-410d3fff-4367-4f88-bbdb-b912a631226c tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:35:39.585935 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-410d3fff-4367-4f88-bbdb-b912a631226c tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:35:39.979218 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-410d3fff-4367-4f88-bbdb-b912a631226c tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508cb16ab6343dfb7de72c6b3600ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211699de14224a63a48d253eaa061c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:35:39.990625 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-410d3fff-4367-4f88-bbdb-b912a631226c tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] 10.222.0.45 "GET /compute/v2.1/servers/8551537f-b0e4-4f79-b9db-fc097f9828f3" status: 200 len: 1267 microversion: 2.1 time: 0.430466 Dec 16 15:35:39.991252 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1098/2204] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:35:39 2021] GET /compute/v2.1/servers/8551537f-b0e4-4f79-b9db-fc097f9828f3 => generated 1267 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:35:41.015195 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-3e651363-fba1-4425-8730-3eabeb879ff8 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:35:41.016183 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-3e651363-fba1-4425-8730-3eabeb879ff8 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] [instance: 8551537f-b0e4-4f79-b9db-fc097f9828f3] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:35:41.024777 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3e651363-fba1-4425-8730-3eabeb879ff8 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:35:41.025558 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3e651363-fba1-4425-8730-3eabeb879ff8 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:35:41.026455 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3e651363-fba1-4425-8730-3eabeb879ff8 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:35:41.026959 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3e651363-fba1-4425-8730-3eabeb879ff8 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:35:41.300532 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-3e651363-fba1-4425-8730-3eabeb879ff8 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508cb16ab6343dfb7de72c6b3600ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211699de14224a63a48d253eaa061c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:35:41.318387 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-3e651363-fba1-4425-8730-3eabeb879ff8 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] 10.222.0.45 "GET /compute/v2.1/servers/8551537f-b0e4-4f79-b9db-fc097f9828f3" status: 200 len: 1267 microversion: 2.1 time: 0.311234 Dec 16 15:35:41.319019 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1107/2205] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:35:41 2021] GET /compute/v2.1/servers/8551537f-b0e4-4f79-b9db-fc097f9828f3 => generated 1267 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:35:42.339978 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-2e4eece0-bc19-4fb5-af32-c446b8dbd3db tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:35:42.341400 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-2e4eece0-bc19-4fb5-af32-c446b8dbd3db tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] [instance: 8551537f-b0e4-4f79-b9db-fc097f9828f3] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:35:42.351377 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2e4eece0-bc19-4fb5-af32-c446b8dbd3db tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:35:42.352188 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2e4eece0-bc19-4fb5-af32-c446b8dbd3db tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:35:42.353609 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2e4eece0-bc19-4fb5-af32-c446b8dbd3db tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:35:42.354433 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2e4eece0-bc19-4fb5-af32-c446b8dbd3db tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:35:42.593099 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-2e4eece0-bc19-4fb5-af32-c446b8dbd3db tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508cb16ab6343dfb7de72c6b3600ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211699de14224a63a48d253eaa061c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:35:42.604537 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-2e4eece0-bc19-4fb5-af32-c446b8dbd3db tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] 10.222.0.45 "GET /compute/v2.1/servers/8551537f-b0e4-4f79-b9db-fc097f9828f3" status: 200 len: 1267 microversion: 2.1 time: 0.272497 Dec 16 15:35:42.605164 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1099/2206] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:35:42 2021] GET /compute/v2.1/servers/8551537f-b0e4-4f79-b9db-fc097f9828f3 => generated 1267 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:35:43.626626 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-dacca2b8-55f2-40d5-a9cf-da1799fb0b0f tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:35:43.627305 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-dacca2b8-55f2-40d5-a9cf-da1799fb0b0f tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] [instance: 8551537f-b0e4-4f79-b9db-fc097f9828f3] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:35:43.636917 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-dacca2b8-55f2-40d5-a9cf-da1799fb0b0f tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:35:43.637532 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-dacca2b8-55f2-40d5-a9cf-da1799fb0b0f tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:35:43.639232 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-dacca2b8-55f2-40d5-a9cf-da1799fb0b0f tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:35:43.639232 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-dacca2b8-55f2-40d5-a9cf-da1799fb0b0f tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:35:43.881005 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-dacca2b8-55f2-40d5-a9cf-da1799fb0b0f tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508cb16ab6343dfb7de72c6b3600ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211699de14224a63a48d253eaa061c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:35:43.891181 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-dacca2b8-55f2-40d5-a9cf-da1799fb0b0f tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] 10.222.0.45 "GET /compute/v2.1/servers/8551537f-b0e4-4f79-b9db-fc097f9828f3" status: 200 len: 1267 microversion: 2.1 time: 0.271979 Dec 16 15:35:43.891676 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1108/2207] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:35:43 2021] GET /compute/v2.1/servers/8551537f-b0e4-4f79-b9db-fc097f9828f3 => generated 1267 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:35:44.914282 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-7dbb52a7-195b-475b-9164-cf558d777d36 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:35:44.914979 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-7dbb52a7-195b-475b-9164-cf558d777d36 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] [instance: 8551537f-b0e4-4f79-b9db-fc097f9828f3] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:35:44.923860 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7dbb52a7-195b-475b-9164-cf558d777d36 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:35:44.924361 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7dbb52a7-195b-475b-9164-cf558d777d36 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:35:44.925213 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7dbb52a7-195b-475b-9164-cf558d777d36 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:35:44.925698 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7dbb52a7-195b-475b-9164-cf558d777d36 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:35:45.158488 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-7dbb52a7-195b-475b-9164-cf558d777d36 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508cb16ab6343dfb7de72c6b3600ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211699de14224a63a48d253eaa061c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:35:45.167959 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-7dbb52a7-195b-475b-9164-cf558d777d36 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] 10.222.0.45 "GET /compute/v2.1/servers/8551537f-b0e4-4f79-b9db-fc097f9828f3" status: 200 len: 1267 microversion: 2.1 time: 0.262637 Dec 16 15:35:45.168566 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1100/2208] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:35:44 2021] GET /compute/v2.1/servers/8551537f-b0e4-4f79-b9db-fc097f9828f3 => generated 1267 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:35:46.188972 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-d4647c53-618b-4f71-885b-3791f094ec84 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:35:46.189632 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-d4647c53-618b-4f71-885b-3791f094ec84 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] [instance: 8551537f-b0e4-4f79-b9db-fc097f9828f3] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:35:46.198348 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d4647c53-618b-4f71-885b-3791f094ec84 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:35:46.198896 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d4647c53-618b-4f71-885b-3791f094ec84 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:35:46.199737 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d4647c53-618b-4f71-885b-3791f094ec84 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:35:46.200217 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d4647c53-618b-4f71-885b-3791f094ec84 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:35:46.461461 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-d4647c53-618b-4f71-885b-3791f094ec84 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508cb16ab6343dfb7de72c6b3600ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211699de14224a63a48d253eaa061c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:35:46.470588 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-d4647c53-618b-4f71-885b-3791f094ec84 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] 10.222.0.45 "GET /compute/v2.1/servers/8551537f-b0e4-4f79-b9db-fc097f9828f3" status: 200 len: 1267 microversion: 2.1 time: 0.289327 Dec 16 15:35:46.471197 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1109/2209] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:35:46 2021] GET /compute/v2.1/servers/8551537f-b0e4-4f79-b9db-fc097f9828f3 => generated 1267 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:35:47.492692 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-2e0280e1-6105-4d3c-842b-3d3396942f92 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:35:47.493418 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-2e0280e1-6105-4d3c-842b-3d3396942f92 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] [instance: 8551537f-b0e4-4f79-b9db-fc097f9828f3] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:35:47.501408 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2e0280e1-6105-4d3c-842b-3d3396942f92 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:35:47.501897 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2e0280e1-6105-4d3c-842b-3d3396942f92 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:35:47.502774 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2e0280e1-6105-4d3c-842b-3d3396942f92 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:35:47.503255 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2e0280e1-6105-4d3c-842b-3d3396942f92 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:35:47.733731 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-2e0280e1-6105-4d3c-842b-3d3396942f92 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508cb16ab6343dfb7de72c6b3600ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211699de14224a63a48d253eaa061c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:35:47.743780 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-2e0280e1-6105-4d3c-842b-3d3396942f92 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] 10.222.0.45 "GET /compute/v2.1/servers/8551537f-b0e4-4f79-b9db-fc097f9828f3" status: 200 len: 1267 microversion: 2.1 time: 0.258575 Dec 16 15:35:47.744287 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1101/2210] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:35:47 2021] GET /compute/v2.1/servers/8551537f-b0e4-4f79-b9db-fc097f9828f3 => generated 1267 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:35:48.766945 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-1c20fdda-bc26-4bf9-8cff-2ac1fcd07e42 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:35:48.768194 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-1c20fdda-bc26-4bf9-8cff-2ac1fcd07e42 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] [instance: 8551537f-b0e4-4f79-b9db-fc097f9828f3] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:35:48.778813 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1c20fdda-bc26-4bf9-8cff-2ac1fcd07e42 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:35:48.778813 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1c20fdda-bc26-4bf9-8cff-2ac1fcd07e42 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:35:48.778813 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1c20fdda-bc26-4bf9-8cff-2ac1fcd07e42 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:35:48.778813 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1c20fdda-bc26-4bf9-8cff-2ac1fcd07e42 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:35:49.039891 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-1c20fdda-bc26-4bf9-8cff-2ac1fcd07e42 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508cb16ab6343dfb7de72c6b3600ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211699de14224a63a48d253eaa061c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:35:49.049559 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-1c20fdda-bc26-4bf9-8cff-2ac1fcd07e42 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] 10.222.0.45 "GET /compute/v2.1/servers/8551537f-b0e4-4f79-b9db-fc097f9828f3" status: 200 len: 1267 microversion: 2.1 time: 0.291083 Dec 16 15:35:49.050187 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1110/2211] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:35:48 2021] GET /compute/v2.1/servers/8551537f-b0e4-4f79-b9db-fc097f9828f3 => generated 1267 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:35:49.856140 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [req-5c3a7d95-1418-4d43-ad03-daa8acb529f2 req-96e8e77c-324d-412a-974e-8c01676f17a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8551537f-b0e4-4f79-b9db-fc097f9828f3", "name": "network-vif-plugged", "status": "completed", "tag": "3fcc49cd-033e-4c73-a0be-c35b404689c8"}]} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:35:49.861123 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:35:49.861123 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: warnings.warn(msg) Dec 16 15:35:49.870893 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-5c3a7d95-1418-4d43-ad03-daa8acb529f2 req-96e8e77c-324d-412a-974e-8c01676f17a8 service nova] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:35:49.871401 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-5c3a7d95-1418-4d43-ad03-daa8acb529f2 req-96e8e77c-324d-412a-974e-8c01676f17a8 service nova] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:35:49.895002 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.compute.server_external_events [req-5c3a7d95-1418-4d43-ad03-daa8acb529f2 req-96e8e77c-324d-412a-974e-8c01676f17a8 service nova] Creating event network-vif-plugged:3fcc49cd-033e-4c73-a0be-c35b404689c8 for instance 8551537f-b0e4-4f79-b9db-fc097f9828f3 on hv-cinder-82189 Dec 16 15:35:49.895644 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [req-5c3a7d95-1418-4d43-ad03-daa8acb529f2 req-96e8e77c-324d-412a-974e-8c01676f17a8 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048546 Dec 16 15:35:49.896309 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1102/2212] 10.222.0.45 () {64 vars in 1308 bytes} [Thu Dec 16 15:35:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:35:50.072587 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-ac327fab-25c9-4124-a956-e378817db4d6 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:35:50.073158 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-ac327fab-25c9-4124-a956-e378817db4d6 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] [instance: 8551537f-b0e4-4f79-b9db-fc097f9828f3] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:35:50.081474 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ac327fab-25c9-4124-a956-e378817db4d6 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:35:50.082027 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ac327fab-25c9-4124-a956-e378817db4d6 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:35:50.082900 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ac327fab-25c9-4124-a956-e378817db4d6 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:35:50.083395 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ac327fab-25c9-4124-a956-e378817db4d6 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:35:50.368413 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-ac327fab-25c9-4124-a956-e378817db4d6 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508cb16ab6343dfb7de72c6b3600ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211699de14224a63a48d253eaa061c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:35:50.380904 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-ac327fab-25c9-4124-a956-e378817db4d6 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] 10.222.0.45 "GET /compute/v2.1/servers/8551537f-b0e4-4f79-b9db-fc097f9828f3" status: 200 len: 1267 microversion: 2.1 time: 0.316593 Dec 16 15:35:50.381778 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1111/2213] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:35:50 2021] GET /compute/v2.1/servers/8551537f-b0e4-4f79-b9db-fc097f9828f3 => generated 1267 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:35:51.405019 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-d7a44817-2c8b-4bd0-bdd1-1be99e4b3f86 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:35:51.406510 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-d7a44817-2c8b-4bd0-bdd1-1be99e4b3f86 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] [instance: 8551537f-b0e4-4f79-b9db-fc097f9828f3] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:35:51.416322 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d7a44817-2c8b-4bd0-bdd1-1be99e4b3f86 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:35:51.416683 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d7a44817-2c8b-4bd0-bdd1-1be99e4b3f86 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:35:51.417530 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d7a44817-2c8b-4bd0-bdd1-1be99e4b3f86 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:35:51.418026 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d7a44817-2c8b-4bd0-bdd1-1be99e4b3f86 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:35:51.651642 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-d7a44817-2c8b-4bd0-bdd1-1be99e4b3f86 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508cb16ab6343dfb7de72c6b3600ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211699de14224a63a48d253eaa061c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:35:51.661024 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-d7a44817-2c8b-4bd0-bdd1-1be99e4b3f86 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] 10.222.0.45 "GET /compute/v2.1/servers/8551537f-b0e4-4f79-b9db-fc097f9828f3" status: 200 len: 1267 microversion: 2.1 time: 0.265228 Dec 16 15:35:51.661647 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1103/2214] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:35:51 2021] GET /compute/v2.1/servers/8551537f-b0e4-4f79-b9db-fc097f9828f3 => generated 1267 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:35:52.684125 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-28a7b893-81c5-4801-9e72-1fead61dd0ff tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:35:52.684830 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-28a7b893-81c5-4801-9e72-1fead61dd0ff tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] [instance: 8551537f-b0e4-4f79-b9db-fc097f9828f3] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:35:52.692924 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-28a7b893-81c5-4801-9e72-1fead61dd0ff tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:35:52.693437 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-28a7b893-81c5-4801-9e72-1fead61dd0ff tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:35:52.694324 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-28a7b893-81c5-4801-9e72-1fead61dd0ff tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:35:52.695405 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-28a7b893-81c5-4801-9e72-1fead61dd0ff tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:35:52.934889 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-28a7b893-81c5-4801-9e72-1fead61dd0ff tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508cb16ab6343dfb7de72c6b3600ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211699de14224a63a48d253eaa061c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:35:52.944231 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-28a7b893-81c5-4801-9e72-1fead61dd0ff tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] 10.222.0.45 "GET /compute/v2.1/servers/8551537f-b0e4-4f79-b9db-fc097f9828f3" status: 200 len: 1453 microversion: 2.1 time: 0.268450 Dec 16 15:35:52.945533 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1112/2215] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:35:52 2021] GET /compute/v2.1/servers/8551537f-b0e4-4f79-b9db-fc097f9828f3 => generated 1453 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:35:52.965886 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-f5f7b504-0e3b-4cd7-b044-9e1bb8108690 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:35:52.966587 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-f5f7b504-0e3b-4cd7-b044-9e1bb8108690 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] [instance: 8551537f-b0e4-4f79-b9db-fc097f9828f3] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:35:52.974846 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f5f7b504-0e3b-4cd7-b044-9e1bb8108690 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:35:52.975240 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f5f7b504-0e3b-4cd7-b044-9e1bb8108690 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:35:52.976698 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f5f7b504-0e3b-4cd7-b044-9e1bb8108690 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:35:52.977162 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f5f7b504-0e3b-4cd7-b044-9e1bb8108690 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:35:53.211921 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-f5f7b504-0e3b-4cd7-b044-9e1bb8108690 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508cb16ab6343dfb7de72c6b3600ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211699de14224a63a48d253eaa061c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:35:53.221437 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-f5f7b504-0e3b-4cd7-b044-9e1bb8108690 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] 10.222.0.45 "GET /compute/v2.1/servers/8551537f-b0e4-4f79-b9db-fc097f9828f3" status: 200 len: 1453 microversion: 2.1 time: 0.263108 Dec 16 15:35:53.222223 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1104/2216] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:35:52 2021] GET /compute/v2.1/servers/8551537f-b0e4-4f79-b9db-fc097f9828f3 => generated 1453 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:35:56.514646 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [req-23d8d438-45c4-4b9f-b18d-ce259067f3d1 req-8c6b7b06-da42-4f41-aa3f-4dd45fedc5e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8551537f-b0e4-4f79-b9db-fc097f9828f3", "tag": "3fcc49cd-033e-4c73-a0be-c35b404689c8"}]} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:35:56.519328 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:35:56.519328 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: warnings.warn(msg) Dec 16 15:35:56.529108 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-23d8d438-45c4-4b9f-b18d-ce259067f3d1 req-8c6b7b06-da42-4f41-aa3f-4dd45fedc5e1 service nova] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:35:56.529672 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-23d8d438-45c4-4b9f-b18d-ce259067f3d1 req-8c6b7b06-da42-4f41-aa3f-4dd45fedc5e1 service nova] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:35:56.549667 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.compute.server_external_events [req-23d8d438-45c4-4b9f-b18d-ce259067f3d1 req-8c6b7b06-da42-4f41-aa3f-4dd45fedc5e1 service nova] Creating event network-changed:3fcc49cd-033e-4c73-a0be-c35b404689c8 for instance 8551537f-b0e4-4f79-b9db-fc097f9828f3 on hv-cinder-82189 Dec 16 15:35:56.555177 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [req-23d8d438-45c4-4b9f-b18d-ce259067f3d1 req-8c6b7b06-da42-4f41-aa3f-4dd45fedc5e1 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047879 Dec 16 15:35:56.557104 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1113/2217] 10.222.0.45 () {64 vars in 1308 bytes} [Thu Dec 16 15:35:56 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:36:36.491411 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-1d72cfa5-91cc-4256-a8f5-af0265015c2e tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Action: 'create', calling method: .version_select at 0x7f14f732e048>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-562923400"}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:36:36.517451 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.quota [None req-1d72cfa5-91cc-4256-a8f5-af0265015c2e tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Getting quotas for project b6a9888d9bd1474688bf7f4b0feb85df. Resources: {'key_pairs'} {{(pid=101355) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 16 15:36:36.521536 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.quota [None req-1d72cfa5-91cc-4256-a8f5-af0265015c2e tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Getting quotas for user b870a3670f19464a8574e3fe9317e296 and project b6a9888d9bd1474688bf7f4b0feb85df. Resources: {'key_pairs'} {{(pid=101355) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 16 15:36:36.774879 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.quota [None req-1d72cfa5-91cc-4256-a8f5-af0265015c2e tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Getting quotas for project b6a9888d9bd1474688bf7f4b0feb85df. Resources: {'key_pairs'} {{(pid=101355) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 16 15:36:36.778913 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.quota [None req-1d72cfa5-91cc-4256-a8f5-af0265015c2e tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Getting quotas for user b870a3670f19464a8574e3fe9317e296 and project b6a9888d9bd1474688bf7f4b0feb85df. Resources: {'key_pairs'} {{(pid=101355) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 16 15:36:36.795448 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-1d72cfa5-91cc-4256-a8f5-af0265015c2e tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 2321 microversion: 2.1 time: 0.311903 Dec 16 15:36:36.796105 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1105/2218] 10.222.0.45 () {60 vars in 1148 bytes} [Thu Dec 16 15:36:36 2021] POST /compute/v2.1/os-keypairs => generated 2321 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:36:36.857927 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-0b150ae1-06e2-438b-a681-1bc460e7cf53 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-421857166", "imageRef": "9992d9b1-78e2-4d97-af3a-aa9786cf3389", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-562923400", "networks": [{"uuid": "260b6d1b-bb5d-47a7-8350-42d33bda8294"}]}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:36:37.087503 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.network.neutron [None req-0b150ae1-06e2-438b-a681-1bc460e7cf53 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] validate_networks() for [('260b6d1b-bb5d-47a7-8350-42d33bda8294', None, None, None)] {{(pid=101356) validate_networks /opt/stack/nova/nova/network/neutron.py:2383}} Dec 16 15:36:37.766844 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.virt.hardware [None req-0b150ae1-06e2-438b-a681-1bc460e7cf53 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Flavor limits 0:0:0 {{(pid=101356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:338}} Dec 16 15:36:37.767450 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.virt.hardware [None req-0b150ae1-06e2-438b-a681-1bc460e7cf53 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Image limits 0:0:0 {{(pid=101356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:342}} Dec 16 15:36:37.767835 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.virt.hardware [None req-0b150ae1-06e2-438b-a681-1bc460e7cf53 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Flavor pref 0:0:0 {{(pid=101356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:378}} Dec 16 15:36:37.768299 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.virt.hardware [None req-0b150ae1-06e2-438b-a681-1bc460e7cf53 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Image pref 0:0:0 {{(pid=101356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:382}} Dec 16 15:36:37.768764 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.virt.hardware [None req-0b150ae1-06e2-438b-a681-1bc460e7cf53 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=101356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:422}} Dec 16 15:36:37.778678 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0b150ae1-06e2-438b-a681-1bc460e7cf53 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:36:37.779181 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0b150ae1-06e2-438b-a681-1bc460e7cf53 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:36:37.780064 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0b150ae1-06e2-438b-a681-1bc460e7cf53 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:36:37.780559 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0b150ae1-06e2-438b-a681-1bc460e7cf53 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:36:37.800737 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.quota [None req-0b150ae1-06e2-438b-a681-1bc460e7cf53 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Getting quotas for project b6a9888d9bd1474688bf7f4b0feb85df. Resources: {'ram', 'instances', 'cores'} {{(pid=101356) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 16 15:36:37.805699 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.quota [None req-0b150ae1-06e2-438b-a681-1bc460e7cf53 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Getting quotas for user b870a3670f19464a8574e3fe9317e296 and project b6a9888d9bd1474688bf7f4b0feb85df. Resources: {'ram', 'instances', 'cores'} {{(pid=101356) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 16 15:36:37.822105 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-0b150ae1-06e2-438b-a681-1bc460e7cf53 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Going to run 1 instances... {{(pid=101356) _provision_instances /opt/stack/nova/nova/compute/api.py:1224}} Dec 16 15:36:37.824541 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-0b150ae1-06e2-438b-a681-1bc460e7cf53 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] [instance: 44b0fa18-ab49-4dde-bb17-091a3cb03e25] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9992d9b1-78e2-4d97-af3a-aa9786cf3389',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=101356) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1616}} Dec 16 15:36:37.923440 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: ERROR oslo.messaging._drivers.impl_rabbit [None req-0b150ae1-06e2-438b-a681-1bc460e7cf53 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] [eda640d0-8db3-4de4-a2a8-b6f5c86e297e] AMQP server on 10.222.0.45:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 16 15:36:38.941112 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO oslo.messaging._drivers.impl_rabbit [None req-0b150ae1-06e2-438b-a681-1bc460e7cf53 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] [eda640d0-8db3-4de4-a2a8-b6f5c86e297e] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 36036. Dec 16 15:36:38.945582 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-0b150ae1-06e2-438b-a681-1bc460e7cf53 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.097128 Dec 16 15:36:38.946330 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1114/2219] 10.222.0.45 () {60 vars in 1137 bytes} [Thu Dec 16 15:36:36 2021] POST /compute/v2.1/servers => generated 380 bytes in 2099 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 16 15:36:38.960697 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-950cd9a6-f3e8-4cd9-9160-0865eefb3b70 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:36:38.961533 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-950cd9a6-f3e8-4cd9-9160-0865eefb3b70 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] [instance: 44b0fa18-ab49-4dde-bb17-091a3cb03e25] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:36:39.130456 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-950cd9a6-f3e8-4cd9-9160-0865eefb3b70 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b870a3670f19464a8574e3fe9317e296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6a9888d9bd1474688bf7f4b0feb85df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:36:39.138741 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-950cd9a6-f3e8-4cd9-9160-0865eefb3b70 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] 10.222.0.45 "GET /compute/v2.1/servers/44b0fa18-ab49-4dde-bb17-091a3cb03e25" status: 200 len: 1257 microversion: 2.1 time: 0.185890 Dec 16 15:36:39.139423 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1106/2220] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:36:38 2021] GET /compute/v2.1/servers/44b0fa18-ab49-4dde-bb17-091a3cb03e25 => generated 1257 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:36:40.161610 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-c2e45294-8f7c-42b6-8e54-8ab927a6a31f tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:36:40.162963 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-c2e45294-8f7c-42b6-8e54-8ab927a6a31f tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] [instance: 44b0fa18-ab49-4dde-bb17-091a3cb03e25] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:36:40.172238 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c2e45294-8f7c-42b6-8e54-8ab927a6a31f tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:36:40.176654 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c2e45294-8f7c-42b6-8e54-8ab927a6a31f tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:36:40.176654 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c2e45294-8f7c-42b6-8e54-8ab927a6a31f tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:36:40.176654 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-c2e45294-8f7c-42b6-8e54-8ab927a6a31f tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:36:40.300001 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-c2e45294-8f7c-42b6-8e54-8ab927a6a31f tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b870a3670f19464a8574e3fe9317e296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6a9888d9bd1474688bf7f4b0feb85df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:36:40.309190 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-c2e45294-8f7c-42b6-8e54-8ab927a6a31f tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] 10.222.0.45 "GET /compute/v2.1/servers/44b0fa18-ab49-4dde-bb17-091a3cb03e25" status: 200 len: 1261 microversion: 2.1 time: 0.155697 Dec 16 15:36:40.309918 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1115/2221] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:36:40 2021] GET /compute/v2.1/servers/44b0fa18-ab49-4dde-bb17-091a3cb03e25 => generated 1261 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:36:41.331418 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-4064b5c3-9dce-4108-aa03-154bef0d98d3 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:36:41.332070 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-4064b5c3-9dce-4108-aa03-154bef0d98d3 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] [instance: 44b0fa18-ab49-4dde-bb17-091a3cb03e25] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:36:41.340074 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4064b5c3-9dce-4108-aa03-154bef0d98d3 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:36:41.340639 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4064b5c3-9dce-4108-aa03-154bef0d98d3 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:36:41.341494 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4064b5c3-9dce-4108-aa03-154bef0d98d3 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:36:41.342023 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4064b5c3-9dce-4108-aa03-154bef0d98d3 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:36:41.510932 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-4064b5c3-9dce-4108-aa03-154bef0d98d3 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b870a3670f19464a8574e3fe9317e296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6a9888d9bd1474688bf7f4b0feb85df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:36:41.520189 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-4064b5c3-9dce-4108-aa03-154bef0d98d3 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] 10.222.0.45 "GET /compute/v2.1/servers/44b0fa18-ab49-4dde-bb17-091a3cb03e25" status: 200 len: 1317 microversion: 2.1 time: 0.196326 Dec 16 15:36:41.520806 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1107/2222] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:36:41 2021] GET /compute/v2.1/servers/44b0fa18-ab49-4dde-bb17-091a3cb03e25 => generated 1317 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:36:42.553169 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-8f9bd5da-16e3-4e5a-b08c-52dcd109b71c tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:36:42.555157 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-8f9bd5da-16e3-4e5a-b08c-52dcd109b71c tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] [instance: 44b0fa18-ab49-4dde-bb17-091a3cb03e25] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:36:42.568472 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8f9bd5da-16e3-4e5a-b08c-52dcd109b71c tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:36:42.569595 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8f9bd5da-16e3-4e5a-b08c-52dcd109b71c tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:36:42.570610 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8f9bd5da-16e3-4e5a-b08c-52dcd109b71c tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:36:42.571207 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8f9bd5da-16e3-4e5a-b08c-52dcd109b71c tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:36:42.833757 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-8f9bd5da-16e3-4e5a-b08c-52dcd109b71c tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b870a3670f19464a8574e3fe9317e296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6a9888d9bd1474688bf7f4b0feb85df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:36:42.845150 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-8f9bd5da-16e3-4e5a-b08c-52dcd109b71c tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] 10.222.0.45 "GET /compute/v2.1/servers/44b0fa18-ab49-4dde-bb17-091a3cb03e25" status: 200 len: 1357 microversion: 2.1 time: 0.301733 Dec 16 15:36:42.845745 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1116/2223] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:36:42 2021] GET /compute/v2.1/servers/44b0fa18-ab49-4dde-bb17-091a3cb03e25 => generated 1357 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:36:43.867708 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-bb013b80-9804-4da3-af12-a29189d36626 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:36:43.868378 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-bb013b80-9804-4da3-af12-a29189d36626 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] [instance: 44b0fa18-ab49-4dde-bb17-091a3cb03e25] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:36:43.877924 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-bb013b80-9804-4da3-af12-a29189d36626 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:36:43.878463 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-bb013b80-9804-4da3-af12-a29189d36626 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:36:43.879319 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-bb013b80-9804-4da3-af12-a29189d36626 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:36:43.879814 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-bb013b80-9804-4da3-af12-a29189d36626 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:36:44.196598 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-bb013b80-9804-4da3-af12-a29189d36626 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b870a3670f19464a8574e3fe9317e296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6a9888d9bd1474688bf7f4b0feb85df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:36:44.207264 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-bb013b80-9804-4da3-af12-a29189d36626 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] 10.222.0.45 "GET /compute/v2.1/servers/44b0fa18-ab49-4dde-bb17-091a3cb03e25" status: 200 len: 1357 microversion: 2.1 time: 0.347460 Dec 16 15:36:44.208113 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1108/2224] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:36:43 2021] GET /compute/v2.1/servers/44b0fa18-ab49-4dde-bb17-091a3cb03e25 => generated 1357 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:36:45.229358 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-a49a5a27-9cc4-49ae-8349-ea734df6d86e tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:36:45.230461 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-a49a5a27-9cc4-49ae-8349-ea734df6d86e tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] [instance: 44b0fa18-ab49-4dde-bb17-091a3cb03e25] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:36:45.238570 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a49a5a27-9cc4-49ae-8349-ea734df6d86e tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:36:45.239389 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a49a5a27-9cc4-49ae-8349-ea734df6d86e tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:36:45.240393 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a49a5a27-9cc4-49ae-8349-ea734df6d86e tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:36:45.241111 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-a49a5a27-9cc4-49ae-8349-ea734df6d86e tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:36:45.500266 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-a49a5a27-9cc4-49ae-8349-ea734df6d86e tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b870a3670f19464a8574e3fe9317e296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6a9888d9bd1474688bf7f4b0feb85df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:36:45.510115 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-a49a5a27-9cc4-49ae-8349-ea734df6d86e tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] 10.222.0.45 "GET /compute/v2.1/servers/44b0fa18-ab49-4dde-bb17-091a3cb03e25" status: 200 len: 1357 microversion: 2.1 time: 0.288944 Dec 16 15:36:45.510732 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1117/2225] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:36:45 2021] GET /compute/v2.1/servers/44b0fa18-ab49-4dde-bb17-091a3cb03e25 => generated 1357 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:36:46.533965 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-f7e787e9-66a1-47ef-a231-c4695c8f3611 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:36:46.534689 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-f7e787e9-66a1-47ef-a231-c4695c8f3611 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] [instance: 44b0fa18-ab49-4dde-bb17-091a3cb03e25] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:36:46.543039 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f7e787e9-66a1-47ef-a231-c4695c8f3611 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:36:46.543550 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f7e787e9-66a1-47ef-a231-c4695c8f3611 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:36:46.544403 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f7e787e9-66a1-47ef-a231-c4695c8f3611 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:36:46.544898 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f7e787e9-66a1-47ef-a231-c4695c8f3611 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:36:46.790891 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-f7e787e9-66a1-47ef-a231-c4695c8f3611 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b870a3670f19464a8574e3fe9317e296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6a9888d9bd1474688bf7f4b0feb85df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:36:46.800792 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-f7e787e9-66a1-47ef-a231-c4695c8f3611 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] 10.222.0.45 "GET /compute/v2.1/servers/44b0fa18-ab49-4dde-bb17-091a3cb03e25" status: 200 len: 1357 microversion: 2.1 time: 0.275364 Dec 16 15:36:46.810661 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1109/2226] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:36:46 2021] GET /compute/v2.1/servers/44b0fa18-ab49-4dde-bb17-091a3cb03e25 => generated 1357 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:36:47.831726 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-0359e085-64f4-4885-8d4a-7cb84737e13b tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:36:47.832491 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-0359e085-64f4-4885-8d4a-7cb84737e13b tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] [instance: 44b0fa18-ab49-4dde-bb17-091a3cb03e25] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:36:47.841035 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0359e085-64f4-4885-8d4a-7cb84737e13b tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:36:47.841545 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0359e085-64f4-4885-8d4a-7cb84737e13b tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:36:47.842426 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0359e085-64f4-4885-8d4a-7cb84737e13b tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:36:47.842923 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0359e085-64f4-4885-8d4a-7cb84737e13b tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:36:48.077973 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-0359e085-64f4-4885-8d4a-7cb84737e13b tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b870a3670f19464a8574e3fe9317e296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6a9888d9bd1474688bf7f4b0feb85df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:36:48.087106 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-0359e085-64f4-4885-8d4a-7cb84737e13b tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] 10.222.0.45 "GET /compute/v2.1/servers/44b0fa18-ab49-4dde-bb17-091a3cb03e25" status: 200 len: 1357 microversion: 2.1 time: 0.263352 Dec 16 15:36:48.087958 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1118/2227] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:36:47 2021] GET /compute/v2.1/servers/44b0fa18-ab49-4dde-bb17-091a3cb03e25 => generated 1357 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:36:49.110025 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-345f9134-1a21-4971-beb2-d5ae9e1d2841 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:36:49.110980 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-345f9134-1a21-4971-beb2-d5ae9e1d2841 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] [instance: 44b0fa18-ab49-4dde-bb17-091a3cb03e25] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:36:49.119123 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-345f9134-1a21-4971-beb2-d5ae9e1d2841 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:36:49.119845 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-345f9134-1a21-4971-beb2-d5ae9e1d2841 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:36:49.134510 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-345f9134-1a21-4971-beb2-d5ae9e1d2841 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:36:49.135293 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-345f9134-1a21-4971-beb2-d5ae9e1d2841 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:36:49.419124 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-345f9134-1a21-4971-beb2-d5ae9e1d2841 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b870a3670f19464a8574e3fe9317e296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6a9888d9bd1474688bf7f4b0feb85df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:36:49.431221 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-345f9134-1a21-4971-beb2-d5ae9e1d2841 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] 10.222.0.45 "GET /compute/v2.1/servers/44b0fa18-ab49-4dde-bb17-091a3cb03e25" status: 200 len: 1357 microversion: 2.1 time: 0.328907 Dec 16 15:36:49.432150 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1110/2228] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:36:49 2021] GET /compute/v2.1/servers/44b0fa18-ab49-4dde-bb17-091a3cb03e25 => generated 1357 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:36:50.456519 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-166a91db-458d-49b2-b339-c5692091c404 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:36:50.457330 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-166a91db-458d-49b2-b339-c5692091c404 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] [instance: 44b0fa18-ab49-4dde-bb17-091a3cb03e25] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:36:50.463225 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 15:36:50.463421 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: Thu Dec 16 15:36:50 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/44b0fa18-ab49-4dde-bb17-091a3cb03e25 (ip 10.222.0.45) !!! Dec 16 15:36:50.483138 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-166a91db-458d-49b2-b339-c5692091c404 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:36:50.483630 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-166a91db-458d-49b2-b339-c5692091c404 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:36:50.484478 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-166a91db-458d-49b2-b339-c5692091c404 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:36:50.484961 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-166a91db-458d-49b2-b339-c5692091c404 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:36:50.719116 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-166a91db-458d-49b2-b339-c5692091c404 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b870a3670f19464a8574e3fe9317e296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6a9888d9bd1474688bf7f4b0feb85df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:36:50.729153 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-166a91db-458d-49b2-b339-c5692091c404 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] 10.222.0.45 "GET /compute/v2.1/servers/44b0fa18-ab49-4dde-bb17-091a3cb03e25" status: 200 len: 1357 microversion: 2.1 time: 0.280441 Dec 16 15:36:50.729767 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1119/2229] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:36:50 2021] GET /compute/v2.1/servers/44b0fa18-ab49-4dde-bb17-091a3cb03e25 => generated 1357 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:36:51.753800 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-051e70de-96ad-4693-a690-12b8d7bdf812 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:36:51.754634 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-051e70de-96ad-4693-a690-12b8d7bdf812 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] [instance: 44b0fa18-ab49-4dde-bb17-091a3cb03e25] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:36:51.763670 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-051e70de-96ad-4693-a690-12b8d7bdf812 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:36:51.764181 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-051e70de-96ad-4693-a690-12b8d7bdf812 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:36:51.765138 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-051e70de-96ad-4693-a690-12b8d7bdf812 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:36:51.765630 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-051e70de-96ad-4693-a690-12b8d7bdf812 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:36:52.000352 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-051e70de-96ad-4693-a690-12b8d7bdf812 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b870a3670f19464a8574e3fe9317e296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6a9888d9bd1474688bf7f4b0feb85df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:36:52.009333 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-051e70de-96ad-4693-a690-12b8d7bdf812 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] 10.222.0.45 "GET /compute/v2.1/servers/44b0fa18-ab49-4dde-bb17-091a3cb03e25" status: 200 len: 1357 microversion: 2.1 time: 0.264354 Dec 16 15:36:52.009885 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1111/2230] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:36:51 2021] GET /compute/v2.1/servers/44b0fa18-ab49-4dde-bb17-091a3cb03e25 => generated 1357 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:36:53.037958 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-2253a908-3f17-4a4e-932c-a65e72306d2f tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:36:53.038637 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-2253a908-3f17-4a4e-932c-a65e72306d2f tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] [instance: 44b0fa18-ab49-4dde-bb17-091a3cb03e25] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:36:53.046867 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2253a908-3f17-4a4e-932c-a65e72306d2f tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:36:53.047382 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2253a908-3f17-4a4e-932c-a65e72306d2f tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:36:53.048245 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2253a908-3f17-4a4e-932c-a65e72306d2f tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:36:53.048742 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2253a908-3f17-4a4e-932c-a65e72306d2f tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:36:53.277327 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-2253a908-3f17-4a4e-932c-a65e72306d2f tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b870a3670f19464a8574e3fe9317e296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6a9888d9bd1474688bf7f4b0feb85df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:36:53.288400 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-2253a908-3f17-4a4e-932c-a65e72306d2f tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] 10.222.0.45 "GET /compute/v2.1/servers/44b0fa18-ab49-4dde-bb17-091a3cb03e25" status: 200 len: 1357 microversion: 2.1 time: 0.264829 Dec 16 15:36:53.288920 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1120/2231] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:36:53 2021] GET /compute/v2.1/servers/44b0fa18-ab49-4dde-bb17-091a3cb03e25 => generated 1357 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:36:54.316986 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-22a95ff3-eef8-445f-bbf9-b449e9b324ca tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:36:54.317624 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-22a95ff3-eef8-445f-bbf9-b449e9b324ca tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] [instance: 44b0fa18-ab49-4dde-bb17-091a3cb03e25] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:36:54.325600 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-22a95ff3-eef8-445f-bbf9-b449e9b324ca tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:36:54.326139 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-22a95ff3-eef8-445f-bbf9-b449e9b324ca tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:36:54.326998 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-22a95ff3-eef8-445f-bbf9-b449e9b324ca tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:36:54.327490 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-22a95ff3-eef8-445f-bbf9-b449e9b324ca tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:36:54.546033 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-22a95ff3-eef8-445f-bbf9-b449e9b324ca tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b870a3670f19464a8574e3fe9317e296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6a9888d9bd1474688bf7f4b0feb85df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:36:54.553196 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-22a95ff3-eef8-445f-bbf9-b449e9b324ca tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] 10.222.0.45 "GET /compute/v2.1/servers/44b0fa18-ab49-4dde-bb17-091a3cb03e25" status: 200 len: 1357 microversion: 2.1 time: 0.244101 Dec 16 15:36:54.553785 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1112/2232] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:36:54 2021] GET /compute/v2.1/servers/44b0fa18-ab49-4dde-bb17-091a3cb03e25 => generated 1357 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:36:55.575157 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-aec7457c-ba06-418f-b96b-509df5df4a22 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:36:55.575747 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-aec7457c-ba06-418f-b96b-509df5df4a22 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] [instance: 44b0fa18-ab49-4dde-bb17-091a3cb03e25] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:36:55.588364 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-aec7457c-ba06-418f-b96b-509df5df4a22 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:36:55.588872 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-aec7457c-ba06-418f-b96b-509df5df4a22 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:36:55.589724 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-aec7457c-ba06-418f-b96b-509df5df4a22 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:36:55.590250 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-aec7457c-ba06-418f-b96b-509df5df4a22 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:36:55.820529 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-aec7457c-ba06-418f-b96b-509df5df4a22 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b870a3670f19464a8574e3fe9317e296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6a9888d9bd1474688bf7f4b0feb85df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:36:55.835870 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-aec7457c-ba06-418f-b96b-509df5df4a22 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] 10.222.0.45 "GET /compute/v2.1/servers/44b0fa18-ab49-4dde-bb17-091a3cb03e25" status: 200 len: 1357 microversion: 2.1 time: 0.268642 Dec 16 15:36:55.836469 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1121/2233] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:36:55 2021] GET /compute/v2.1/servers/44b0fa18-ab49-4dde-bb17-091a3cb03e25 => generated 1357 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:36:56.858642 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-d52c826a-f850-4695-a34b-eb4715f2a92f tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:36:56.859329 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-d52c826a-f850-4695-a34b-eb4715f2a92f tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] [instance: 44b0fa18-ab49-4dde-bb17-091a3cb03e25] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:36:56.868797 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d52c826a-f850-4695-a34b-eb4715f2a92f tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:36:56.868972 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d52c826a-f850-4695-a34b-eb4715f2a92f tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:36:56.869810 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d52c826a-f850-4695-a34b-eb4715f2a92f tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:36:56.870424 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d52c826a-f850-4695-a34b-eb4715f2a92f tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:36:57.225747 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-d52c826a-f850-4695-a34b-eb4715f2a92f tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b870a3670f19464a8574e3fe9317e296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6a9888d9bd1474688bf7f4b0feb85df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:36:57.235293 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-d52c826a-f850-4695-a34b-eb4715f2a92f tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] 10.222.0.45 "GET /compute/v2.1/servers/44b0fa18-ab49-4dde-bb17-091a3cb03e25" status: 200 len: 1357 microversion: 2.1 time: 0.385442 Dec 16 15:36:57.236104 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1113/2234] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:36:56 2021] GET /compute/v2.1/servers/44b0fa18-ab49-4dde-bb17-091a3cb03e25 => generated 1357 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:36:57.303932 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [req-972fd644-7635-43cc-8230-4e38d737f0f9 req-dc77d705-acd2-4624-b82f-b534edecb839 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44b0fa18-ab49-4dde-bb17-091a3cb03e25", "tag": "6925aa7d-82c7-4220-a544-9bf5ae16c3c5"}]} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:36:57.309208 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:36:57.309208 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: warnings.warn(msg) Dec 16 15:36:57.319455 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-972fd644-7635-43cc-8230-4e38d737f0f9 req-dc77d705-acd2-4624-b82f-b534edecb839 service nova] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:36:57.319969 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-972fd644-7635-43cc-8230-4e38d737f0f9 req-dc77d705-acd2-4624-b82f-b534edecb839 service nova] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:36:57.343158 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.compute.server_external_events [req-972fd644-7635-43cc-8230-4e38d737f0f9 req-dc77d705-acd2-4624-b82f-b534edecb839 service nova] Creating event network-changed:6925aa7d-82c7-4220-a544-9bf5ae16c3c5 for instance 44b0fa18-ab49-4dde-bb17-091a3cb03e25 on hv-cinder-82189 Dec 16 15:36:57.353058 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [req-972fd644-7635-43cc-8230-4e38d737f0f9 req-dc77d705-acd2-4624-b82f-b534edecb839 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.155241 Dec 16 15:36:57.353732 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1122/2235] 10.222.0.45 () {64 vars in 1308 bytes} [Thu Dec 16 15:36:57 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:36:58.257188 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-de8f518a-7935-472e-a344-73ce6d093676 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:36:58.257859 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-de8f518a-7935-472e-a344-73ce6d093676 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] [instance: 44b0fa18-ab49-4dde-bb17-091a3cb03e25] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:36:58.265695 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-de8f518a-7935-472e-a344-73ce6d093676 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:36:58.266239 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-de8f518a-7935-472e-a344-73ce6d093676 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:36:58.267076 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-de8f518a-7935-472e-a344-73ce6d093676 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:36:58.267565 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-de8f518a-7935-472e-a344-73ce6d093676 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:36:58.647152 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-de8f518a-7935-472e-a344-73ce6d093676 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b870a3670f19464a8574e3fe9317e296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6a9888d9bd1474688bf7f4b0feb85df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:36:58.656216 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-de8f518a-7935-472e-a344-73ce6d093676 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] 10.222.0.45 "GET /compute/v2.1/servers/44b0fa18-ab49-4dde-bb17-091a3cb03e25" status: 200 len: 1357 microversion: 2.1 time: 0.407142 Dec 16 15:36:58.656818 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1114/2236] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:36:58 2021] GET /compute/v2.1/servers/44b0fa18-ab49-4dde-bb17-091a3cb03e25 => generated 1357 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:36:59.679820 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-92cee95f-c866-4097-a670-a8c34dae3b58 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:36:59.680509 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-92cee95f-c866-4097-a670-a8c34dae3b58 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] [instance: 44b0fa18-ab49-4dde-bb17-091a3cb03e25] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:36:59.688967 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-92cee95f-c866-4097-a670-a8c34dae3b58 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:36:59.689481 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-92cee95f-c866-4097-a670-a8c34dae3b58 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:36:59.690362 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-92cee95f-c866-4097-a670-a8c34dae3b58 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:36:59.690858 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-92cee95f-c866-4097-a670-a8c34dae3b58 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:36:59.907753 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-92cee95f-c866-4097-a670-a8c34dae3b58 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b870a3670f19464a8574e3fe9317e296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6a9888d9bd1474688bf7f4b0feb85df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:36:59.917771 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-92cee95f-c866-4097-a670-a8c34dae3b58 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] 10.222.0.45 "GET /compute/v2.1/servers/44b0fa18-ab49-4dde-bb17-091a3cb03e25" status: 200 len: 1357 microversion: 2.1 time: 0.246895 Dec 16 15:36:59.918446 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1123/2237] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:36:59 2021] GET /compute/v2.1/servers/44b0fa18-ab49-4dde-bb17-091a3cb03e25 => generated 1357 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:37:00.942334 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-b8b3091f-629d-448b-9728-e3e66cd80005 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:37:00.942997 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-b8b3091f-629d-448b-9728-e3e66cd80005 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] [instance: 44b0fa18-ab49-4dde-bb17-091a3cb03e25] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:37:00.950812 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b8b3091f-629d-448b-9728-e3e66cd80005 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:37:00.951310 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b8b3091f-629d-448b-9728-e3e66cd80005 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:37:00.952285 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b8b3091f-629d-448b-9728-e3e66cd80005 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:37:00.952778 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b8b3091f-629d-448b-9728-e3e66cd80005 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:37:01.167845 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-b8b3091f-629d-448b-9728-e3e66cd80005 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b870a3670f19464a8574e3fe9317e296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6a9888d9bd1474688bf7f4b0feb85df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:37:01.176658 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-b8b3091f-629d-448b-9728-e3e66cd80005 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] 10.222.0.45 "GET /compute/v2.1/servers/44b0fa18-ab49-4dde-bb17-091a3cb03e25" status: 200 len: 1357 microversion: 2.1 time: 0.241987 Dec 16 15:37:01.177247 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1115/2238] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:37:00 2021] GET /compute/v2.1/servers/44b0fa18-ab49-4dde-bb17-091a3cb03e25 => generated 1357 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:37:02.199120 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-e6e9c74c-6f45-46de-9f60-e94a43a81d44 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:37:02.199798 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-e6e9c74c-6f45-46de-9f60-e94a43a81d44 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] [instance: 44b0fa18-ab49-4dde-bb17-091a3cb03e25] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:37:02.207637 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e6e9c74c-6f45-46de-9f60-e94a43a81d44 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:37:02.208150 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e6e9c74c-6f45-46de-9f60-e94a43a81d44 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:37:02.209041 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e6e9c74c-6f45-46de-9f60-e94a43a81d44 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:37:02.209881 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e6e9c74c-6f45-46de-9f60-e94a43a81d44 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:37:02.430602 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-e6e9c74c-6f45-46de-9f60-e94a43a81d44 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b870a3670f19464a8574e3fe9317e296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6a9888d9bd1474688bf7f4b0feb85df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:37:02.439316 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-e6e9c74c-6f45-46de-9f60-e94a43a81d44 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] 10.222.0.45 "GET /compute/v2.1/servers/44b0fa18-ab49-4dde-bb17-091a3cb03e25" status: 200 len: 1357 microversion: 2.1 time: 0.247931 Dec 16 15:37:02.439904 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1124/2239] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:37:02 2021] GET /compute/v2.1/servers/44b0fa18-ab49-4dde-bb17-091a3cb03e25 => generated 1357 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:37:03.461106 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-1acc88e8-0560-4722-abc4-22835ded2227 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:37:03.461770 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-1acc88e8-0560-4722-abc4-22835ded2227 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] [instance: 44b0fa18-ab49-4dde-bb17-091a3cb03e25] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:37:03.469600 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1acc88e8-0560-4722-abc4-22835ded2227 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:37:03.470137 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1acc88e8-0560-4722-abc4-22835ded2227 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:37:03.470986 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1acc88e8-0560-4722-abc4-22835ded2227 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:37:03.471486 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1acc88e8-0560-4722-abc4-22835ded2227 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:37:03.703530 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-1acc88e8-0560-4722-abc4-22835ded2227 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b870a3670f19464a8574e3fe9317e296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6a9888d9bd1474688bf7f4b0feb85df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:37:03.712298 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-1acc88e8-0560-4722-abc4-22835ded2227 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] 10.222.0.45 "GET /compute/v2.1/servers/44b0fa18-ab49-4dde-bb17-091a3cb03e25" status: 200 len: 1357 microversion: 2.1 time: 0.258841 Dec 16 15:37:03.712893 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1116/2240] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:37:03 2021] GET /compute/v2.1/servers/44b0fa18-ab49-4dde-bb17-091a3cb03e25 => generated 1357 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:37:04.252568 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [req-52c824f1-1ad1-4b00-915c-77743356c531 req-4adf49b9-b626-4620-941f-a228ed8d96c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44b0fa18-ab49-4dde-bb17-091a3cb03e25", "name": "network-vif-plugged", "status": "completed", "tag": "6925aa7d-82c7-4220-a544-9bf5ae16c3c5"}]} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:37:04.258120 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:37:04.258120 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: warnings.warn(msg) Dec 16 15:37:04.267384 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-52c824f1-1ad1-4b00-915c-77743356c531 req-4adf49b9-b626-4620-941f-a228ed8d96c5 service nova] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:37:04.267885 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-52c824f1-1ad1-4b00-915c-77743356c531 req-4adf49b9-b626-4620-941f-a228ed8d96c5 service nova] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:37:04.287530 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.compute.server_external_events [req-52c824f1-1ad1-4b00-915c-77743356c531 req-4adf49b9-b626-4620-941f-a228ed8d96c5 service nova] Creating event network-vif-plugged:6925aa7d-82c7-4220-a544-9bf5ae16c3c5 for instance 44b0fa18-ab49-4dde-bb17-091a3cb03e25 on hv-cinder-82189 Dec 16 15:37:04.292951 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [req-52c824f1-1ad1-4b00-915c-77743356c531 req-4adf49b9-b626-4620-941f-a228ed8d96c5 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135751 Dec 16 15:37:04.293629 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1125/2241] 10.222.0.45 () {64 vars in 1308 bytes} [Thu Dec 16 15:37:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:37:04.734584 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-ca2977fb-decf-4d38-8493-3559415ae04d tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:37:04.735262 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-ca2977fb-decf-4d38-8493-3559415ae04d tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] [instance: 44b0fa18-ab49-4dde-bb17-091a3cb03e25] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:37:04.743699 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ca2977fb-decf-4d38-8493-3559415ae04d tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:37:04.744211 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ca2977fb-decf-4d38-8493-3559415ae04d tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:37:04.745059 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ca2977fb-decf-4d38-8493-3559415ae04d tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:37:04.745559 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ca2977fb-decf-4d38-8493-3559415ae04d tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:37:04.968109 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-ca2977fb-decf-4d38-8493-3559415ae04d tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b870a3670f19464a8574e3fe9317e296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6a9888d9bd1474688bf7f4b0feb85df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:37:04.976938 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-ca2977fb-decf-4d38-8493-3559415ae04d tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] 10.222.0.45 "GET /compute/v2.1/servers/44b0fa18-ab49-4dde-bb17-091a3cb03e25" status: 200 len: 1357 microversion: 2.1 time: 0.250218 Dec 16 15:37:04.977528 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1117/2242] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:37:04 2021] GET /compute/v2.1/servers/44b0fa18-ab49-4dde-bb17-091a3cb03e25 => generated 1357 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:37:05.999283 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-d071cb77-fd4e-491e-8567-9bb3e773bc65 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:37:06.000040 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-d071cb77-fd4e-491e-8567-9bb3e773bc65 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] [instance: 44b0fa18-ab49-4dde-bb17-091a3cb03e25] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:37:06.008545 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d071cb77-fd4e-491e-8567-9bb3e773bc65 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:37:06.009045 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d071cb77-fd4e-491e-8567-9bb3e773bc65 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:37:06.009887 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d071cb77-fd4e-491e-8567-9bb3e773bc65 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:37:06.010398 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d071cb77-fd4e-491e-8567-9bb3e773bc65 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:37:06.240837 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-d071cb77-fd4e-491e-8567-9bb3e773bc65 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b870a3670f19464a8574e3fe9317e296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6a9888d9bd1474688bf7f4b0feb85df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:37:06.249745 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-d071cb77-fd4e-491e-8567-9bb3e773bc65 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] 10.222.0.45 "GET /compute/v2.1/servers/44b0fa18-ab49-4dde-bb17-091a3cb03e25" status: 200 len: 1357 microversion: 2.1 time: 0.259562 Dec 16 15:37:06.250316 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1126/2243] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:37:05 2021] GET /compute/v2.1/servers/44b0fa18-ab49-4dde-bb17-091a3cb03e25 => generated 1357 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:37:07.271282 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-83b859f4-c3e9-4af4-b3ed-c98b98d8215f tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:37:07.272462 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-83b859f4-c3e9-4af4-b3ed-c98b98d8215f tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] [instance: 44b0fa18-ab49-4dde-bb17-091a3cb03e25] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:37:07.280641 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-83b859f4-c3e9-4af4-b3ed-c98b98d8215f tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:37:07.281150 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-83b859f4-c3e9-4af4-b3ed-c98b98d8215f tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:37:07.282001 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-83b859f4-c3e9-4af4-b3ed-c98b98d8215f tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:37:07.282526 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-83b859f4-c3e9-4af4-b3ed-c98b98d8215f tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:37:07.549313 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-83b859f4-c3e9-4af4-b3ed-c98b98d8215f tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b870a3670f19464a8574e3fe9317e296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6a9888d9bd1474688bf7f4b0feb85df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:37:07.558651 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-83b859f4-c3e9-4af4-b3ed-c98b98d8215f tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] 10.222.0.45 "GET /compute/v2.1/servers/44b0fa18-ab49-4dde-bb17-091a3cb03e25" status: 200 len: 1547 microversion: 2.1 time: 0.295078 Dec 16 15:37:07.560598 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1118/2244] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:37:07 2021] GET /compute/v2.1/servers/44b0fa18-ab49-4dde-bb17-091a3cb03e25 => generated 1547 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:37:07.579851 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-8a34c7c9-88ac-46fa-9bb8-3af47fc8c670 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:37:07.580520 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-8a34c7c9-88ac-46fa-9bb8-3af47fc8c670 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] [instance: 44b0fa18-ab49-4dde-bb17-091a3cb03e25] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:37:07.588300 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8a34c7c9-88ac-46fa-9bb8-3af47fc8c670 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:37:07.588793 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8a34c7c9-88ac-46fa-9bb8-3af47fc8c670 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:37:07.589622 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8a34c7c9-88ac-46fa-9bb8-3af47fc8c670 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:37:07.590125 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8a34c7c9-88ac-46fa-9bb8-3af47fc8c670 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:37:07.805380 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-8a34c7c9-88ac-46fa-9bb8-3af47fc8c670 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b870a3670f19464a8574e3fe9317e296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6a9888d9bd1474688bf7f4b0feb85df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:37:07.814143 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-8a34c7c9-88ac-46fa-9bb8-3af47fc8c670 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] 10.222.0.45 "GET /compute/v2.1/servers/44b0fa18-ab49-4dde-bb17-091a3cb03e25" status: 200 len: 1547 microversion: 2.1 time: 0.241738 Dec 16 15:37:07.814741 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1127/2245] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:37:07 2021] GET /compute/v2.1/servers/44b0fa18-ab49-4dde-bb17-091a3cb03e25 => generated 1547 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:37:07.834949 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-67158575-d435-403e-8a2c-a6641afdc885 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:37:07.844297 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:37:07.844297 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: warnings.warn(msg) Dec 16 15:37:07.845386 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-67158575-d435-403e-8a2c-a6641afdc885 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b870a3670f19464a8574e3fe9317e296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6a9888d9bd1474688bf7f4b0feb85df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:37:07.847328 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-67158575-d435-403e-8a2c-a6641afdc885 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Searching by: {'deleted': False, 'project_id': 'b6a9888d9bd1474688bf7f4b0feb85df'} {{(pid=101355) get_all /opt/stack/nova/nova/compute/api.py:2789}} Dec 16 15:37:07.853175 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-67158575-d435-403e-8a2c-a6641afdc885 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:37:07.853681 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-67158575-d435-403e-8a2c-a6641afdc885 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:37:07.854579 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-67158575-d435-403e-8a2c-a6641afdc885 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:37:07.855070 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-67158575-d435-403e-8a2c-a6641afdc885 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:37:07.952537 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.multi_cell_list [None req-67158575-d435-403e-8a2c-a6641afdc885 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=101355) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:379}} Dec 16 15:37:08.050190 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-67158575-d435-403e-8a2c-a6641afdc885 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] 10.222.0.45 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.222556 Dec 16 15:37:08.050733 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1119/2246] 10.222.0.45 () {58 vars in 1115 bytes} [Thu Dec 16 15:37:07 2021] GET /compute/v2.1/servers => generated 342 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:37:08.065956 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-f11298a6-ee81-415c-add0-d1cf7eda66ad tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:37:08.066646 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-f11298a6-ee81-415c-add0-d1cf7eda66ad tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] [instance: 44b0fa18-ab49-4dde-bb17-091a3cb03e25] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:37:08.074425 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f11298a6-ee81-415c-add0-d1cf7eda66ad tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:37:08.074929 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f11298a6-ee81-415c-add0-d1cf7eda66ad tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:37:08.075753 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f11298a6-ee81-415c-add0-d1cf7eda66ad tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:37:08.076235 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-f11298a6-ee81-415c-add0-d1cf7eda66ad tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:37:08.285679 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-f11298a6-ee81-415c-add0-d1cf7eda66ad tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b870a3670f19464a8574e3fe9317e296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6a9888d9bd1474688bf7f4b0feb85df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:37:08.294984 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-f11298a6-ee81-415c-add0-d1cf7eda66ad tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] 10.222.0.45 "GET /compute/v2.1/servers/44b0fa18-ab49-4dde-bb17-091a3cb03e25" status: 200 len: 1547 microversion: 2.1 time: 0.236518 Dec 16 15:37:08.295800 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1128/2247] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:37:08 2021] GET /compute/v2.1/servers/44b0fa18-ab49-4dde-bb17-091a3cb03e25 => generated 1547 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:37:10.404748 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-0f71e274-3fd2-47f6-9ebe-efe478a24fc9 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e362bdec-376f-4eea-8803-b604a13f8bc5"}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:37:10.405937 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-0f71e274-3fd2-47f6-9ebe-efe478a24fc9 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] [instance: 44b0fa18-ab49-4dde-bb17-091a3cb03e25] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:37:10.414813 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0f71e274-3fd2-47f6-9ebe-efe478a24fc9 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:37:10.415327 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0f71e274-3fd2-47f6-9ebe-efe478a24fc9 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:37:10.416173 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0f71e274-3fd2-47f6-9ebe-efe478a24fc9 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:37:10.416664 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0f71e274-3fd2-47f6-9ebe-efe478a24fc9 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:37:11.159022 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-0f71e274-3fd2-47f6-9ebe-efe478a24fc9 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] 10.222.0.45 "POST /compute/v2.1/servers/44b0fa18-ab49-4dde-bb17-091a3cb03e25/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.762451 Dec 16 15:37:11.159722 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1120/2248] 10.222.0.45 () {60 vars in 1313 bytes} [Thu Dec 16 15:37:10 2021] POST /compute/v2.1/servers/44b0fa18-ab49-4dde-bb17-091a3cb03e25/os-volume_attachments => generated 194 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:37:19.243427 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-33411cd3-60b5-4641-92e4-34f6875a5f8a tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:37:19.244030 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-33411cd3-60b5-4641-92e4-34f6875a5f8a tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] [instance: 44b0fa18-ab49-4dde-bb17-091a3cb03e25] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:37:19.254579 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-33411cd3-60b5-4641-92e4-34f6875a5f8a tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:37:19.255371 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-33411cd3-60b5-4641-92e4-34f6875a5f8a tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:37:19.256748 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-33411cd3-60b5-4641-92e4-34f6875a5f8a tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:37:19.257531 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-33411cd3-60b5-4641-92e4-34f6875a5f8a tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:37:19.478265 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-33411cd3-60b5-4641-92e4-34f6875a5f8a tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b870a3670f19464a8574e3fe9317e296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6a9888d9bd1474688bf7f4b0feb85df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:37:19.487653 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-33411cd3-60b5-4641-92e4-34f6875a5f8a tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] 10.222.0.45 "GET /compute/v2.1/servers/44b0fa18-ab49-4dde-bb17-091a3cb03e25" status: 200 len: 1593 microversion: 2.1 time: 0.252467 Dec 16 15:37:19.488246 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1129/2249] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:37:19 2021] GET /compute/v2.1/servers/44b0fa18-ab49-4dde-bb17-091a3cb03e25 => generated 1593 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:37:22.635715 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [req-311a014d-4d38-4ef4-8067-b6b7f3bf8e56 req-4c0cb728-20d0-4e85-8e35-010c21b32c09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44b0fa18-ab49-4dde-bb17-091a3cb03e25", "tag": "6925aa7d-82c7-4220-a544-9bf5ae16c3c5"}]} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:37:22.640962 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:37:22.640962 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: warnings.warn(msg) Dec 16 15:37:22.652904 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-311a014d-4d38-4ef4-8067-b6b7f3bf8e56 req-4c0cb728-20d0-4e85-8e35-010c21b32c09 service nova] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:37:22.653500 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-311a014d-4d38-4ef4-8067-b6b7f3bf8e56 req-4c0cb728-20d0-4e85-8e35-010c21b32c09 service nova] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:37:22.673775 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.compute.server_external_events [req-311a014d-4d38-4ef4-8067-b6b7f3bf8e56 req-4c0cb728-20d0-4e85-8e35-010c21b32c09 service nova] Creating event network-changed:6925aa7d-82c7-4220-a544-9bf5ae16c3c5 for instance 44b0fa18-ab49-4dde-bb17-091a3cb03e25 on hv-cinder-82189 Dec 16 15:37:22.679774 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [req-311a014d-4d38-4ef4-8067-b6b7f3bf8e56 req-4c0cb728-20d0-4e85-8e35-010c21b32c09 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052621 Dec 16 15:37:22.680568 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1121/2250] 10.222.0.45 () {64 vars in 1308 bytes} [Thu Dec 16 15:37:22 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:37:24.979547 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-ac53c6b3-f250-4b9f-93a1-bdf9e8b630b1 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-294014708"}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:37:24.980260 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-ac53c6b3-f250-4b9f-93a1-bdf9e8b630b1 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] [instance: 44b0fa18-ab49-4dde-bb17-091a3cb03e25] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:37:24.988888 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ac53c6b3-f250-4b9f-93a1-bdf9e8b630b1 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:37:24.989392 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ac53c6b3-f250-4b9f-93a1-bdf9e8b630b1 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:37:24.990370 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ac53c6b3-f250-4b9f-93a1-bdf9e8b630b1 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:37:24.990882 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ac53c6b3-f250-4b9f-93a1-bdf9e8b630b1 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:37:25.262556 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.network.security_group_api [None req-ac53c6b3-f250-4b9f-93a1-bdf9e8b630b1 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Adding security group fec80772-e67d-4195-a897-6cfea3e9cc9f to port 6925aa7d-82c7-4220-a544-9bf5ae16c3c5 Dec 16 15:37:25.921120 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-ac53c6b3-f250-4b9f-93a1-bdf9e8b630b1 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] 10.222.0.45 "POST /compute/v2.1/servers/44b0fa18-ab49-4dde-bb17-091a3cb03e25/action" status: 202 len: 0 microversion: 2.1 time: 0.950243 Dec 16 15:37:25.922306 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1130/2251] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 15:37:24 2021] POST /compute/v2.1/servers/44b0fa18-ab49-4dde-bb17-091a3cb03e25/action => generated 0 bytes in 952 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:37:25.937418 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-d997987d-ac29-4334-8e6e-4468d655ad31 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:37:25.938619 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-d997987d-ac29-4334-8e6e-4468d655ad31 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] [instance: 44b0fa18-ab49-4dde-bb17-091a3cb03e25] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:37:25.948595 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [req-e9384bfa-7957-4321-8d5c-ee4b293cdbfe req-52b75406-72e1-4a51-a499-a7f7354d7d3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44b0fa18-ab49-4dde-bb17-091a3cb03e25", "tag": "6925aa7d-82c7-4220-a544-9bf5ae16c3c5"}]} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:37:25.953261 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:37:25.953261 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: warnings.warn(msg) Dec 16 15:37:25.955480 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d997987d-ac29-4334-8e6e-4468d655ad31 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:37:25.956995 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d997987d-ac29-4334-8e6e-4468d655ad31 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:37:25.960116 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d997987d-ac29-4334-8e6e-4468d655ad31 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:37:25.960817 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d997987d-ac29-4334-8e6e-4468d655ad31 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:37:25.964074 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-e9384bfa-7957-4321-8d5c-ee4b293cdbfe req-52b75406-72e1-4a51-a499-a7f7354d7d3f service nova] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:37:25.964585 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-e9384bfa-7957-4321-8d5c-ee4b293cdbfe req-52b75406-72e1-4a51-a499-a7f7354d7d3f service nova] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:37:25.984970 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.compute.server_external_events [req-e9384bfa-7957-4321-8d5c-ee4b293cdbfe req-52b75406-72e1-4a51-a499-a7f7354d7d3f service nova] Creating event network-changed:6925aa7d-82c7-4220-a544-9bf5ae16c3c5 for instance 44b0fa18-ab49-4dde-bb17-091a3cb03e25 on hv-cinder-82189 Dec 16 15:37:25.991252 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [req-e9384bfa-7957-4321-8d5c-ee4b293cdbfe req-52b75406-72e1-4a51-a499-a7f7354d7d3f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052725 Dec 16 15:37:25.994844 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1131/2252] 10.222.0.45 () {64 vars in 1308 bytes} [Thu Dec 16 15:37:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:37:26.291830 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-d997987d-ac29-4334-8e6e-4468d655ad31 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b870a3670f19464a8574e3fe9317e296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6a9888d9bd1474688bf7f4b0feb85df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:37:26.302209 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-d997987d-ac29-4334-8e6e-4468d655ad31 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] 10.222.0.45 "GET /compute/v2.1/servers/44b0fa18-ab49-4dde-bb17-091a3cb03e25" status: 200 len: 1757 microversion: 2.1 time: 0.374436 Dec 16 15:37:26.303360 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1122/2253] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:37:25 2021] GET /compute/v2.1/servers/44b0fa18-ab49-4dde-bb17-091a3cb03e25 => generated 1757 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:38:09.128936 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-d9db93f2-4c9c-40a9-a4c6-6b806bc4745b tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1412326854", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1519735302", "security_groups": [{"name": "tempest-secgroup-smoke-1827351747"}], "block_device_mapping_v2": [{"uuid": "412f0c61-a56e-4989-8b92-41f870f796c5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "888cf1c9-54d5-43ec-9d53-9903be1aba42"}]}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:38:09.306516 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.network.neutron [None req-d9db93f2-4c9c-40a9-a4c6-6b806bc4745b tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] validate_networks() for [('888cf1c9-54d5-43ec-9d53-9903be1aba42', None, None, None)] {{(pid=101356) validate_networks /opt/stack/nova/nova/network/neutron.py:2383}} Dec 16 15:38:10.059929 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.virt.hardware [None req-d9db93f2-4c9c-40a9-a4c6-6b806bc4745b tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Flavor limits 0:0:0 {{(pid=101356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:338}} Dec 16 15:38:10.060407 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.virt.hardware [None req-d9db93f2-4c9c-40a9-a4c6-6b806bc4745b tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Image limits 0:0:0 {{(pid=101356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:342}} Dec 16 15:38:10.060956 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.virt.hardware [None req-d9db93f2-4c9c-40a9-a4c6-6b806bc4745b tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Flavor pref 0:0:0 {{(pid=101356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:378}} Dec 16 15:38:10.061446 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.virt.hardware [None req-d9db93f2-4c9c-40a9-a4c6-6b806bc4745b tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Image pref 0:0:0 {{(pid=101356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:382}} Dec 16 15:38:10.061941 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.virt.hardware [None req-d9db93f2-4c9c-40a9-a4c6-6b806bc4745b tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=101356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:422}} Dec 16 15:38:10.071009 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d9db93f2-4c9c-40a9-a4c6-6b806bc4745b tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:38:10.071521 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d9db93f2-4c9c-40a9-a4c6-6b806bc4745b tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:38:10.072403 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d9db93f2-4c9c-40a9-a4c6-6b806bc4745b tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:38:10.072904 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-d9db93f2-4c9c-40a9-a4c6-6b806bc4745b tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:38:10.092316 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.quota [None req-d9db93f2-4c9c-40a9-a4c6-6b806bc4745b tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Getting quotas for project 211699de14224a63a48d253eaa061c69. Resources: {'ram', 'instances', 'cores'} {{(pid=101356) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 16 15:38:10.096550 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.quota [None req-d9db93f2-4c9c-40a9-a4c6-6b806bc4745b tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Getting quotas for user 7508cb16ab6343dfb7de72c6b3600ae8 and project 211699de14224a63a48d253eaa061c69. Resources: {'ram', 'instances', 'cores'} {{(pid=101356) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 16 15:38:10.200893 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-d9db93f2-4c9c-40a9-a4c6-6b806bc4745b tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Going to run 1 instances... {{(pid=101356) _provision_instances /opt/stack/nova/nova/compute/api.py:1224}} Dec 16 15:38:10.203608 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-d9db93f2-4c9c-40a9-a4c6-6b806bc4745b tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] [instance: 55e131bc-148b-487f-8429-c2f47286ab8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='412f0c61-a56e-4989-8b92-41f870f796c5',volume_size=None,volume_type=None)] {{(pid=101356) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1616}} Dec 16 15:38:10.527685 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-d9db93f2-4c9c-40a9-a4c6-6b806bc4745b tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.406973 Dec 16 15:38:10.528395 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1132/2254] 10.222.0.45 () {60 vars in 1137 bytes} [Thu Dec 16 15:38:09 2021] POST /compute/v2.1/servers => generated 406 bytes in 1409 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 16 15:38:10.543671 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-45bfb947-f2ce-4f5f-8b4a-81cda81a3738 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:38:10.544542 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-45bfb947-f2ce-4f5f-8b4a-81cda81a3738 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] [instance: 55e131bc-148b-487f-8429-c2f47286ab8c] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:38:10.628487 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-45bfb947-f2ce-4f5f-8b4a-81cda81a3738 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508cb16ab6343dfb7de72c6b3600ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211699de14224a63a48d253eaa061c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:38:10.636379 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-45bfb947-f2ce-4f5f-8b4a-81cda81a3738 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] 10.222.0.45 "GET /compute/v2.1/servers/55e131bc-148b-487f-8429-c2f47286ab8c" status: 200 len: 1095 microversion: 2.1 time: 0.101023 Dec 16 15:38:10.636973 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1123/2255] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:38:10 2021] GET /compute/v2.1/servers/55e131bc-148b-487f-8429-c2f47286ab8c => generated 1095 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:38:11.658498 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-3d1d79fc-553d-4ac8-8f4c-118d60fe7f9a tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:38:11.659474 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-3d1d79fc-553d-4ac8-8f4c-118d60fe7f9a tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] [instance: 55e131bc-148b-487f-8429-c2f47286ab8c] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:38:11.749259 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-3d1d79fc-553d-4ac8-8f4c-118d60fe7f9a tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508cb16ab6343dfb7de72c6b3600ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211699de14224a63a48d253eaa061c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:38:11.757349 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-3d1d79fc-553d-4ac8-8f4c-118d60fe7f9a tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] 10.222.0.45 "GET /compute/v2.1/servers/55e131bc-148b-487f-8429-c2f47286ab8c" status: 200 len: 1095 microversion: 2.1 time: 0.107219 Dec 16 15:38:11.757948 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1133/2256] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:38:11 2021] GET /compute/v2.1/servers/55e131bc-148b-487f-8429-c2f47286ab8c => generated 1095 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:38:12.780329 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-da11e694-4bf3-4b3f-8059-2e803fe80dd0 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:38:12.781002 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-da11e694-4bf3-4b3f-8059-2e803fe80dd0 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] [instance: 55e131bc-148b-487f-8429-c2f47286ab8c] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:38:12.864177 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-da11e694-4bf3-4b3f-8059-2e803fe80dd0 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508cb16ab6343dfb7de72c6b3600ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211699de14224a63a48d253eaa061c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:38:12.872291 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-da11e694-4bf3-4b3f-8059-2e803fe80dd0 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] 10.222.0.45 "GET /compute/v2.1/servers/55e131bc-148b-487f-8429-c2f47286ab8c" status: 200 len: 1095 microversion: 2.1 time: 0.100225 Dec 16 15:38:12.872892 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1124/2257] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:38:12 2021] GET /compute/v2.1/servers/55e131bc-148b-487f-8429-c2f47286ab8c => generated 1095 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:38:13.893124 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-ecdc4aae-1fc6-4f5d-8e25-9444164a5272 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:38:13.893838 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-ecdc4aae-1fc6-4f5d-8e25-9444164a5272 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] [instance: 55e131bc-148b-487f-8429-c2f47286ab8c] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:38:13.976089 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-ecdc4aae-1fc6-4f5d-8e25-9444164a5272 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508cb16ab6343dfb7de72c6b3600ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211699de14224a63a48d253eaa061c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:38:13.985129 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-ecdc4aae-1fc6-4f5d-8e25-9444164a5272 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] 10.222.0.45 "GET /compute/v2.1/servers/55e131bc-148b-487f-8429-c2f47286ab8c" status: 200 len: 1095 microversion: 2.1 time: 0.100104 Dec 16 15:38:13.985801 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1134/2258] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:38:13 2021] GET /compute/v2.1/servers/55e131bc-148b-487f-8429-c2f47286ab8c => generated 1095 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:38:15.006616 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-af1127e3-23cd-4102-9114-b2411dff1286 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:38:15.007292 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-af1127e3-23cd-4102-9114-b2411dff1286 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] [instance: 55e131bc-148b-487f-8429-c2f47286ab8c] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:38:15.016518 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-af1127e3-23cd-4102-9114-b2411dff1286 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:38:15.017026 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-af1127e3-23cd-4102-9114-b2411dff1286 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:38:15.017877 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-af1127e3-23cd-4102-9114-b2411dff1286 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:38:15.018406 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-af1127e3-23cd-4102-9114-b2411dff1286 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:38:15.150145 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-af1127e3-23cd-4102-9114-b2411dff1286 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508cb16ab6343dfb7de72c6b3600ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211699de14224a63a48d253eaa061c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:38:15.159263 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-af1127e3-23cd-4102-9114-b2411dff1286 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] 10.222.0.45 "GET /compute/v2.1/servers/55e131bc-148b-487f-8429-c2f47286ab8c" status: 200 len: 1145 microversion: 2.1 time: 0.160021 Dec 16 15:38:15.159870 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1125/2259] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:38:14 2021] GET /compute/v2.1/servers/55e131bc-148b-487f-8429-c2f47286ab8c => generated 1145 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:38:16.181769 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-67d0231d-1a1c-49bb-a463-b1308eeb3ea4 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:38:16.182539 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-67d0231d-1a1c-49bb-a463-b1308eeb3ea4 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] [instance: 55e131bc-148b-487f-8429-c2f47286ab8c] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:38:16.192278 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-67d0231d-1a1c-49bb-a463-b1308eeb3ea4 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:38:16.192789 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-67d0231d-1a1c-49bb-a463-b1308eeb3ea4 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:38:16.193793 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-67d0231d-1a1c-49bb-a463-b1308eeb3ea4 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:38:16.195242 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-67d0231d-1a1c-49bb-a463-b1308eeb3ea4 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:38:16.326969 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-67d0231d-1a1c-49bb-a463-b1308eeb3ea4 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508cb16ab6343dfb7de72c6b3600ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211699de14224a63a48d253eaa061c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:38:16.335953 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-67d0231d-1a1c-49bb-a463-b1308eeb3ea4 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] 10.222.0.45 "GET /compute/v2.1/servers/55e131bc-148b-487f-8429-c2f47286ab8c" status: 200 len: 1201 microversion: 2.1 time: 0.162668 Dec 16 15:38:16.336564 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1135/2260] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:38:16 2021] GET /compute/v2.1/servers/55e131bc-148b-487f-8429-c2f47286ab8c => generated 1201 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:38:17.357779 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-0bb7f300-153b-431f-b477-666ef2e4eb13 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:38:17.358642 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-0bb7f300-153b-431f-b477-666ef2e4eb13 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] [instance: 55e131bc-148b-487f-8429-c2f47286ab8c] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:38:17.366978 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0bb7f300-153b-431f-b477-666ef2e4eb13 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:38:17.367494 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0bb7f300-153b-431f-b477-666ef2e4eb13 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:38:17.368514 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0bb7f300-153b-431f-b477-666ef2e4eb13 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:38:17.369013 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0bb7f300-153b-431f-b477-666ef2e4eb13 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:38:17.882140 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-0bb7f300-153b-431f-b477-666ef2e4eb13 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508cb16ab6343dfb7de72c6b3600ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211699de14224a63a48d253eaa061c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:38:17.891128 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-0bb7f300-153b-431f-b477-666ef2e4eb13 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] 10.222.0.45 "GET /compute/v2.1/servers/55e131bc-148b-487f-8429-c2f47286ab8c" status: 200 len: 1279 microversion: 2.1 time: 0.541336 Dec 16 15:38:17.892659 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1126/2261] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:38:17 2021] GET /compute/v2.1/servers/55e131bc-148b-487f-8429-c2f47286ab8c => generated 1279 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:38:18.435419 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [req-7136d214-a09a-4a4e-85eb-829251906201 req-237da705-49bc-44ee-a7e5-ad6e31d0ec4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55e131bc-148b-487f-8429-c2f47286ab8c", "tag": "6a38862a-109c-43da-917c-390dc4a17d8c"}]} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:38:18.440558 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:38:18.440558 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: warnings.warn(msg) Dec 16 15:38:18.453897 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-7136d214-a09a-4a4e-85eb-829251906201 req-237da705-49bc-44ee-a7e5-ad6e31d0ec4e service nova] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:38:18.453897 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-7136d214-a09a-4a4e-85eb-829251906201 req-237da705-49bc-44ee-a7e5-ad6e31d0ec4e service nova] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:38:18.477921 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.compute.server_external_events [req-7136d214-a09a-4a4e-85eb-829251906201 req-237da705-49bc-44ee-a7e5-ad6e31d0ec4e service nova] Creating event network-changed:6a38862a-109c-43da-917c-390dc4a17d8c for instance 55e131bc-148b-487f-8429-c2f47286ab8c on hv-cinder-82189 Dec 16 15:38:18.482893 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [req-7136d214-a09a-4a4e-85eb-829251906201 req-237da705-49bc-44ee-a7e5-ad6e31d0ec4e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055407 Dec 16 15:38:18.483531 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1136/2262] 10.222.0.45 () {64 vars in 1308 bytes} [Thu Dec 16 15:38:18 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:38:18.913239 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-6e957dc2-4922-4b83-aa5b-666f453c32aa tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:38:18.913988 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-6e957dc2-4922-4b83-aa5b-666f453c32aa tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] [instance: 55e131bc-148b-487f-8429-c2f47286ab8c] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:38:18.922683 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6e957dc2-4922-4b83-aa5b-666f453c32aa tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:38:18.923184 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6e957dc2-4922-4b83-aa5b-666f453c32aa tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:38:18.928190 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6e957dc2-4922-4b83-aa5b-666f453c32aa tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:38:18.928697 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6e957dc2-4922-4b83-aa5b-666f453c32aa tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:38:19.262792 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-6e957dc2-4922-4b83-aa5b-666f453c32aa tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508cb16ab6343dfb7de72c6b3600ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211699de14224a63a48d253eaa061c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:38:19.271605 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-6e957dc2-4922-4b83-aa5b-666f453c32aa tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] 10.222.0.45 "GET /compute/v2.1/servers/55e131bc-148b-487f-8429-c2f47286ab8c" status: 200 len: 1267 microversion: 2.1 time: 0.366489 Dec 16 15:38:19.272212 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1127/2263] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:38:18 2021] GET /compute/v2.1/servers/55e131bc-148b-487f-8429-c2f47286ab8c => generated 1267 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:38:20.294421 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-e38c2b17-9da3-4ab4-b457-6d0ca51ef894 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:38:20.295105 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-e38c2b17-9da3-4ab4-b457-6d0ca51ef894 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] [instance: 55e131bc-148b-487f-8429-c2f47286ab8c] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:38:20.303296 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e38c2b17-9da3-4ab4-b457-6d0ca51ef894 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:38:20.303802 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e38c2b17-9da3-4ab4-b457-6d0ca51ef894 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:38:20.304629 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e38c2b17-9da3-4ab4-b457-6d0ca51ef894 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:38:20.305115 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e38c2b17-9da3-4ab4-b457-6d0ca51ef894 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:38:20.734412 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-e38c2b17-9da3-4ab4-b457-6d0ca51ef894 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508cb16ab6343dfb7de72c6b3600ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211699de14224a63a48d253eaa061c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:38:20.743330 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-e38c2b17-9da3-4ab4-b457-6d0ca51ef894 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] 10.222.0.45 "GET /compute/v2.1/servers/55e131bc-148b-487f-8429-c2f47286ab8c" status: 200 len: 1267 microversion: 2.1 time: 0.457242 Dec 16 15:38:20.743930 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1137/2264] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:38:20 2021] GET /compute/v2.1/servers/55e131bc-148b-487f-8429-c2f47286ab8c => generated 1267 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:38:21.764764 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-cb49fad8-343e-45f7-b068-4498ba5eda5c tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:38:21.765436 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-cb49fad8-343e-45f7-b068-4498ba5eda5c tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] [instance: 55e131bc-148b-487f-8429-c2f47286ab8c] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:38:21.773279 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cb49fad8-343e-45f7-b068-4498ba5eda5c tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:38:21.773787 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cb49fad8-343e-45f7-b068-4498ba5eda5c tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:38:21.774646 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cb49fad8-343e-45f7-b068-4498ba5eda5c tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:38:21.775139 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cb49fad8-343e-45f7-b068-4498ba5eda5c tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:38:21.991565 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-cb49fad8-343e-45f7-b068-4498ba5eda5c tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508cb16ab6343dfb7de72c6b3600ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211699de14224a63a48d253eaa061c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:38:22.000347 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-cb49fad8-343e-45f7-b068-4498ba5eda5c tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] 10.222.0.45 "GET /compute/v2.1/servers/55e131bc-148b-487f-8429-c2f47286ab8c" status: 200 len: 1267 microversion: 2.1 time: 0.243265 Dec 16 15:38:22.000942 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1128/2265] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:38:21 2021] GET /compute/v2.1/servers/55e131bc-148b-487f-8429-c2f47286ab8c => generated 1267 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:38:23.022510 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-65f57a13-5226-4617-b15f-579afd48e1d4 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:38:23.023185 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-65f57a13-5226-4617-b15f-579afd48e1d4 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] [instance: 55e131bc-148b-487f-8429-c2f47286ab8c] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:38:23.031825 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-65f57a13-5226-4617-b15f-579afd48e1d4 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:38:23.032339 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-65f57a13-5226-4617-b15f-579afd48e1d4 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:38:23.033187 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-65f57a13-5226-4617-b15f-579afd48e1d4 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:38:23.033935 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-65f57a13-5226-4617-b15f-579afd48e1d4 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:38:23.243812 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-65f57a13-5226-4617-b15f-579afd48e1d4 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508cb16ab6343dfb7de72c6b3600ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211699de14224a63a48d253eaa061c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:38:23.253010 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-65f57a13-5226-4617-b15f-579afd48e1d4 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] 10.222.0.45 "GET /compute/v2.1/servers/55e131bc-148b-487f-8429-c2f47286ab8c" status: 200 len: 1267 microversion: 2.1 time: 0.238350 Dec 16 15:38:23.253596 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1138/2266] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:38:23 2021] GET /compute/v2.1/servers/55e131bc-148b-487f-8429-c2f47286ab8c => generated 1267 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:38:24.275500 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-dd10d649-616c-4a26-831c-c297588d10c3 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:38:24.276174 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-dd10d649-616c-4a26-831c-c297588d10c3 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] [instance: 55e131bc-148b-487f-8429-c2f47286ab8c] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:38:24.284754 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-dd10d649-616c-4a26-831c-c297588d10c3 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:38:24.285264 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-dd10d649-616c-4a26-831c-c297588d10c3 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:38:24.286123 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-dd10d649-616c-4a26-831c-c297588d10c3 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:38:24.286622 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-dd10d649-616c-4a26-831c-c297588d10c3 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:38:24.502418 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-dd10d649-616c-4a26-831c-c297588d10c3 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508cb16ab6343dfb7de72c6b3600ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211699de14224a63a48d253eaa061c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:38:24.511509 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-dd10d649-616c-4a26-831c-c297588d10c3 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] 10.222.0.45 "GET /compute/v2.1/servers/55e131bc-148b-487f-8429-c2f47286ab8c" status: 200 len: 1267 microversion: 2.1 time: 0.243631 Dec 16 15:38:24.512115 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1129/2267] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:38:24 2021] GET /compute/v2.1/servers/55e131bc-148b-487f-8429-c2f47286ab8c => generated 1267 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:38:25.535207 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-4e6a5b5d-25b4-4bb5-80ad-86d4b2728a85 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:38:25.535786 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-4e6a5b5d-25b4-4bb5-80ad-86d4b2728a85 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] [instance: 55e131bc-148b-487f-8429-c2f47286ab8c] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:38:25.544432 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4e6a5b5d-25b4-4bb5-80ad-86d4b2728a85 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:38:25.544939 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4e6a5b5d-25b4-4bb5-80ad-86d4b2728a85 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:38:25.545789 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4e6a5b5d-25b4-4bb5-80ad-86d4b2728a85 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:38:25.546315 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4e6a5b5d-25b4-4bb5-80ad-86d4b2728a85 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:38:26.007697 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-4e6a5b5d-25b4-4bb5-80ad-86d4b2728a85 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508cb16ab6343dfb7de72c6b3600ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211699de14224a63a48d253eaa061c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:38:26.017468 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-4e6a5b5d-25b4-4bb5-80ad-86d4b2728a85 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] 10.222.0.45 "GET /compute/v2.1/servers/55e131bc-148b-487f-8429-c2f47286ab8c" status: 200 len: 1267 microversion: 2.1 time: 0.491279 Dec 16 15:38:26.018185 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1139/2268] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:38:25 2021] GET /compute/v2.1/servers/55e131bc-148b-487f-8429-c2f47286ab8c => generated 1267 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:38:27.040013 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-4c673183-08b8-461b-872e-3472c213a990 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:38:27.040791 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-4c673183-08b8-461b-872e-3472c213a990 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] [instance: 55e131bc-148b-487f-8429-c2f47286ab8c] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:38:27.049386 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4c673183-08b8-461b-872e-3472c213a990 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:38:27.049884 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4c673183-08b8-461b-872e-3472c213a990 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:38:27.050815 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4c673183-08b8-461b-872e-3472c213a990 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:38:27.051308 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4c673183-08b8-461b-872e-3472c213a990 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:38:27.476562 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-4c673183-08b8-461b-872e-3472c213a990 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508cb16ab6343dfb7de72c6b3600ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211699de14224a63a48d253eaa061c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:38:27.487486 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-4c673183-08b8-461b-872e-3472c213a990 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] 10.222.0.45 "GET /compute/v2.1/servers/55e131bc-148b-487f-8429-c2f47286ab8c" status: 200 len: 1267 microversion: 2.1 time: 0.455158 Dec 16 15:38:27.488392 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1130/2269] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:38:27 2021] GET /compute/v2.1/servers/55e131bc-148b-487f-8429-c2f47286ab8c => generated 1267 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:38:28.513530 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-0a230291-cb6c-49f6-a25e-c141b86dbfe9 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:38:28.514239 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-0a230291-cb6c-49f6-a25e-c141b86dbfe9 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] [instance: 55e131bc-148b-487f-8429-c2f47286ab8c] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:38:28.522159 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0a230291-cb6c-49f6-a25e-c141b86dbfe9 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:38:28.522670 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0a230291-cb6c-49f6-a25e-c141b86dbfe9 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:38:28.523520 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0a230291-cb6c-49f6-a25e-c141b86dbfe9 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:38:28.524015 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0a230291-cb6c-49f6-a25e-c141b86dbfe9 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:38:28.753648 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-0a230291-cb6c-49f6-a25e-c141b86dbfe9 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508cb16ab6343dfb7de72c6b3600ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211699de14224a63a48d253eaa061c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:38:28.762534 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-0a230291-cb6c-49f6-a25e-c141b86dbfe9 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] 10.222.0.45 "GET /compute/v2.1/servers/55e131bc-148b-487f-8429-c2f47286ab8c" status: 200 len: 1267 microversion: 2.1 time: 0.257447 Dec 16 15:38:28.763140 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1140/2270] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:38:28 2021] GET /compute/v2.1/servers/55e131bc-148b-487f-8429-c2f47286ab8c => generated 1267 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:38:29.784421 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-b91e730f-997d-40bb-93ba-5ff546df7591 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:38:29.785016 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-b91e730f-997d-40bb-93ba-5ff546df7591 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] [instance: 55e131bc-148b-487f-8429-c2f47286ab8c] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:38:29.793470 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b91e730f-997d-40bb-93ba-5ff546df7591 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:38:29.793981 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b91e730f-997d-40bb-93ba-5ff546df7591 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:38:29.794847 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b91e730f-997d-40bb-93ba-5ff546df7591 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:38:29.795341 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b91e730f-997d-40bb-93ba-5ff546df7591 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:38:30.012194 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-b91e730f-997d-40bb-93ba-5ff546df7591 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508cb16ab6343dfb7de72c6b3600ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211699de14224a63a48d253eaa061c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:38:30.020867 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-b91e730f-997d-40bb-93ba-5ff546df7591 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] 10.222.0.45 "GET /compute/v2.1/servers/55e131bc-148b-487f-8429-c2f47286ab8c" status: 200 len: 1267 microversion: 2.1 time: 0.244412 Dec 16 15:38:30.021449 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1131/2271] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:38:29 2021] GET /compute/v2.1/servers/55e131bc-148b-487f-8429-c2f47286ab8c => generated 1267 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:38:30.631839 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [req-e03f12cd-1257-4713-ae87-e90586f1deed req-7ce2307a-62fb-4236-8f35-a89c47d28d8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55e131bc-148b-487f-8429-c2f47286ab8c", "name": "network-vif-plugged", "status": "completed", "tag": "6a38862a-109c-43da-917c-390dc4a17d8c"}]} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:38:30.636452 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:38:30.636452 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: warnings.warn(msg) Dec 16 15:38:30.646991 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-e03f12cd-1257-4713-ae87-e90586f1deed req-7ce2307a-62fb-4236-8f35-a89c47d28d8a service nova] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:38:30.647588 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-e03f12cd-1257-4713-ae87-e90586f1deed req-7ce2307a-62fb-4236-8f35-a89c47d28d8a service nova] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:38:30.665903 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.compute.server_external_events [req-e03f12cd-1257-4713-ae87-e90586f1deed req-7ce2307a-62fb-4236-8f35-a89c47d28d8a service nova] Creating event network-vif-plugged:6a38862a-109c-43da-917c-390dc4a17d8c for instance 55e131bc-148b-487f-8429-c2f47286ab8c on hv-cinder-82189 Dec 16 15:38:30.670957 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [req-e03f12cd-1257-4713-ae87-e90586f1deed req-7ce2307a-62fb-4236-8f35-a89c47d28d8a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046873 Dec 16 15:38:30.671614 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1141/2272] 10.222.0.45 () {64 vars in 1308 bytes} [Thu Dec 16 15:38:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:38:31.044307 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-93017516-564b-4faa-bbe4-beb7290b02fe tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:38:31.044941 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-93017516-564b-4faa-bbe4-beb7290b02fe tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] [instance: 55e131bc-148b-487f-8429-c2f47286ab8c] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:38:31.052819 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-93017516-564b-4faa-bbe4-beb7290b02fe tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:38:31.053328 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-93017516-564b-4faa-bbe4-beb7290b02fe tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:38:31.054203 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-93017516-564b-4faa-bbe4-beb7290b02fe tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:38:31.054698 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-93017516-564b-4faa-bbe4-beb7290b02fe tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:38:31.309435 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-93017516-564b-4faa-bbe4-beb7290b02fe tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508cb16ab6343dfb7de72c6b3600ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211699de14224a63a48d253eaa061c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:38:31.319013 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-93017516-564b-4faa-bbe4-beb7290b02fe tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] 10.222.0.45 "GET /compute/v2.1/servers/55e131bc-148b-487f-8429-c2f47286ab8c" status: 200 len: 1267 microversion: 2.1 time: 0.283000 Dec 16 15:38:31.319625 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1132/2273] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:38:31 2021] GET /compute/v2.1/servers/55e131bc-148b-487f-8429-c2f47286ab8c => generated 1267 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:38:32.340551 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-b048ef1e-da36-4504-8cde-55683b3cac30 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:38:32.341324 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-b048ef1e-da36-4504-8cde-55683b3cac30 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] [instance: 55e131bc-148b-487f-8429-c2f47286ab8c] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:38:32.349627 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b048ef1e-da36-4504-8cde-55683b3cac30 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:38:32.350187 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b048ef1e-da36-4504-8cde-55683b3cac30 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:38:32.351042 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b048ef1e-da36-4504-8cde-55683b3cac30 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:38:32.351536 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b048ef1e-da36-4504-8cde-55683b3cac30 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:38:32.565701 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-b048ef1e-da36-4504-8cde-55683b3cac30 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508cb16ab6343dfb7de72c6b3600ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211699de14224a63a48d253eaa061c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:38:32.575035 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-b048ef1e-da36-4504-8cde-55683b3cac30 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] 10.222.0.45 "GET /compute/v2.1/servers/55e131bc-148b-487f-8429-c2f47286ab8c" status: 200 len: 1267 microversion: 2.1 time: 0.242805 Dec 16 15:38:32.575632 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1142/2274] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:38:32 2021] GET /compute/v2.1/servers/55e131bc-148b-487f-8429-c2f47286ab8c => generated 1267 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:38:33.597026 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-1ffa5712-907d-4960-941f-5019fb517b35 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:38:33.597739 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-1ffa5712-907d-4960-941f-5019fb517b35 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] [instance: 55e131bc-148b-487f-8429-c2f47286ab8c] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:38:33.601277 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 15:38:33.601426 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: Thu Dec 16 15:38:33 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/55e131bc-148b-487f-8429-c2f47286ab8c (ip 10.222.0.45) !!! Dec 16 15:38:33.619295 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1ffa5712-907d-4960-941f-5019fb517b35 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:38:33.622751 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1ffa5712-907d-4960-941f-5019fb517b35 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:38:33.622751 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1ffa5712-907d-4960-941f-5019fb517b35 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:38:33.622751 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1ffa5712-907d-4960-941f-5019fb517b35 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:38:33.833405 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-1ffa5712-907d-4960-941f-5019fb517b35 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508cb16ab6343dfb7de72c6b3600ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211699de14224a63a48d253eaa061c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:38:33.842767 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-1ffa5712-907d-4960-941f-5019fb517b35 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] 10.222.0.45 "GET /compute/v2.1/servers/55e131bc-148b-487f-8429-c2f47286ab8c" status: 200 len: 1454 microversion: 2.1 time: 0.253936 Dec 16 15:38:33.843357 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1133/2275] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:38:33 2021] GET /compute/v2.1/servers/55e131bc-148b-487f-8429-c2f47286ab8c => generated 1454 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:38:33.864292 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-344138df-10c0-4b6a-8aa1-cb4c2c2127db tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:38:33.864957 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-344138df-10c0-4b6a-8aa1-cb4c2c2127db tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] [instance: 55e131bc-148b-487f-8429-c2f47286ab8c] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:38:33.872829 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-344138df-10c0-4b6a-8aa1-cb4c2c2127db tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:38:33.873738 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-344138df-10c0-4b6a-8aa1-cb4c2c2127db tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:38:33.874607 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-344138df-10c0-4b6a-8aa1-cb4c2c2127db tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:38:33.875102 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-344138df-10c0-4b6a-8aa1-cb4c2c2127db tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:38:34.092717 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-344138df-10c0-4b6a-8aa1-cb4c2c2127db tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508cb16ab6343dfb7de72c6b3600ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211699de14224a63a48d253eaa061c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:38:34.101548 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-344138df-10c0-4b6a-8aa1-cb4c2c2127db tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] 10.222.0.45 "GET /compute/v2.1/servers/55e131bc-148b-487f-8429-c2f47286ab8c" status: 200 len: 1454 microversion: 2.1 time: 0.245001 Dec 16 15:38:34.102161 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1143/2276] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:38:33 2021] GET /compute/v2.1/servers/55e131bc-148b-487f-8429-c2f47286ab8c => generated 1454 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:38:35.310247 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-4c7eb70d-e7ca-4930-94c3-003e6b27ec1c tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:38:35.312185 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-4c7eb70d-e7ca-4930-94c3-003e6b27ec1c tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] [instance: 44b0fa18-ab49-4dde-bb17-091a3cb03e25] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:38:35.324596 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4c7eb70d-e7ca-4930-94c3-003e6b27ec1c tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:38:35.325183 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4c7eb70d-e7ca-4930-94c3-003e6b27ec1c tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:38:35.326139 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4c7eb70d-e7ca-4930-94c3-003e6b27ec1c tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:38:35.326756 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-4c7eb70d-e7ca-4930-94c3-003e6b27ec1c tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:38:35.557257 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-4c7eb70d-e7ca-4930-94c3-003e6b27ec1c tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] 10.222.0.45 "POST /compute/v2.1/servers/44b0fa18-ab49-4dde-bb17-091a3cb03e25/action" status: 202 len: 0 microversion: 2.1 time: 0.261551 Dec 16 15:38:35.557915 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1134/2277] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 15:38:35 2021] POST /compute/v2.1/servers/44b0fa18-ab49-4dde-bb17-091a3cb03e25/action => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 16 15:38:35.572241 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-7d2d9ccd-cd3d-4ac5-af3a-0cb7fc73779f tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:38:35.573259 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-7d2d9ccd-cd3d-4ac5-af3a-0cb7fc73779f tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] [instance: 44b0fa18-ab49-4dde-bb17-091a3cb03e25] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:38:35.582832 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7d2d9ccd-cd3d-4ac5-af3a-0cb7fc73779f tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:38:35.583657 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7d2d9ccd-cd3d-4ac5-af3a-0cb7fc73779f tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:38:35.584996 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7d2d9ccd-cd3d-4ac5-af3a-0cb7fc73779f tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:38:35.585575 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-7d2d9ccd-cd3d-4ac5-af3a-0cb7fc73779f tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:38:35.932519 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-7d2d9ccd-cd3d-4ac5-af3a-0cb7fc73779f tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b870a3670f19464a8574e3fe9317e296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6a9888d9bd1474688bf7f4b0feb85df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:38:35.942987 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-7d2d9ccd-cd3d-4ac5-af3a-0cb7fc73779f tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] 10.222.0.45 "GET /compute/v2.1/servers/44b0fa18-ab49-4dde-bb17-091a3cb03e25" status: 200 len: 1749 microversion: 2.1 time: 0.379992 Dec 16 15:38:35.943824 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1144/2278] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:38:35 2021] GET /compute/v2.1/servers/44b0fa18-ab49-4dde-bb17-091a3cb03e25 => generated 1749 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:38:36.967427 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-166aff17-1c20-404a-8713-83afa4c37204 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:38:36.968627 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-166aff17-1c20-404a-8713-83afa4c37204 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] [instance: 44b0fa18-ab49-4dde-bb17-091a3cb03e25] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:38:36.979475 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-166aff17-1c20-404a-8713-83afa4c37204 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:38:36.979988 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-166aff17-1c20-404a-8713-83afa4c37204 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:38:36.980838 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-166aff17-1c20-404a-8713-83afa4c37204 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:38:36.981324 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-166aff17-1c20-404a-8713-83afa4c37204 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:38:37.203637 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-166aff17-1c20-404a-8713-83afa4c37204 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b870a3670f19464a8574e3fe9317e296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6a9888d9bd1474688bf7f4b0feb85df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:38:37.212999 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-166aff17-1c20-404a-8713-83afa4c37204 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] 10.222.0.45 "GET /compute/v2.1/servers/44b0fa18-ab49-4dde-bb17-091a3cb03e25" status: 200 len: 1754 microversion: 2.1 time: 0.254821 Dec 16 15:38:37.213676 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1135/2279] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:38:36 2021] GET /compute/v2.1/servers/44b0fa18-ab49-4dde-bb17-091a3cb03e25 => generated 1754 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:38:37.547634 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [req-ae1c5f81-a8dd-4358-bf19-4633a37f928e req-474fdccd-8805-42b9-8d67-bb5733c975bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55e131bc-148b-487f-8429-c2f47286ab8c", "tag": "6a38862a-109c-43da-917c-390dc4a17d8c"}]} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:38:37.551332 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:38:37.551332 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: warnings.warn(msg) Dec 16 15:38:37.560239 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-ae1c5f81-a8dd-4358-bf19-4633a37f928e req-474fdccd-8805-42b9-8d67-bb5733c975bd service nova] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:38:37.560735 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-ae1c5f81-a8dd-4358-bf19-4633a37f928e req-474fdccd-8805-42b9-8d67-bb5733c975bd service nova] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:38:37.578438 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.compute.server_external_events [req-ae1c5f81-a8dd-4358-bf19-4633a37f928e req-474fdccd-8805-42b9-8d67-bb5733c975bd service nova] Creating event network-changed:6a38862a-109c-43da-917c-390dc4a17d8c for instance 55e131bc-148b-487f-8429-c2f47286ab8c on hv-cinder-82189 Dec 16 15:38:37.583663 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [req-ae1c5f81-a8dd-4358-bf19-4633a37f928e req-474fdccd-8805-42b9-8d67-bb5733c975bd service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.149214 Dec 16 15:38:37.584493 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1145/2280] 10.222.0.45 () {64 vars in 1308 bytes} [Thu Dec 16 15:38:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:38:38.236519 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-38ced77d-76e1-4ca6-82b2-d832580cead0 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:38:38.238553 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-38ced77d-76e1-4ca6-82b2-d832580cead0 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] [instance: 44b0fa18-ab49-4dde-bb17-091a3cb03e25] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:38:38.245148 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-38ced77d-76e1-4ca6-82b2-d832580cead0 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:38:38.246213 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-38ced77d-76e1-4ca6-82b2-d832580cead0 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:38:38.247304 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-38ced77d-76e1-4ca6-82b2-d832580cead0 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:38:38.247801 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-38ced77d-76e1-4ca6-82b2-d832580cead0 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:38:38.573311 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-38ced77d-76e1-4ca6-82b2-d832580cead0 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b870a3670f19464a8574e3fe9317e296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6a9888d9bd1474688bf7f4b0feb85df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:38:38.583065 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-38ced77d-76e1-4ca6-82b2-d832580cead0 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] 10.222.0.45 "GET /compute/v2.1/servers/44b0fa18-ab49-4dde-bb17-091a3cb03e25" status: 200 len: 1754 microversion: 2.1 time: 0.354630 Dec 16 15:38:38.583667 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1136/2281] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:38:38 2021] GET /compute/v2.1/servers/44b0fa18-ab49-4dde-bb17-091a3cb03e25 => generated 1754 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:38:39.606724 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-21cb9103-ffee-4c7f-8b06-fca2cfb4bd7f tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:38:39.607487 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-21cb9103-ffee-4c7f-8b06-fca2cfb4bd7f tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] [instance: 44b0fa18-ab49-4dde-bb17-091a3cb03e25] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:38:39.615594 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-21cb9103-ffee-4c7f-8b06-fca2cfb4bd7f tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:38:39.616094 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-21cb9103-ffee-4c7f-8b06-fca2cfb4bd7f tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:38:39.616965 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-21cb9103-ffee-4c7f-8b06-fca2cfb4bd7f tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:38:39.617446 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-21cb9103-ffee-4c7f-8b06-fca2cfb4bd7f tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:38:39.837847 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-21cb9103-ffee-4c7f-8b06-fca2cfb4bd7f tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b870a3670f19464a8574e3fe9317e296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6a9888d9bd1474688bf7f4b0feb85df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:38:39.847199 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-21cb9103-ffee-4c7f-8b06-fca2cfb4bd7f tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] 10.222.0.45 "GET /compute/v2.1/servers/44b0fa18-ab49-4dde-bb17-091a3cb03e25" status: 200 len: 1754 microversion: 2.1 time: 0.248451 Dec 16 15:38:39.847800 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1146/2282] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:38:39 2021] GET /compute/v2.1/servers/44b0fa18-ab49-4dde-bb17-091a3cb03e25 => generated 1754 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:38:40.869041 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-ae16ee4a-e6b0-47b3-9e13-011b794a6b26 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:38:40.869707 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-ae16ee4a-e6b0-47b3-9e13-011b794a6b26 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] [instance: 44b0fa18-ab49-4dde-bb17-091a3cb03e25] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:38:40.878013 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ae16ee4a-e6b0-47b3-9e13-011b794a6b26 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:38:40.878567 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ae16ee4a-e6b0-47b3-9e13-011b794a6b26 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:38:40.879403 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ae16ee4a-e6b0-47b3-9e13-011b794a6b26 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:38:40.879895 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ae16ee4a-e6b0-47b3-9e13-011b794a6b26 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:38:41.116058 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-ae16ee4a-e6b0-47b3-9e13-011b794a6b26 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b870a3670f19464a8574e3fe9317e296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6a9888d9bd1474688bf7f4b0feb85df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:38:41.127740 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-ae16ee4a-e6b0-47b3-9e13-011b794a6b26 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] 10.222.0.45 "GET /compute/v2.1/servers/44b0fa18-ab49-4dde-bb17-091a3cb03e25" status: 200 len: 1754 microversion: 2.1 time: 0.266117 Dec 16 15:38:41.128297 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1137/2283] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:38:40 2021] GET /compute/v2.1/servers/44b0fa18-ab49-4dde-bb17-091a3cb03e25 => generated 1754 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:38:42.151298 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-59c02a83-bbd5-4850-9694-f3089835b1f0 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:38:42.152519 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-59c02a83-bbd5-4850-9694-f3089835b1f0 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] [instance: 44b0fa18-ab49-4dde-bb17-091a3cb03e25] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:38:42.160847 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-59c02a83-bbd5-4850-9694-f3089835b1f0 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:38:42.161352 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-59c02a83-bbd5-4850-9694-f3089835b1f0 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:38:42.162229 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-59c02a83-bbd5-4850-9694-f3089835b1f0 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:38:42.162730 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-59c02a83-bbd5-4850-9694-f3089835b1f0 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:38:42.516906 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-59c02a83-bbd5-4850-9694-f3089835b1f0 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b870a3670f19464a8574e3fe9317e296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6a9888d9bd1474688bf7f4b0feb85df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:38:42.526183 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-59c02a83-bbd5-4850-9694-f3089835b1f0 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] 10.222.0.45 "GET /compute/v2.1/servers/44b0fa18-ab49-4dde-bb17-091a3cb03e25" status: 200 len: 1754 microversion: 2.1 time: 0.382632 Dec 16 15:38:42.526780 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1147/2284] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:38:42 2021] GET /compute/v2.1/servers/44b0fa18-ab49-4dde-bb17-091a3cb03e25 => generated 1754 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 16 15:38:43.551029 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-2698c911-382c-4ce1-8ddd-a17b5bed21ca tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:38:43.551029 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-2698c911-382c-4ce1-8ddd-a17b5bed21ca tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] [instance: 44b0fa18-ab49-4dde-bb17-091a3cb03e25] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:38:43.556884 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2698c911-382c-4ce1-8ddd-a17b5bed21ca tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:38:43.557382 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2698c911-382c-4ce1-8ddd-a17b5bed21ca tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:38:43.558738 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2698c911-382c-4ce1-8ddd-a17b5bed21ca tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:38:43.559222 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-2698c911-382c-4ce1-8ddd-a17b5bed21ca tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:38:43.784404 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-2698c911-382c-4ce1-8ddd-a17b5bed21ca tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b870a3670f19464a8574e3fe9317e296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6a9888d9bd1474688bf7f4b0feb85df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:38:43.794311 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-2698c911-382c-4ce1-8ddd-a17b5bed21ca tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] 10.222.0.45 "GET /compute/v2.1/servers/44b0fa18-ab49-4dde-bb17-091a3cb03e25" status: 200 len: 1754 microversion: 2.1 time: 0.253666 Dec 16 15:38:43.794911 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1138/2285] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:38:43 2021] GET /compute/v2.1/servers/44b0fa18-ab49-4dde-bb17-091a3cb03e25 => generated 1754 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:38:44.816505 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-fea5bb54-4d3a-47cf-b1e7-8d6c3b6848e4 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:38:44.817097 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-fea5bb54-4d3a-47cf-b1e7-8d6c3b6848e4 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] [instance: 44b0fa18-ab49-4dde-bb17-091a3cb03e25] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:38:44.825563 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fea5bb54-4d3a-47cf-b1e7-8d6c3b6848e4 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:38:44.826072 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fea5bb54-4d3a-47cf-b1e7-8d6c3b6848e4 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:38:44.826923 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fea5bb54-4d3a-47cf-b1e7-8d6c3b6848e4 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:38:44.827416 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fea5bb54-4d3a-47cf-b1e7-8d6c3b6848e4 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:38:45.082789 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-fea5bb54-4d3a-47cf-b1e7-8d6c3b6848e4 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b870a3670f19464a8574e3fe9317e296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6a9888d9bd1474688bf7f4b0feb85df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:38:45.092223 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-fea5bb54-4d3a-47cf-b1e7-8d6c3b6848e4 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] 10.222.0.45 "GET /compute/v2.1/servers/44b0fa18-ab49-4dde-bb17-091a3cb03e25" status: 200 len: 1754 microversion: 2.1 time: 0.284091 Dec 16 15:38:45.092813 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1148/2286] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:38:44 2021] GET /compute/v2.1/servers/44b0fa18-ab49-4dde-bb17-091a3cb03e25 => generated 1754 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:38:46.114111 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-8fbb9456-2d30-4551-8e7a-8c3ea6a9f28d tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:38:46.114694 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-8fbb9456-2d30-4551-8e7a-8c3ea6a9f28d tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] [instance: 44b0fa18-ab49-4dde-bb17-091a3cb03e25] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:38:46.122412 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8fbb9456-2d30-4551-8e7a-8c3ea6a9f28d tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:38:46.122915 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8fbb9456-2d30-4551-8e7a-8c3ea6a9f28d tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:38:46.123739 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8fbb9456-2d30-4551-8e7a-8c3ea6a9f28d tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:38:46.124226 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8fbb9456-2d30-4551-8e7a-8c3ea6a9f28d tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:38:46.545837 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-8fbb9456-2d30-4551-8e7a-8c3ea6a9f28d tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b870a3670f19464a8574e3fe9317e296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6a9888d9bd1474688bf7f4b0feb85df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:38:46.555291 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-8fbb9456-2d30-4551-8e7a-8c3ea6a9f28d tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] 10.222.0.45 "GET /compute/v2.1/servers/44b0fa18-ab49-4dde-bb17-091a3cb03e25" status: 200 len: 1754 microversion: 2.1 time: 0.448908 Dec 16 15:38:46.555891 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1139/2287] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:38:46 2021] GET /compute/v2.1/servers/44b0fa18-ab49-4dde-bb17-091a3cb03e25 => generated 1754 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:38:47.578190 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-9accecbc-7554-40fc-852c-92b26bd2a523 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:38:47.578866 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-9accecbc-7554-40fc-852c-92b26bd2a523 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] [instance: 44b0fa18-ab49-4dde-bb17-091a3cb03e25] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:38:47.586635 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9accecbc-7554-40fc-852c-92b26bd2a523 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:38:47.587142 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9accecbc-7554-40fc-852c-92b26bd2a523 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:38:47.587972 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9accecbc-7554-40fc-852c-92b26bd2a523 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:38:47.588468 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9accecbc-7554-40fc-852c-92b26bd2a523 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:38:47.812161 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-9accecbc-7554-40fc-852c-92b26bd2a523 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b870a3670f19464a8574e3fe9317e296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6a9888d9bd1474688bf7f4b0feb85df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:38:47.821525 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-9accecbc-7554-40fc-852c-92b26bd2a523 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] 10.222.0.45 "GET /compute/v2.1/servers/44b0fa18-ab49-4dde-bb17-091a3cb03e25" status: 200 len: 1754 microversion: 2.1 time: 0.251589 Dec 16 15:38:47.822130 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1149/2288] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:38:47 2021] GET /compute/v2.1/servers/44b0fa18-ab49-4dde-bb17-091a3cb03e25 => generated 1754 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:38:48.844103 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-1331a6c6-0608-41ed-9a29-b328606926dc tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:38:48.844776 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-1331a6c6-0608-41ed-9a29-b328606926dc tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] [instance: 44b0fa18-ab49-4dde-bb17-091a3cb03e25] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:38:48.852603 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1331a6c6-0608-41ed-9a29-b328606926dc tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:38:48.853121 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1331a6c6-0608-41ed-9a29-b328606926dc tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:38:48.853962 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1331a6c6-0608-41ed-9a29-b328606926dc tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:38:48.854485 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1331a6c6-0608-41ed-9a29-b328606926dc tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:38:49.093821 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-1331a6c6-0608-41ed-9a29-b328606926dc tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b870a3670f19464a8574e3fe9317e296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6a9888d9bd1474688bf7f4b0feb85df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:38:49.103631 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-1331a6c6-0608-41ed-9a29-b328606926dc tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] 10.222.0.45 "GET /compute/v2.1/servers/44b0fa18-ab49-4dde-bb17-091a3cb03e25" status: 200 len: 1757 microversion: 2.1 time: 0.267620 Dec 16 15:38:49.104146 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1140/2289] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:38:48 2021] GET /compute/v2.1/servers/44b0fa18-ab49-4dde-bb17-091a3cb03e25 => generated 1757 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:40:00.720574 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c006f2bf-d7e6-4bb8-aace-c3797b4b538d] AMQP server on 10.222.0.45:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 15:40:00.727824 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-9b4aa619-4f43-4807-a34d-d26b92df37e2 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-294014708"}} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:40:00.728421 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-9b4aa619-4f43-4807-a34d-d26b92df37e2 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] [instance: 44b0fa18-ab49-4dde-bb17-091a3cb03e25] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:40:00.736916 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9b4aa619-4f43-4807-a34d-d26b92df37e2 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:40:00.737423 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9b4aa619-4f43-4807-a34d-d26b92df37e2 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:40:00.738291 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9b4aa619-4f43-4807-a34d-d26b92df37e2 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:40:00.738785 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-9b4aa619-4f43-4807-a34d-d26b92df37e2 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:40:00.952424 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.network.security_group_api [None req-9b4aa619-4f43-4807-a34d-d26b92df37e2 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Removing security group fec80772-e67d-4195-a897-6cfea3e9cc9f from port 6925aa7d-82c7-4220-a544-9bf5ae16c3c5 Dec 16 15:40:01.516259 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-9b4aa619-4f43-4807-a34d-d26b92df37e2 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] 10.222.0.45 "POST /compute/v2.1/servers/44b0fa18-ab49-4dde-bb17-091a3cb03e25/action" status: 202 len: 0 microversion: 2.1 time: 0.797130 Dec 16 15:40:01.517036 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1150/2290] 10.222.0.45 () {60 vars in 1268 bytes} [Thu Dec 16 15:40:00 2021] POST /compute/v2.1/servers/44b0fa18-ab49-4dde-bb17-091a3cb03e25/action => generated 0 bytes in 799 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:40:01.534744 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [req-141a01ba-8877-4146-b45c-6d17238dcb1f req-554b8bc9-33f5-449c-ace0-e2c2d1693641 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44b0fa18-ab49-4dde-bb17-091a3cb03e25", "tag": "6925aa7d-82c7-4220-a544-9bf5ae16c3c5"}]} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:40:01.542686 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:40:01.542686 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: warnings.warn(msg) Dec 16 15:40:01.553045 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-141a01ba-8877-4146-b45c-6d17238dcb1f req-554b8bc9-33f5-449c-ace0-e2c2d1693641 service nova] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:40:01.553649 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-141a01ba-8877-4146-b45c-6d17238dcb1f req-554b8bc9-33f5-449c-ace0-e2c2d1693641 service nova] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:40:01.573813 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.compute.server_external_events [req-141a01ba-8877-4146-b45c-6d17238dcb1f req-554b8bc9-33f5-449c-ace0-e2c2d1693641 service nova] Creating event network-changed:6925aa7d-82c7-4220-a544-9bf5ae16c3c5 for instance 44b0fa18-ab49-4dde-bb17-091a3cb03e25 on hv-cinder-82189 Dec 16 15:40:01.582030 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [req-141a01ba-8877-4146-b45c-6d17238dcb1f req-554b8bc9-33f5-449c-ace0-e2c2d1693641 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060875 Dec 16 15:40:01.583001 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1141/2291] 10.222.0.45 () {64 vars in 1308 bytes} [Thu Dec 16 15:40:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:40:04.357912 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [req-3ec248f0-f1f0-42d5-8597-5c407e2ef0d9 req-e50473e4-c5b6-436f-a5e4-81ffcfc46f39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44b0fa18-ab49-4dde-bb17-091a3cb03e25", "tag": "6925aa7d-82c7-4220-a544-9bf5ae16c3c5"}]} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:40:04.360678 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-3735b7bc-0003-419a-8211-e9240b23e942 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:40:04.361430 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-3735b7bc-0003-419a-8211-e9240b23e942 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] [instance: 44b0fa18-ab49-4dde-bb17-091a3cb03e25] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:40:04.364866 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:40:04.364866 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: warnings.warn(msg) Dec 16 15:40:04.370684 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3735b7bc-0003-419a-8211-e9240b23e942 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:40:04.371436 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3735b7bc-0003-419a-8211-e9240b23e942 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:40:04.372500 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3735b7bc-0003-419a-8211-e9240b23e942 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:40:04.373185 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3735b7bc-0003-419a-8211-e9240b23e942 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:40:04.377867 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-3ec248f0-f1f0-42d5-8597-5c407e2ef0d9 req-e50473e4-c5b6-436f-a5e4-81ffcfc46f39 service nova] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:40:04.378483 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-3ec248f0-f1f0-42d5-8597-5c407e2ef0d9 req-e50473e4-c5b6-436f-a5e4-81ffcfc46f39 service nova] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:40:04.397857 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.compute.server_external_events [req-3ec248f0-f1f0-42d5-8597-5c407e2ef0d9 req-e50473e4-c5b6-436f-a5e4-81ffcfc46f39 service nova] Creating event network-changed:6925aa7d-82c7-4220-a544-9bf5ae16c3c5 for instance 44b0fa18-ab49-4dde-bb17-091a3cb03e25 on hv-cinder-82189 Dec 16 15:40:04.404289 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [req-3ec248f0-f1f0-42d5-8597-5c407e2ef0d9 req-e50473e4-c5b6-436f-a5e4-81ffcfc46f39 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057108 Dec 16 15:40:04.405710 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1142/2292] 10.222.0.45 () {64 vars in 1308 bytes} [Thu Dec 16 15:40:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:40:04.434822 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO oslo.messaging._drivers.impl_rabbit [-] [c006f2bf-d7e6-4bb8-aace-c3797b4b538d] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 36460. Dec 16 15:40:04.716349 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-3735b7bc-0003-419a-8211-e9240b23e942 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] 10.222.0.45 "DELETE /compute/v2.1/servers/44b0fa18-ab49-4dde-bb17-091a3cb03e25/os-volume_attachments/e362bdec-376f-4eea-8803-b604a13f8bc5" status: 202 len: 0 microversion: 2.1 time: 0.374361 Dec 16 15:40:04.721464 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1151/2293] 10.222.0.45 () {58 vars in 1406 bytes} [Thu Dec 16 15:40:04 2021] DELETE /compute/v2.1/servers/44b0fa18-ab49-4dde-bb17-091a3cb03e25/os-volume_attachments/e362bdec-376f-4eea-8803-b604a13f8bc5 => generated 0 bytes in 378 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:40:04.734316 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-652f3f08-4c73-4a2b-a053-05f642f21533 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:40:04.735986 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-652f3f08-4c73-4a2b-a053-05f642f21533 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] [instance: 44b0fa18-ab49-4dde-bb17-091a3cb03e25] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:40:04.744521 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-652f3f08-4c73-4a2b-a053-05f642f21533 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:40:04.745297 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-652f3f08-4c73-4a2b-a053-05f642f21533 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:40:04.746452 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-652f3f08-4c73-4a2b-a053-05f642f21533 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:40:04.747157 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-652f3f08-4c73-4a2b-a053-05f642f21533 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:40:04.823742 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-652f3f08-4c73-4a2b-a053-05f642f21533 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] 10.222.0.45 "GET /compute/v2.1/servers/44b0fa18-ab49-4dde-bb17-091a3cb03e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.100254 Dec 16 15:40:04.824390 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1143/2294] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:40:04 2021] GET /compute/v2.1/servers/44b0fa18-ab49-4dde-bb17-091a3cb03e25/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:40:05.841270 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-1b10e4f9-957b-4d90-8035-0d3978aea436 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:40:05.843047 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-1b10e4f9-957b-4d90-8035-0d3978aea436 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] [instance: 44b0fa18-ab49-4dde-bb17-091a3cb03e25] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:40:05.851304 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1b10e4f9-957b-4d90-8035-0d3978aea436 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:40:05.851819 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1b10e4f9-957b-4d90-8035-0d3978aea436 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:40:05.852691 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1b10e4f9-957b-4d90-8035-0d3978aea436 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:40:05.853189 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-1b10e4f9-957b-4d90-8035-0d3978aea436 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:40:05.931109 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-1b10e4f9-957b-4d90-8035-0d3978aea436 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] 10.222.0.45 "GET /compute/v2.1/servers/44b0fa18-ab49-4dde-bb17-091a3cb03e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.098092 Dec 16 15:40:05.931661 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1152/2295] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:40:05 2021] GET /compute/v2.1/servers/44b0fa18-ab49-4dde-bb17-091a3cb03e25/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:40:06.947569 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-19b325a2-f109-4fd2-91a6-5bf9da38aec8 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:40:06.948602 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-19b325a2-f109-4fd2-91a6-5bf9da38aec8 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] [instance: 44b0fa18-ab49-4dde-bb17-091a3cb03e25] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:40:06.957224 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-19b325a2-f109-4fd2-91a6-5bf9da38aec8 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:40:06.957726 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-19b325a2-f109-4fd2-91a6-5bf9da38aec8 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:40:06.958581 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-19b325a2-f109-4fd2-91a6-5bf9da38aec8 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:40:06.959074 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-19b325a2-f109-4fd2-91a6-5bf9da38aec8 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:40:07.028077 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-19b325a2-f109-4fd2-91a6-5bf9da38aec8 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] 10.222.0.45 "GET /compute/v2.1/servers/44b0fa18-ab49-4dde-bb17-091a3cb03e25/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.088191 Dec 16 15:40:07.028686 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1144/2296] 10.222.0.45 () {58 vars in 1292 bytes} [Thu Dec 16 15:40:06 2021] GET /compute/v2.1/servers/44b0fa18-ab49-4dde-bb17-091a3cb03e25/os-volume_attachments => generated 25 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 16 15:40:07.043606 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-3cf2cf36-00a5-418f-acf7-0471e64c2851 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:40:07.044163 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-3cf2cf36-00a5-418f-acf7-0471e64c2851 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] [instance: 44b0fa18-ab49-4dde-bb17-091a3cb03e25] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:40:07.052066 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3cf2cf36-00a5-418f-acf7-0471e64c2851 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:40:07.052580 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3cf2cf36-00a5-418f-acf7-0471e64c2851 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:40:07.053415 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3cf2cf36-00a5-418f-acf7-0471e64c2851 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:40:07.053909 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-3cf2cf36-00a5-418f-acf7-0471e64c2851 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:40:07.226572 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.wsgi [None req-3cf2cf36-00a5-418f-acf7-0471e64c2851 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] HTTP exception thrown: Instance 44b0fa18-ab49-4dde-bb17-091a3cb03e25 is not attached to volume e362bdec-376f-4eea-8803-b604a13f8bc5 Dec 16 15:40:07.227239 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-3cf2cf36-00a5-418f-acf7-0471e64c2851 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Returning 404 to user: Instance 44b0fa18-ab49-4dde-bb17-091a3cb03e25 is not attached to volume e362bdec-376f-4eea-8803-b604a13f8bc5 {{(pid=101356) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:941}} Dec 16 15:40:07.228139 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-3cf2cf36-00a5-418f-acf7-0471e64c2851 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] 10.222.0.45 "DELETE /compute/v2.1/servers/44b0fa18-ab49-4dde-bb17-091a3cb03e25/os-volume_attachments/e362bdec-376f-4eea-8803-b604a13f8bc5" status: 404 len: 154 microversion: 2.1 time: 0.192371 Dec 16 15:40:07.228739 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1153/2297] 10.222.0.45 () {58 vars in 1406 bytes} [Thu Dec 16 15:40:07 2021] DELETE /compute/v2.1/servers/44b0fa18-ab49-4dde-bb17-091a3cb03e25/os-volume_attachments/e362bdec-376f-4eea-8803-b604a13f8bc5 => generated 154 bytes in 194 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 15:40:08.530927 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-ac44587d-51dd-45ea-bc54-0140105647e9 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:40:08.531472 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-ac44587d-51dd-45ea-bc54-0140105647e9 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] [instance: 44b0fa18-ab49-4dde-bb17-091a3cb03e25] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:40:08.539418 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ac44587d-51dd-45ea-bc54-0140105647e9 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:40:08.539915 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ac44587d-51dd-45ea-bc54-0140105647e9 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:40:08.540750 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ac44587d-51dd-45ea-bc54-0140105647e9 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:40:08.541239 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ac44587d-51dd-45ea-bc54-0140105647e9 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:40:08.747691 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-ac44587d-51dd-45ea-bc54-0140105647e9 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] [instance: 44b0fa18-ab49-4dde-bb17-091a3cb03e25] Going to try to terminate instance {{(pid=101355) delete /opt/stack/nova/nova/compute/api.py:2496}} Dec 16 15:40:08.933678 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-ac44587d-51dd-45ea-bc54-0140105647e9 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] 10.222.0.45 "DELETE /compute/v2.1/servers/44b0fa18-ab49-4dde-bb17-091a3cb03e25" status: 204 len: 0 microversion: 2.1 time: 0.410611 Dec 16 15:40:08.934382 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1145/2298] 10.222.0.45 () {58 vars in 1229 bytes} [Thu Dec 16 15:40:08 2021] DELETE /compute/v2.1/servers/44b0fa18-ab49-4dde-bb17-091a3cb03e25 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 16 15:40:08.946959 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-fd4e4798-fb40-477c-90ea-76f492c12961 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:40:08.947678 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-fd4e4798-fb40-477c-90ea-76f492c12961 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] [instance: 44b0fa18-ab49-4dde-bb17-091a3cb03e25] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:40:08.956310 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fd4e4798-fb40-477c-90ea-76f492c12961 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:40:08.956807 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fd4e4798-fb40-477c-90ea-76f492c12961 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:40:08.957647 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fd4e4798-fb40-477c-90ea-76f492c12961 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:40:08.958172 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-fd4e4798-fb40-477c-90ea-76f492c12961 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:40:09.180542 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-fd4e4798-fb40-477c-90ea-76f492c12961 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b870a3670f19464a8574e3fe9317e296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6a9888d9bd1474688bf7f4b0feb85df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:40:09.190006 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-fd4e4798-fb40-477c-90ea-76f492c12961 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] 10.222.0.45 "GET /compute/v2.1/servers/44b0fa18-ab49-4dde-bb17-091a3cb03e25" status: 200 len: 1553 microversion: 2.1 time: 0.250597 Dec 16 15:40:09.190640 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1154/2299] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:40:08 2021] GET /compute/v2.1/servers/44b0fa18-ab49-4dde-bb17-091a3cb03e25 => generated 1553 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:40:10.213037 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-6446a9db-3454-41ec-88fa-a0262bdce6a5 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:40:10.213833 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-6446a9db-3454-41ec-88fa-a0262bdce6a5 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] [instance: 44b0fa18-ab49-4dde-bb17-091a3cb03e25] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:40:10.222208 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6446a9db-3454-41ec-88fa-a0262bdce6a5 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:40:10.222712 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6446a9db-3454-41ec-88fa-a0262bdce6a5 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:40:10.223534 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6446a9db-3454-41ec-88fa-a0262bdce6a5 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:40:10.224019 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-6446a9db-3454-41ec-88fa-a0262bdce6a5 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:40:10.522444 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-6446a9db-3454-41ec-88fa-a0262bdce6a5 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b870a3670f19464a8574e3fe9317e296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6a9888d9bd1474688bf7f4b0feb85df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:40:10.532034 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-6446a9db-3454-41ec-88fa-a0262bdce6a5 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] 10.222.0.45 "GET /compute/v2.1/servers/44b0fa18-ab49-4dde-bb17-091a3cb03e25" status: 200 len: 1553 microversion: 2.1 time: 0.327081 Dec 16 15:40:10.532628 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1146/2300] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:40:10 2021] GET /compute/v2.1/servers/44b0fa18-ab49-4dde-bb17-091a3cb03e25 => generated 1553 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:40:11.557023 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-414b8bdc-7ab0-4873-8225-a0f5f28d7267 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:40:11.557023 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-414b8bdc-7ab0-4873-8225-a0f5f28d7267 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] [instance: 44b0fa18-ab49-4dde-bb17-091a3cb03e25] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:40:11.558579 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 15:40:11.558754 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: Thu Dec 16 15:40:11 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/44b0fa18-ab49-4dde-bb17-091a3cb03e25 (ip 10.222.0.45) !!! Dec 16 15:40:11.577538 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-414b8bdc-7ab0-4873-8225-a0f5f28d7267 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:40:11.578060 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-414b8bdc-7ab0-4873-8225-a0f5f28d7267 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:40:11.578918 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-414b8bdc-7ab0-4873-8225-a0f5f28d7267 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:40:11.579411 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-414b8bdc-7ab0-4873-8225-a0f5f28d7267 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:40:11.814027 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-414b8bdc-7ab0-4873-8225-a0f5f28d7267 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b870a3670f19464a8574e3fe9317e296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6a9888d9bd1474688bf7f4b0feb85df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:40:11.825962 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-414b8bdc-7ab0-4873-8225-a0f5f28d7267 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] 10.222.0.45 "GET /compute/v2.1/servers/44b0fa18-ab49-4dde-bb17-091a3cb03e25" status: 200 len: 1553 microversion: 2.1 time: 0.279088 Dec 16 15:40:11.826618 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1155/2301] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:40:11 2021] GET /compute/v2.1/servers/44b0fa18-ab49-4dde-bb17-091a3cb03e25 => generated 1553 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:40:12.220646 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [req-dd6bce15-0bbe-45c6-88fe-25dff57b633f req-70f819ac-5341-4dcb-beb7-9f138567f7ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44b0fa18-ab49-4dde-bb17-091a3cb03e25", "name": "network-vif-deleted", "tag": "6925aa7d-82c7-4220-a544-9bf5ae16c3c5"}]} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:40:12.225177 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:40:12.225177 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: warnings.warn(msg) Dec 16 15:40:12.233909 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-dd6bce15-0bbe-45c6-88fe-25dff57b633f req-70f819ac-5341-4dcb-beb7-9f138567f7ab service nova] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:40:12.234439 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-dd6bce15-0bbe-45c6-88fe-25dff57b633f req-70f819ac-5341-4dcb-beb7-9f138567f7ab service nova] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:40:12.254587 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.compute.server_external_events [req-dd6bce15-0bbe-45c6-88fe-25dff57b633f req-70f819ac-5341-4dcb-beb7-9f138567f7ab service nova] Creating event network-vif-deleted:6925aa7d-82c7-4220-a544-9bf5ae16c3c5 for instance 44b0fa18-ab49-4dde-bb17-091a3cb03e25 on hv-cinder-82189 Dec 16 15:40:12.259599 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [req-dd6bce15-0bbe-45c6-88fe-25dff57b633f req-70f819ac-5341-4dcb-beb7-9f138567f7ab service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047354 Dec 16 15:40:12.268696 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1147/2302] 10.222.0.45 () {64 vars in 1308 bytes} [Thu Dec 16 15:40:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:40:12.847490 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-200f5910-e238-438a-a972-076b6209282a tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:40:12.848953 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-200f5910-e238-438a-a972-076b6209282a tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] [instance: 44b0fa18-ab49-4dde-bb17-091a3cb03e25] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:40:12.855973 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-200f5910-e238-438a-a972-076b6209282a tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:40:12.856482 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-200f5910-e238-438a-a972-076b6209282a tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:40:12.857324 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-200f5910-e238-438a-a972-076b6209282a tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:40:12.858351 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-200f5910-e238-438a-a972-076b6209282a tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:40:12.970688 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-200f5910-e238-438a-a972-076b6209282a tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:40:12.971250 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-200f5910-e238-438a-a972-076b6209282a tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:40:12.971828 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.objects.instance [None req-200f5910-e238-438a-a972-076b6209282a tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lazy-loading 'fault' on Instance uuid 44b0fa18-ab49-4dde-bb17-091a3cb03e25 {{(pid=101356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 16 15:40:13.035970 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-200f5910-e238-438a-a972-076b6209282a tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b870a3670f19464a8574e3fe9317e296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6a9888d9bd1474688bf7f4b0feb85df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:40:13.045706 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-200f5910-e238-438a-a972-076b6209282a tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] 10.222.0.45 "GET /compute/v2.1/servers/44b0fa18-ab49-4dde-bb17-091a3cb03e25" status: 200 len: 1347 microversion: 2.1 time: 0.205211 Dec 16 15:40:13.046348 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1156/2303] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:40:12 2021] GET /compute/v2.1/servers/44b0fa18-ab49-4dde-bb17-091a3cb03e25 => generated 1347 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:40:14.069931 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-0a7b3cca-f87c-497f-8082-a8c3d49277fa tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:40:14.070747 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-0a7b3cca-f87c-497f-8082-a8c3d49277fa tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] [instance: 44b0fa18-ab49-4dde-bb17-091a3cb03e25] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:40:14.080564 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0a7b3cca-f87c-497f-8082-a8c3d49277fa tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:40:14.081077 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0a7b3cca-f87c-497f-8082-a8c3d49277fa tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:40:14.082485 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0a7b3cca-f87c-497f-8082-a8c3d49277fa tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:40:14.083414 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-0a7b3cca-f87c-497f-8082-a8c3d49277fa tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:40:14.138304 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.wsgi [None req-0a7b3cca-f87c-497f-8082-a8c3d49277fa tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] HTTP exception thrown: Instance 44b0fa18-ab49-4dde-bb17-091a3cb03e25 could not be found. Dec 16 15:40:14.139010 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-0a7b3cca-f87c-497f-8082-a8c3d49277fa tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Returning 404 to user: Instance 44b0fa18-ab49-4dde-bb17-091a3cb03e25 could not be found. {{(pid=101355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:941}} Dec 16 15:40:14.139842 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-0a7b3cca-f87c-497f-8082-a8c3d49277fa tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] 10.222.0.45 "GET /compute/v2.1/servers/44b0fa18-ab49-4dde-bb17-091a3cb03e25" status: 404 len: 111 microversion: 2.1 time: 0.079524 Dec 16 15:40:14.140451 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1148/2304] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:40:14 2021] GET /compute/v2.1/servers/44b0fa18-ab49-4dde-bb17-091a3cb03e25 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 15:40:14.155219 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-0a91ec07-70aa-441e-ac52-f5bbd9eeb3a1 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] Calling method '.version_select at 0x7f14f6f97620>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:40:14.237300 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-0a91ec07-70aa-441e-ac52-f5bbd9eeb3a1 tempest-TestMinimumBasicScenario-754029852 tempest-TestMinimumBasicScenario-754029852-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-562923400" status: 202 len: 0 microversion: 2.1 time: 0.090491 Dec 16 15:40:14.237938 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1157/2305] 10.222.0.45 () {58 vars in 1259 bytes} [Thu Dec 16 15:40:14 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-562923400 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 16 15:40:39.751623 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-e4c921a6-5dcd-4eaa-89e4-2afdf952963f tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:40:39.752170 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-e4c921a6-5dcd-4eaa-89e4-2afdf952963f tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] [instance: 55e131bc-148b-487f-8429-c2f47286ab8c] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:40:39.753904 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [req-a369c09e-a0d0-4ed8-85a5-f961b9d06926 req-cf276c67-3e52-46f2-aa34-e554c7a992a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55e131bc-148b-487f-8429-c2f47286ab8c", "tag": "6a38862a-109c-43da-917c-390dc4a17d8c"}]} {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:40:39.759203 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:40:39.759203 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: warnings.warn(msg) Dec 16 15:40:39.761077 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e4c921a6-5dcd-4eaa-89e4-2afdf952963f tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:40:39.761591 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e4c921a6-5dcd-4eaa-89e4-2afdf952963f tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:40:39.762577 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e4c921a6-5dcd-4eaa-89e4-2afdf952963f tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:40:39.763597 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e4c921a6-5dcd-4eaa-89e4-2afdf952963f tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:40:39.766096 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c89047bd-5046-4dc5-81a4-5f3a093a9e0b] AMQP server on 10.222.0.45:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 15:40:39.769901 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-a369c09e-a0d0-4ed8-85a5-f961b9d06926 req-cf276c67-3e52-46f2-aa34-e554c7a992a3 service nova] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:40:39.770427 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-a369c09e-a0d0-4ed8-85a5-f961b9d06926 req-cf276c67-3e52-46f2-aa34-e554c7a992a3 service nova] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:40:39.788954 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.compute.server_external_events [req-a369c09e-a0d0-4ed8-85a5-f961b9d06926 req-cf276c67-3e52-46f2-aa34-e554c7a992a3 service nova] Creating event network-changed:6a38862a-109c-43da-917c-390dc4a17d8c for instance 55e131bc-148b-487f-8429-c2f47286ab8c on hv-cinder-82189 Dec 16 15:40:39.795236 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [req-a369c09e-a0d0-4ed8-85a5-f961b9d06926 req-cf276c67-3e52-46f2-aa34-e554c7a992a3 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051026 Dec 16 15:40:39.796145 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1149/2306] 10.222.0.45 () {64 vars in 1308 bytes} [Thu Dec 16 15:40:39 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:40:39.834005 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-e4c921a6-5dcd-4eaa-89e4-2afdf952963f tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] [instance: 55e131bc-148b-487f-8429-c2f47286ab8c] Going to try to terminate instance {{(pid=101356) delete /opt/stack/nova/nova/compute/api.py:2496}} Dec 16 15:40:40.093258 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-e4c921a6-5dcd-4eaa-89e4-2afdf952963f tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] 10.222.0.45 "DELETE /compute/v2.1/servers/55e131bc-148b-487f-8429-c2f47286ab8c" status: 204 len: 0 microversion: 2.1 time: 0.349378 Dec 16 15:40:40.093917 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1158/2307] 10.222.0.45 () {58 vars in 1229 bytes} [Thu Dec 16 15:40:39 2021] DELETE /compute/v2.1/servers/55e131bc-148b-487f-8429-c2f47286ab8c => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 16 15:40:40.108171 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-98646fb8-8f67-4928-94c6-8885b7592194 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:40:40.108949 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-98646fb8-8f67-4928-94c6-8885b7592194 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] [instance: 55e131bc-148b-487f-8429-c2f47286ab8c] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:40:40.117206 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-98646fb8-8f67-4928-94c6-8885b7592194 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:40:40.117913 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-98646fb8-8f67-4928-94c6-8885b7592194 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:40:40.118863 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-98646fb8-8f67-4928-94c6-8885b7592194 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:40:40.119369 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-98646fb8-8f67-4928-94c6-8885b7592194 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:40:40.486727 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-98646fb8-8f67-4928-94c6-8885b7592194 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508cb16ab6343dfb7de72c6b3600ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211699de14224a63a48d253eaa061c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:40:40.496411 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-98646fb8-8f67-4928-94c6-8885b7592194 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] 10.222.0.45 "GET /compute/v2.1/servers/55e131bc-148b-487f-8429-c2f47286ab8c" status: 200 len: 1578 microversion: 2.1 time: 0.397352 Dec 16 15:40:40.502207 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1150/2308] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:40:40 2021] GET /compute/v2.1/servers/55e131bc-148b-487f-8429-c2f47286ab8c => generated 1578 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:40:41.519610 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-b7845fe5-211f-46e6-889b-74777f7a4164 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:40:41.520378 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-b7845fe5-211f-46e6-889b-74777f7a4164 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] [instance: 55e131bc-148b-487f-8429-c2f47286ab8c] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:40:41.528344 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b7845fe5-211f-46e6-889b-74777f7a4164 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:40:41.528868 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b7845fe5-211f-46e6-889b-74777f7a4164 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:40:41.529730 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b7845fe5-211f-46e6-889b-74777f7a4164 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:40:41.530252 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b7845fe5-211f-46e6-889b-74777f7a4164 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:40:41.800603 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-b7845fe5-211f-46e6-889b-74777f7a4164 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508cb16ab6343dfb7de72c6b3600ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211699de14224a63a48d253eaa061c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:40:41.809668 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-b7845fe5-211f-46e6-889b-74777f7a4164 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] 10.222.0.45 "GET /compute/v2.1/servers/55e131bc-148b-487f-8429-c2f47286ab8c" status: 200 len: 1460 microversion: 2.1 time: 0.298409 Dec 16 15:40:41.810387 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1159/2309] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:40:41 2021] GET /compute/v2.1/servers/55e131bc-148b-487f-8429-c2f47286ab8c => generated 1460 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:40:42.833091 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-b2559849-7e2b-4b45-b557-3ee7df958134 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:40:42.833768 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-b2559849-7e2b-4b45-b557-3ee7df958134 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] [instance: 55e131bc-148b-487f-8429-c2f47286ab8c] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:40:42.858976 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO oslo.messaging._drivers.impl_rabbit [-] [c89047bd-5046-4dc5-81a4-5f3a093a9e0b] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 36614. Dec 16 15:40:42.860710 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b2559849-7e2b-4b45-b557-3ee7df958134 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:40:42.861240 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b2559849-7e2b-4b45-b557-3ee7df958134 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:40:42.863035 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b2559849-7e2b-4b45-b557-3ee7df958134 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:40:42.863548 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-b2559849-7e2b-4b45-b557-3ee7df958134 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:40:43.065391 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-b2559849-7e2b-4b45-b557-3ee7df958134 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508cb16ab6343dfb7de72c6b3600ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211699de14224a63a48d253eaa061c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:40:43.074516 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-b2559849-7e2b-4b45-b557-3ee7df958134 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] 10.222.0.45 "GET /compute/v2.1/servers/55e131bc-148b-487f-8429-c2f47286ab8c" status: 200 len: 1392 microversion: 2.1 time: 0.249686 Dec 16 15:40:43.080414 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1151/2310] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:40:42 2021] GET /compute/v2.1/servers/55e131bc-148b-487f-8429-c2f47286ab8c => generated 1392 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:40:43.080573 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [req-e544a129-8986-408f-8cb7-93a91eee15ea req-37880eb2-01f9-41b5-be48-4de99d821946 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55e131bc-148b-487f-8429-c2f47286ab8c", "name": "network-vif-deleted", "tag": "6a38862a-109c-43da-917c-390dc4a17d8c"}]} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:40:43.096923 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:40:43.096923 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: warnings.warn(msg) Dec 16 15:40:43.096923 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-e544a129-8986-408f-8cb7-93a91eee15ea req-37880eb2-01f9-41b5-be48-4de99d821946 service nova] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:40:43.096923 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-e544a129-8986-408f-8cb7-93a91eee15ea req-37880eb2-01f9-41b5-be48-4de99d821946 service nova] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:40:43.111144 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.compute.server_external_events [req-e544a129-8986-408f-8cb7-93a91eee15ea req-37880eb2-01f9-41b5-be48-4de99d821946 service nova] Creating event network-vif-deleted:6a38862a-109c-43da-917c-390dc4a17d8c for instance 55e131bc-148b-487f-8429-c2f47286ab8c on hv-cinder-82189 Dec 16 15:40:43.116158 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [req-e544a129-8986-408f-8cb7-93a91eee15ea req-37880eb2-01f9-41b5-be48-4de99d821946 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045105 Dec 16 15:40:43.116791 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1160/2311] 10.222.0.45 () {64 vars in 1308 bytes} [Thu Dec 16 15:40:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 15:40:44.097428 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-cabf334c-8491-4513-9fb1-b920e54ac135 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:40:44.098163 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-cabf334c-8491-4513-9fb1-b920e54ac135 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] [instance: 55e131bc-148b-487f-8429-c2f47286ab8c] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:40:44.105947 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cabf334c-8491-4513-9fb1-b920e54ac135 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:40:44.106499 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cabf334c-8491-4513-9fb1-b920e54ac135 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:40:44.107933 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cabf334c-8491-4513-9fb1-b920e54ac135 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:40:44.108427 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cabf334c-8491-4513-9fb1-b920e54ac135 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:40:44.274851 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cabf334c-8491-4513-9fb1-b920e54ac135 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:40:44.275363 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-cabf334c-8491-4513-9fb1-b920e54ac135 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:40:44.275879 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.objects.instance [None req-cabf334c-8491-4513-9fb1-b920e54ac135 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lazy-loading 'fault' on Instance uuid 55e131bc-148b-487f-8429-c2f47286ab8c {{(pid=101355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 16 15:40:44.379461 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-cabf334c-8491-4513-9fb1-b920e54ac135 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508cb16ab6343dfb7de72c6b3600ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211699de14224a63a48d253eaa061c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:40:44.387891 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-cabf334c-8491-4513-9fb1-b920e54ac135 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] 10.222.0.45 "GET /compute/v2.1/servers/55e131bc-148b-487f-8429-c2f47286ab8c" status: 200 len: 1185 microversion: 2.1 time: 0.298658 Dec 16 15:40:44.389023 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1152/2312] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:40:44 2021] GET /compute/v2.1/servers/55e131bc-148b-487f-8429-c2f47286ab8c => generated 1185 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:40:45.411739 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-77f1b1d4-6a60-4419-b755-6128de8e0d89 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:40:45.412507 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-77f1b1d4-6a60-4419-b755-6128de8e0d89 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] [instance: 55e131bc-148b-487f-8429-c2f47286ab8c] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:40:45.421455 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-77f1b1d4-6a60-4419-b755-6128de8e0d89 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:40:45.422009 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-77f1b1d4-6a60-4419-b755-6128de8e0d89 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:40:45.422889 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-77f1b1d4-6a60-4419-b755-6128de8e0d89 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:40:45.423382 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-77f1b1d4-6a60-4419-b755-6128de8e0d89 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:40:45.477249 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.wsgi [None req-77f1b1d4-6a60-4419-b755-6128de8e0d89 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] HTTP exception thrown: Instance 55e131bc-148b-487f-8429-c2f47286ab8c could not be found. Dec 16 15:40:45.477956 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-77f1b1d4-6a60-4419-b755-6128de8e0d89 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Returning 404 to user: Instance 55e131bc-148b-487f-8429-c2f47286ab8c could not be found. {{(pid=101356) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:941}} Dec 16 15:40:45.478886 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-77f1b1d4-6a60-4419-b755-6128de8e0d89 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] 10.222.0.45 "GET /compute/v2.1/servers/55e131bc-148b-487f-8429-c2f47286ab8c" status: 404 len: 111 microversion: 2.1 time: 0.076241 Dec 16 15:40:45.479519 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1161/2313] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:40:45 2021] GET /compute/v2.1/servers/55e131bc-148b-487f-8429-c2f47286ab8c => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 15:40:49.969110 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-5277d834-e8b0-47b3-a8fd-bc80dbada694 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:40:49.969916 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-5277d834-e8b0-47b3-a8fd-bc80dbada694 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] [instance: 8551537f-b0e4-4f79-b9db-fc097f9828f3] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:40:49.970749 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [req-b78efb41-869f-41f4-a434-480d30983d76 req-0423fbd3-fd6e-444c-a0ae-8e57d002f930 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8551537f-b0e4-4f79-b9db-fc097f9828f3", "tag": "3fcc49cd-033e-4c73-a0be-c35b404689c8"}]} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:40:49.975328 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:40:49.975328 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: warnings.warn(msg) Dec 16 15:40:49.978143 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5277d834-e8b0-47b3-a8fd-bc80dbada694 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:40:49.978725 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5277d834-e8b0-47b3-a8fd-bc80dbada694 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:40:49.979642 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5277d834-e8b0-47b3-a8fd-bc80dbada694 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:40:49.980335 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-5277d834-e8b0-47b3-a8fd-bc80dbada694 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:40:49.984186 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-b78efb41-869f-41f4-a434-480d30983d76 req-0423fbd3-fd6e-444c-a0ae-8e57d002f930 service nova] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:40:49.984683 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-b78efb41-869f-41f4-a434-480d30983d76 req-0423fbd3-fd6e-444c-a0ae-8e57d002f930 service nova] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:40:50.002539 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.compute.server_external_events [req-b78efb41-869f-41f4-a434-480d30983d76 req-0423fbd3-fd6e-444c-a0ae-8e57d002f930 service nova] Creating event network-changed:3fcc49cd-033e-4c73-a0be-c35b404689c8 for instance 8551537f-b0e4-4f79-b9db-fc097f9828f3 on hv-cinder-82189 Dec 16 15:40:50.007798 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [req-b78efb41-869f-41f4-a434-480d30983d76 req-0423fbd3-fd6e-444c-a0ae-8e57d002f930 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044271 Dec 16 15:40:50.008867 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1162/2314] 10.222.0.45 () {64 vars in 1308 bytes} [Thu Dec 16 15:40:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 16 15:40:50.049603 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-5277d834-e8b0-47b3-a8fd-bc80dbada694 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] [instance: 8551537f-b0e4-4f79-b9db-fc097f9828f3] Going to try to terminate instance {{(pid=101355) delete /opt/stack/nova/nova/compute/api.py:2496}} Dec 16 15:40:50.265355 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-5277d834-e8b0-47b3-a8fd-bc80dbada694 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] 10.222.0.45 "DELETE /compute/v2.1/servers/8551537f-b0e4-4f79-b9db-fc097f9828f3" status: 204 len: 0 microversion: 2.1 time: 0.304200 Dec 16 15:40:50.266229 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1153/2315] 10.222.0.45 () {58 vars in 1229 bytes} [Thu Dec 16 15:40:49 2021] DELETE /compute/v2.1/servers/8551537f-b0e4-4f79-b9db-fc097f9828f3 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 16 15:40:50.279710 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-ec3ac476-3e39-4bcb-abad-c916f3122c94 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:40:50.280471 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-ec3ac476-3e39-4bcb-abad-c916f3122c94 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] [instance: 8551537f-b0e4-4f79-b9db-fc097f9828f3] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:40:50.289301 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ec3ac476-3e39-4bcb-abad-c916f3122c94 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:40:50.289870 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ec3ac476-3e39-4bcb-abad-c916f3122c94 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:40:50.290816 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ec3ac476-3e39-4bcb-abad-c916f3122c94 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:40:50.291310 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-ec3ac476-3e39-4bcb-abad-c916f3122c94 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:40:50.595031 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-ec3ac476-3e39-4bcb-abad-c916f3122c94 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508cb16ab6343dfb7de72c6b3600ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211699de14224a63a48d253eaa061c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101356) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:40:50.604677 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-ec3ac476-3e39-4bcb-abad-c916f3122c94 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] 10.222.0.45 "GET /compute/v2.1/servers/8551537f-b0e4-4f79-b9db-fc097f9828f3" status: 200 len: 1578 microversion: 2.1 time: 0.333627 Dec 16 15:40:50.605482 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1163/2316] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:40:50 2021] GET /compute/v2.1/servers/8551537f-b0e4-4f79-b9db-fc097f9828f3 => generated 1578 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:40:51.629794 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-13af8741-0cf9-489c-ba93-1b6b007c36a3 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:40:51.630556 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-13af8741-0cf9-489c-ba93-1b6b007c36a3 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] [instance: 8551537f-b0e4-4f79-b9db-fc097f9828f3] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:40:51.639311 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-13af8741-0cf9-489c-ba93-1b6b007c36a3 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:40:51.640042 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-13af8741-0cf9-489c-ba93-1b6b007c36a3 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:40:51.640678 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-13af8741-0cf9-489c-ba93-1b6b007c36a3 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:40:51.641177 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-13af8741-0cf9-489c-ba93-1b6b007c36a3 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:40:52.190172 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-13af8741-0cf9-489c-ba93-1b6b007c36a3 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508cb16ab6343dfb7de72c6b3600ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211699de14224a63a48d253eaa061c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:40:52.199514 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-13af8741-0cf9-489c-ba93-1b6b007c36a3 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] 10.222.0.45 "GET /compute/v2.1/servers/8551537f-b0e4-4f79-b9db-fc097f9828f3" status: 200 len: 1459 microversion: 2.1 time: 0.579137 Dec 16 15:40:52.200254 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1154/2317] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:40:51 2021] GET /compute/v2.1/servers/8551537f-b0e4-4f79-b9db-fc097f9828f3 => generated 1459 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:40:52.565586 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [req-142dfe91-521a-4571-a926-1aadbdaf9c36 req-02168f8d-25de-4cac-b227-f5510895207f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8551537f-b0e4-4f79-b9db-fc097f9828f3", "name": "network-vif-deleted", "tag": "3fcc49cd-033e-4c73-a0be-c35b404689c8"}]} {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:520}} Dec 16 15:40:52.570424 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1018: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 16 15:40:52.570424 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: warnings.warn(msg) Dec 16 15:40:52.579111 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-142dfe91-521a-4571-a926-1aadbdaf9c36 req-02168f8d-25de-4cac-b227-f5510895207f service nova] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:40:52.579601 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [req-142dfe91-521a-4571-a926-1aadbdaf9c36 req-02168f8d-25de-4cac-b227-f5510895207f service nova] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:40:52.600550 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.compute.server_external_events [req-142dfe91-521a-4571-a926-1aadbdaf9c36 req-02168f8d-25de-4cac-b227-f5510895207f service nova] Creating event network-vif-deleted:3fcc49cd-033e-4c73-a0be-c35b404689c8 for instance 8551537f-b0e4-4f79-b9db-fc097f9828f3 on hv-cinder-82189 Dec 16 15:40:52.605785 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [req-142dfe91-521a-4571-a926-1aadbdaf9c36 req-02168f8d-25de-4cac-b227-f5510895207f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048614 Dec 16 15:40:52.610702 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1164/2318] 10.222.0.45 () {64 vars in 1308 bytes} [Thu Dec 16 15:40:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 16 15:40:53.232318 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-e3771c3f-46bf-4b32-975c-c9f807386a6d tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:40:53.232318 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-e3771c3f-46bf-4b32-975c-c9f807386a6d tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] [instance: 8551537f-b0e4-4f79-b9db-fc097f9828f3] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:40:53.232984 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e3771c3f-46bf-4b32-975c-c9f807386a6d tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:40:53.233493 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e3771c3f-46bf-4b32-975c-c9f807386a6d tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:40:53.234410 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e3771c3f-46bf-4b32-975c-c9f807386a6d tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:40:53.234905 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e3771c3f-46bf-4b32-975c-c9f807386a6d tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:40:53.313917 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e3771c3f-46bf-4b32-975c-c9f807386a6d tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:40:53.314454 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-e3771c3f-46bf-4b32-975c-c9f807386a6d tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:40:53.314962 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.objects.instance [None req-e3771c3f-46bf-4b32-975c-c9f807386a6d tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lazy-loading 'fault' on Instance uuid 8551537f-b0e4-4f79-b9db-fc097f9828f3 {{(pid=101355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 16 15:40:53.436288 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.policy [None req-e3771c3f-46bf-4b32-975c-c9f807386a6d tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7508cb16ab6343dfb7de72c6b3600ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '211699de14224a63a48d253eaa061c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=101355) authorize /opt/stack/nova/nova/policy.py:193}} Dec 16 15:40:53.445259 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-e3771c3f-46bf-4b32-975c-c9f807386a6d tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] 10.222.0.45 "GET /compute/v2.1/servers/8551537f-b0e4-4f79-b9db-fc097f9828f3" status: 200 len: 1231 microversion: 2.1 time: 0.230292 Dec 16 15:40:53.445852 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1155/2319] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:40:53 2021] GET /compute/v2.1/servers/8551537f-b0e4-4f79-b9db-fc097f9828f3 => generated 1231 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 16 15:40:54.469410 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-60dcbb40-5abe-4824-9673-7a8a9a445e0b tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:40:54.470184 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-60dcbb40-5abe-4824-9673-7a8a9a445e0b tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] [instance: 8551537f-b0e4-4f79-b9db-fc097f9828f3] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:40:54.478237 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-60dcbb40-5abe-4824-9673-7a8a9a445e0b tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:40:54.478734 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-60dcbb40-5abe-4824-9673-7a8a9a445e0b tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:40:54.479553 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-60dcbb40-5abe-4824-9673-7a8a9a445e0b tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:40:54.480037 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-60dcbb40-5abe-4824-9673-7a8a9a445e0b tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:40:54.541974 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.wsgi [None req-60dcbb40-5abe-4824-9673-7a8a9a445e0b tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] HTTP exception thrown: Instance 8551537f-b0e4-4f79-b9db-fc097f9828f3 could not be found. Dec 16 15:40:54.542692 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-60dcbb40-5abe-4824-9673-7a8a9a445e0b tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Returning 404 to user: Instance 8551537f-b0e4-4f79-b9db-fc097f9828f3 could not be found. {{(pid=101356) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:941}} Dec 16 15:40:54.543614 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-60dcbb40-5abe-4824-9673-7a8a9a445e0b tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] 10.222.0.45 "GET /compute/v2.1/servers/8551537f-b0e4-4f79-b9db-fc097f9828f3" status: 404 len: 111 microversion: 2.1 time: 0.082910 Dec 16 15:40:54.544861 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1165/2320] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:40:54 2021] GET /compute/v2.1/servers/8551537f-b0e4-4f79-b9db-fc097f9828f3 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 15:40:55.425031 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-8d56106b-27f4-4907-b89e-f611f12c42a7 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Calling method '>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:40:55.425625 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-8d56106b-27f4-4907-b89e-f611f12c42a7 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] [instance: cd530067-1ba5-46f5-8d47-2dac866e61c1] Fetching instance by UUID {{(pid=101355) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:40:55.433398 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8d56106b-27f4-4907-b89e-f611f12c42a7 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:40:55.433902 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8d56106b-27f4-4907-b89e-f611f12c42a7 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:40:55.435277 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8d56106b-27f4-4907-b89e-f611f12c42a7 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:40:55.435764 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-8d56106b-27f4-4907-b89e-f611f12c42a7 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101355) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:40:55.489173 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.wsgi [None req-8d56106b-27f4-4907-b89e-f611f12c42a7 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] HTTP exception thrown: Instance cd530067-1ba5-46f5-8d47-2dac866e61c1 could not be found. Dec 16 15:40:55.489831 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-8d56106b-27f4-4907-b89e-f611f12c42a7 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Returning 404 to user: Instance cd530067-1ba5-46f5-8d47-2dac866e61c1 could not be found. {{(pid=101355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:941}} Dec 16 15:40:55.490772 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-8d56106b-27f4-4907-b89e-f611f12c42a7 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] 10.222.0.45 "DELETE /compute/v2.1/servers/cd530067-1ba5-46f5-8d47-2dac866e61c1" status: 404 len: 111 microversion: 2.1 time: 0.073498 Dec 16 15:40:55.491388 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1156/2321] 10.222.0.45 () {58 vars in 1229 bytes} [Thu Dec 16 15:40:55 2021] DELETE /compute/v2.1/servers/cd530067-1ba5-46f5-8d47-2dac866e61c1 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 15:40:55.503953 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-15ab2d44-add6-4790-a1b3-50507aed5298 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Calling method '>' {{(pid=101356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:40:55.504621 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.compute.api [None req-15ab2d44-add6-4790-a1b3-50507aed5298 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] [instance: cd530067-1ba5-46f5-8d47-2dac866e61c1] Fetching instance by UUID {{(pid=101356) get /opt/stack/nova/nova/compute/api.py:2748}} Dec 16 15:40:55.512377 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-15ab2d44-add6-4790-a1b3-50507aed5298 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:40:55.512952 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-15ab2d44-add6-4790-a1b3-50507aed5298 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:40:55.513851 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-15ab2d44-add6-4790-a1b3-50507aed5298 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:358}} Dec 16 15:40:55.514330 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG oslo_concurrency.lockutils [None req-15ab2d44-add6-4790-a1b3-50507aed5298 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Lock "93843735-3183-4729-8723-375da9e05360" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101356) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:370}} Dec 16 15:40:55.581357 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.wsgi [None req-15ab2d44-add6-4790-a1b3-50507aed5298 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] HTTP exception thrown: Instance cd530067-1ba5-46f5-8d47-2dac866e61c1 could not be found. Dec 16 15:40:55.582027 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-15ab2d44-add6-4790-a1b3-50507aed5298 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Returning 404 to user: Instance cd530067-1ba5-46f5-8d47-2dac866e61c1 could not be found. {{(pid=101356) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:941}} Dec 16 15:40:55.582966 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-15ab2d44-add6-4790-a1b3-50507aed5298 tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] 10.222.0.45 "GET /compute/v2.1/servers/cd530067-1ba5-46f5-8d47-2dac866e61c1" status: 404 len: 111 microversion: 2.1 time: 0.086928 Dec 16 15:40:55.583578 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101356|app: 0|req: 1166/2322] 10.222.0.45 () {58 vars in 1226 bytes} [Thu Dec 16 15:40:55 2021] GET /compute/v2.1/servers/cd530067-1ba5-46f5-8d47-2dac866e61c1 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 16 15:40:57.120588 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: DEBUG nova.api.openstack.wsgi [None req-ef8acdea-d682-4557-aec2-4c8095dd9d5a tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] Calling method '.version_select at 0x7f14f732e8c8>' {{(pid=101355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:523}} Dec 16 15:40:57.157407 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: INFO nova.api.openstack.requestlog [None req-ef8acdea-d682-4557-aec2-4c8095dd9d5a tempest-TestVolumeBootPattern-1862920404 tempest-TestVolumeBootPattern-1862920404-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1519735302" status: 202 len: 0 microversion: 2.1 time: 0.044207 Dec 16 15:40:57.158054 dv-cinder-821894-3-iscsi devstack@n-api.service[101353]: [pid: 101355|app: 0|req: 1157/2323] 10.222.0.45 () {58 vars in 1253 bytes} [Thu Dec 16 15:40:57 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1519735302 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)